MIT

Key findings

1. 1948

   A Mathematical Theory of Communication

   Claude Shannon

   Defined information in bits and the entropy of a source: H = −Σ p log p.

   Why it matters here · Cross-entropy loss — the objective every language model in this catalog is trained against — is a direct application.

   H = −Σ p log p
2. 1966

   ELIZA

   Joseph Weizenbaum

   A pattern-matching script that convincingly imitated a Rogerian therapist in a few hundred lines.

   Why it matters here · Named the ELIZA effect: people attribute understanding to fluent text. Still the single biggest source of overstated AI capability claims.
3. 1969

   Perceptrons

   Marvin Minsky and Seymour Papert

   Proved a single-layer perceptron cannot represent XOR, and questioned whether deeper nets could be trained.

   Why it matters here · Triggered the first AI winter — and the exact limitation that backpropagation later dissolved. The clearest case study in how a proof about one architecture can freeze a field.
4. 1995

   Quantum error correction codes

   Peter Shor (then Bell Labs, later MIT)

   Proved that quantum information can be protected by encoding one logical qubit across nine physical qubits.

   Why it matters here · Every logical-qubit roadmap in the Quantum segment is measured against this idea.

   9 physical → 1 logical qubit
5. 2019

   The Lottery Ticket Hypothesis

   Frankle, Carbin

   Dense networks contain sparse subnetworks that, trained from the original initialisation, match full accuracy.

   Why it matters here · The intellectual basis for the pruning and distillation that produce the small/cheap tiers in vendor pricing tables.
6. 2020

   Liquid neural networks

   Hasani, Rus et al., CSAIL

   Continuous-time networks whose neuron dynamics adapt after training, robust with very few units.

   Why it matters here · An active alternative line for edge robotics and drones where a transformer will not fit in the power budget.
7. 2022

   Neural rendering and differentiable simulation

   CSAIL graphics groups

   Differentiable renderers and simulators that let gradients flow through physics and image formation.

   Why it matters here · Under the 3D and world-model products beginning to appear in the video/3D segment.

On the history timeline

Milestones on the 1943 → today timeline credited to this institution.

• 1966ELIZA — the first chatbot, and the first AI illusionJoseph WeizenbaumSymbolic era & the winters
• 1969Perceptrons — the book that triggered the first AI winterMarvin Minsky & Seymour PapertSymbolic era & the winters
• 1981Simulating Physics with ComputersRichard FeynmanSymbolic era & the winters
• 1986Subsumption architecture — intelligence without representationRodney BrooksConnectionist revival

What to follow