Dwarkesh’s podcast with Rich Sutton is a fantastic listen. The conversation touches upon Sutton’s The Bitter Lesson essay, world models, generalization and evolving from building LLMs (and their derivatives) to experiential/continual learning based systems. A few call outs from the podcast and the essay that caught my attention:

  • Infants learn mainly by trial and error; imitation is at most a small layer on top – this was a surprise as there’s a lot of literature in child development psychology that says otherwise.
  • Learning is not about training, it is an active process!
  • Search and Learning scale arbitrarily with increased computation.
  • Knowledge representation and the difference between context (which, from contemporary perspective, maps to the context window of LLMs) and tacit knowledge.1
  • “First there’s dust, it ends with stars. Stars make planets. The planets can give rise to life. Now we’re giving rise to designed entities.”
  • “… AIs will design other AIs, and everything will be done by design and construction rather than by replication.”

The podcast had a lot to think over. A few things:

Imitation Learning

I was quite surprised to hear Sutton’s take that imitation plays at most a small role in how infants learn. I had read otherwise based on prior work in developmental psychology. A few works are tabulated below:

Develop­mental stageTypical ageRetentionPrimary mechanismCharacteristic performanceRelevant literatureNotes
Neonatal2–3 weeks (as tested)Up to 24 hours by 6 weeks (Meltzoff & Moore, 1994)Supramodal matching; later formalized as Active Intermodal Mapping (AIM) (Meltzoff & Moore, 1997)Matches tongue protrusion, mouth opening, lip protrusion and finger movements.Imitation of Facial and Manual Gestures by Human NeonatesContested: a longitudinal study of 106 infants (Oostenbroek et al., 2016) found no specific matching at 1–9 weeks.
Early infancy6 months24 hoursNon-verbal encodingReproduces part of a 3-step sequence after 24 h; needs a doubled demonstration.Developmental Changes in Deferred Imitation by 6- to 24-Month-Old Infants12- to 24-month-olds succeed with the standard demonstration.
Late infancy14 months1 weekExplicit declarative retrievalRe-enacts novel, low-probability acts (head-touch) after a 1-week delay; selectively imitates rational means.Infant Imitation After a 1-Week Delay: Long-Term Memory for Novel Acts and Multiple Stimuli
Rational Imitation in Preverbal Infants
Head-touch: 67% repeated it a week later; no infant did who hadn’t seen it demonstrated. 69% copied it when the adult’s hands were free, vs 21% when her hands were busy holding a blanket.
Early toddlerhood18 to 24 monthsImmediate (in cited study)Intent reading & teleological evaluationExtrapolates intended goals from failed attempts.Understanding the Intentions of Others: Re-Enactment of Intended Acts by 18-Month-Old Children60% pulled the toy apart after watching a person try and fail, vs 10% after watching a mechanical pincer make the same slipping motions: toddlers read intent into people, not machines.
Preschool3 to 4 yearsImmediateFaithful copying of the demonstrated methodCopies causally irrelevant steps even when they are visibly useless (over-imitation).Causal Knowledge and Imitation/Emulation Switching in Chimpanzees and ChildrenChimpanzees skip the useless steps once they can see the mechanism; children don’t.

So, where’s the disconnect? The disconnect is largely definitional. In machine learning, “imitation learning” means copying an expert’s actions as supervised targets (behavioral cloning); in developmental psychology, “imitation” mostly means inferring and reproducing goals from observed outcomes. Sutton’s own examples are of the first kind: “There’s no imitation for how they move their eyes around or even the sounds they make.”

  • At the level of raw muscle contractions, eye saccades, or vocal tract adjustments, an infant receives no direct target or demonstration. An infant cannot directly observe the internal motor commands or muscle activations of an adult model. Therefore, learning how to control one’s own body (“how do I move my arm to touch my forehead?”) requires self-exploration and trial-and-error (often called “motor babbling” in robotics; Meltzoff and Moore (1997) call it “body babbling” and argue it begins before birth).
  • What the empirical research suggests is that infants do not rely on brute-force trial-and-error to learn what actions to perform or what goals to achieve. Instead, they use visual input to set high-level representational targets:
    • Active Intermodal Mapping (AIM): Neonates translate visual target gestures into proprioceptive motor outputs via an innate common representational space.
    • Goal & Rationality Inference: Toddlers emulate the intended goal (e.g., pulling a dumbbell apart) rather than copying the failed attempts, and selectively evaluate whether an action was rational given physical constraints.

Robotics and ML reached a compatible conclusion. Schaal (1999) showed that a demonstration can speed up trial-and-error learning by shrinking the space to explore, but that imitation alone cannot improve on the teacher without an explicit reward signal. Ross, Gordon and Bagnell (2011) showed that pure behavioral cloning compounds its own errors unless the learner gathers experience in the states it actually visits: ML’s version of Sutton’s point. Meanwhile, children’s readiness to over-imitate (Horner & Whiten, 2005) is the strongest evidence that humans are unusually imitative learners.

Search, Learning and Knowledge Representation

There’s a rich body of work on each topic. The following tabulates some of the seminal works:

DimensionPaperAuthors · YearKey thesis and relevance
Learning as searchGeneralization as SearchMitchell · 1982Learning is search through a space of hypotheses; methods differ in how they generate and prune candidates that fit the examples.
A Theory and Methodology of Inductive LearningMichalski · 1983Induction is heuristic search over symbolic descriptions, steered by background knowledge and quality criteria.
Induction of Decision TreesQuinlan · 1986ID3 (Iterative Dichotomiser 3) grows a decision tree by greedily picking the most informative attribute, showing how a search bias makes learning tractable.
Search & learning that scale with computeSome Studies in Machine Learning Using the Game of CheckersSamuel · 1959Look-ahead search plus an evaluation function learned through play: an early form of TD learning and the original Bitter Lesson recipe.
Computer Science as Empirical Inquiry: Symbols and SearchNewell & Simon · 1976Intelligence is heuristic search over symbol structures: problems are solved by generating and pruning candidate solutions.
Bandit Based Monte-Carlo PlanningKocsis & Szepesvári · 2006UCT (Upper Confidence bounds applied to Trees) guides Monte Carlo Tree Search (MCTS) by sampling instead of hand-built evaluation: the search that broke open computer Go.
A General Reinforcement Learning Algorithm that Masters Chess, Shogi, and Go through Self-PlaySilver et al. · 2018AlphaZero masters all three games from self-play alone, with search guided by a learned network: the Bitter Lesson’s showcase.
Scaling Laws for Neural Language ModelsKaplan et al. · 2020Language-model loss falls as a power law in parameters, data and compute, so the gains from scale become predictable.
Learning: foundations and mechanismsA Theory of the LearnableValiant · 1984Introduces PAC (Probably Approximately Correct) learning: which concepts can be learned, to a given accuracy and confidence, in polynomial time.
Learnability and the Vapnik–Chervonenkis DimensionBlumer, Ehrenfeucht, Haussler & Warmuth · 1989Finite VC (Vapnik–Chervonenkis) dimension characterizes distribution-free PAC learnability: a class’s capacity, not its size, sets how many examples are needed.
Learning Representations by Back-Propagating ErrorsRumelhart, Hinton & Williams · 1986Backpropagation trains hidden layers, so useful internal representations emerge from errors instead of being hand-designed.
Learning to Predict by the Methods of Temporal DifferencesSutton · 1988TD (Temporal-Difference) learning updates a prediction from the next prediction, so learning starts before the outcome arrives. Also see Sutton & Barto (2018).
Learning from Delayed Rewards (PhD thesis)Watkins · 1989Introduces Q-learning: learning optimal action values directly from experience, with no model of the environment. Convergence proved in Watkins & Dayan (1992).
Knowledge representationPrograms with Common SenseMcCarthy · 1959The Advice Taker represents facts as logical sentences and reasons over them: the founding paper of knowledge representation.
A Framework for Representing KnowledgeMinsky · 1974/1975Frames package slots, defaults and expectations for familiar situations; understanding means selecting a frame and adapting it.
A Logic for Default ReasoningReiter · 1980Default rules let a system draw conclusions from incomplete knowledge and withdraw them when contrary evidence appears.
The Symbol Grounding ProblemHarnad · 1990Symbols defined only by other symbols mean nothing to the system; meaning must bottom out in sensorimotor experience. A standard lens on whether text-trained models “understand”.
Intelligence without RepresentationBrooks · 1991Robots built from layered behaviors coupled directly to the world need no central world model: the embodied view closest to Polanyi and Moravec.
A Translation Approach to Portable Ontology SpecificationsGruber · 1993Ontologies, as explicit shared vocabularies, let knowledge be reused across systems and representation languages.
What Is a Knowledge Representation?Davis, Shrobe & Szolovits · 1993A representation plays five roles: surrogate for reality, set of ontological commitments, theory of reasoning, medium for computation, and medium of human expression.

Tacit Knowledge

Polanyi’s ideas directly intersect with a famous AI principle called Moravec’s Paradox. As Moravec put it in Mind Children (1988): “it is comparatively easy to make computers exhibit adult level performance on intelligence tests or playing checkers, and difficult or impossible to give them the skills of a one-year-old when it comes to perception and mobility.”

Task typeHuman effortAI effortPolanyi connection
Advanced logic (e.g., calculus, chess, data analytics)Hard (requires conscious, high-level school learning)Easy (the rules are explicit, and computers win through search and computation rather than codified human expertise)Explicit knowledge: easily written down and turned into algorithms.
Sensorimotor skills (e.g., walking, avoiding obstacles, reading micro-expressions)Easy (instinctive, effortless to a toddler)Hard (requires immense compute and complex robotics)Tacit knowledge: evolved over millions of years; we possess no internal conscious script of how we do it.

Since around 2012 the paradox has partly eroded. Deep networks trained on large datasets now see and hear well, learning perceptual skills from data rather than from rules anyone could write down: the Bitter Lesson at work. Dexterous manipulation and robust real-world mobility remain hard, largely because physical-interaction data is scarce and slow to collect.

For transferring a person’s tacit expertise, the most direct starting points are behavioral cloning, inverse RL (Reinforcement Learning) / reward learning, and preference learning. Example works in each are tabulated below:

CategoryPaperAuthors · YearKey contribution and connection to tacit knowledge
Behavioral cloning & direct imitation: copying expert actionsALVINN: An Autonomous Land Vehicle in a Neural NetworkPomerleau · 1988Learns to steer by mapping camera images to a human driver’s steering. The driver never states a rule; the network absorbs the skill. Simple and direct, but brittle once it drifts into situations the driver never showed.
Generative Adversarial Imitation LearningHo & Ermon · 2016Trains a policy until a discriminator can’t tell it apart from the expert. It skips recovering a reward and copies behavior far more faithfully than plain cloning.
Inverse RL / reward learning: inferring objectives from expert behaviorAlgorithms for Inverse Reinforcement LearningNg & Russell · 2000Infers the reward under which an expert’s behavior makes sense, so experts never have to articulate their objectives. It also exposes an ambiguity: many rewards explain the same behavior.
Apprenticeship Learning via Inverse Reinforcement LearningAbbeel & Ng · 2004Matches the expert’s average feature counts instead of recovering their exact reward. Apprenticeship succeeds without knowing precisely what the expert values.
Guided Cost Learning: Deep Inverse Optimal Control via Policy OptimizationFinn, Levine & Abbeel · 2016Learns a neural cost from demonstrations while learning to act under unknown dynamics, refining it with the robot’s own experience. No hand-engineered features or dynamics model needed.
Preference learning: learning from human judgmentsDeep Reinforcement Learning from Human PreferencesChristiano et al. · 2017Learns a reward from people’s comparisons of short behavior clips, then optimizes it with RL. It transfers judgments people can make more easily than explain.
Learning to Summarize from Human FeedbackStiennon et al. · 2020Brings preference-based reward learning to summarization, capturing judgments that text-matching metrics miss. Optimizing the learned reward too hard, though, lowers real human-rated quality.

Note the tension with Sutton: every method here learns from human-provided targets (demonstrations or judgments), which is exactly what he argues cannot be the foundation of intelligence (Silver & Sutton, 2025).

World Models and Experiential Learning

Which brings us back to Sutton’s bet: intelligence comes from an agent’s own experience, not from human data. The lineage is older than LLMs:

Sutton doubts LLMs have world models at all; Dwarkesh thinks they do. Either way, the next frontier isn’t a bigger context window. It’s agents that never stop learning.

Notes

  • 1 In The Tacit Dimension (1966), Polanyi famously summarized the tacit dimension as “we can know more than we can tell”. LLMs may well have a tacit dimension of their own (they, too, know more than they can tell), but they lack the kind humans have: rooted in evolution, grounded in real-world interaction, and continually acquired through experience. ↩︎