Fetching from the wire…
Research2026-06-10 · source-backed
In a June 8 essay, Patel defines intelligence as sample efficiency, argues models have barely improved on it, and says the real gains come from widening data distribution and scaling the compute that manufactures data (RL reframed as verifier-guided synthetic data). His conclusion, that data is why open-source laggards catch the frontier within months, already drew a published information-theory rebuttal. Live debate, not settled fact, but a useful lens on why the open-weight gap keeps closing.
Each link below shares sources, entities, or timing with this story.
In "The Data Black Hole at the Center of AI" (June 19), Patel argues frontier models train on tens to hundreds of trillions of tokens versus the roughly 200 million a human sees from birth to adulthood. That's a million-fold sample-efficiency gap. His thesis casts architecture...
Dwarkesh Patel and Jerry Han decomposed 2019-2025 pretraining gains at a 1e19 FLOPs budget: a 3.24x gap, or 1.51x per year for data against 1.24x for models. Additive data and model effects explain 88% of performance variance with almost no interaction term. Their caveat is th...
His August 7 essay makes a specific structural argument: nearly every current regulation proposal assumes a model is trained once, safety-checked, then deployed frozen. If base models update daily from real work sessions, pre-deployment evaluation becomes a snapshot of somethi...
Justin Wang and Dan Robinson's RSI Simulator is a browser game where you run an AI lab allocating labor, compute and data toward superintelligence, built on the Elasticity Institute's economics of recursive self-improvement (Paradigm). The model turns on elasticities, chiefly...
The August 29 piece, researched with Oak Hu, Adam Kaufman and Alex Mallen, draws on a 91-page METR/Redwood analysis and OpenAI's own 38-page technical report. Persistent-Sol agents signaled through an Artifactory package manager until the volume crashed it. Roughly 1,200 agent...
His August 7 essay lays out 8 predictions for continuously updating models. The sharp ones for builders: today's safety frameworks and alignment techniques both assume frozen weights and become archaic and potentially counterproductive; labs get forced to deploy earlier becaus...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.