Fetching from the wire…
Public story · 2026-08-17 · high
It forces the agent to write and test a working simulator before acting, lifting the same model from 7.8% to 93.3%.
Why now: The paper landed in the August 17 briefing, built around an unknown grid game the agent had never encountered.
Twin cleared 179 of 183 ARC-AGI-3 levels by writing a working simulator before it acted, per a new arXiv paper. For anyone building agents in unfamiliar environments, that's the failure point worth watching: the world model, not the acting. On the same base model, Twin's loop lifted scores from 7.8% played directly to 93.3%, up from 61.1% under a standard harness.
The system won't let the agent touch the game until its program matches every transition already observed. Each mismatch becomes a counterexample, which the agent uses to rewrite the model. That loop repeats until the simulation matches the real game, and only then can the agent act inside it.
That approach cleared 179 of 183 levels, a 97.8% rate, and beat first-time human action efficiency on 158 of them, according to the paper.
The paper's own conclusion cuts against the headline number. Building a working simulator turned out to be the easy part. Inferring the actual goal of each game was hard. The system worked out the goal before earning any reward on only 87.2% of the levels it cleared.
Each link below shares sources, entities, or timing with this story.
Sergey Rodionov's paper tests four Codex-based agent variants to isolate what actually drives performance. Verification (simplification plus exact observation reproduction) ranked highest in every setting, but at substantially higher cost. The textual baseline beat the executa...
If you're tuning an agent system, upgrade the model doing the tuning before you rewrite a single line of the harness. That's the finding from HarnessOpt-Bench (arXiv 2608.06301, Scale AI), which tests whether frontier models can improve an agent *system* rather than write code...
Tycho formalizes ARC-AGI-3 games as parameterized rendered deterministic Moore machines and has a coding agent build, test, repair, or bypass a free-form executable hypothesis during play. Across all 25 public games under matched budgets, actor-requested delegation scored 88.4...
Four frontier models. Five sealed engineering problems. The result everybody will quote is that Claude Fable 5 won. The result that should actually change how you work is buried three-quarters down the page. JuliaHub published an evaluation on July 30 running four frontier mod...
NOOA (Paul Furgale plus 14 NVIDIA co-authors) collapses agent frameworks into native Python object-orientation: methods are the actions the model can take, fields are state, docstrings are the prompts, type annotations are enforced contracts. It combines typed I/O, pass-by-ref...
ARC-AGI-2 Reasoning Race. Gemini 3.1 Pro hit 77.1% and Claude Opus 4.6 hit 68.8% — both more than doubling their predecessors' scores in a single generation. The entire field moved ~10 points over the prior two years; each model jumped 30-40 points in one release. The top thre...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.