Fetching from the wire…
Public story · 2026-03-07 · source-backed
Chollet confirmed ARC-AGI-3 launches March 25 — the first major format change since 2019. The key shift: ARC-3 tests interactive reasoning and agency — a model's capacity to set and pursue goals independently. The scoring metric provides the first formal human vs. AI action efficiency comparison. Chollet: "The era of simply scaling up models to achieve intelligence has run its course." (ARC Prize)
Each link below shares sources, entities, or timing with this story.
First major format change since ARC was introduced in 2019. Version 3 tests interactive reasoning and agency — an AI's capacity to set and pursue goals independently. New metric formally compares human vs AI "action efficiency." Developer Toolkit released, public launch March...
ARC-AGI-3 makes a fundamental shift: instead of static puzzle-solving, it measures agency — a model's capacity to set and pursue goals independently in interactive environments. Public release March 25. If frontier models still fail at ARC-AGI-3 despite succeeding at coding ta...
First interactive reasoning benchmark. Top agent (StochasticGoose) scored 12.58% vs. humans. "Intelligence is efficiency." Agents struggle to convert environmental feedback into coherent strategies. Full launch March 25. ARC Prize
Drops static puzzles for interactive games where agents must figure out rules through exploration. First format change since 2019. Preview: most humans beat the games easily; AI agents struggle. ARC Prize
Chollet confirmed GPT-5.2 at 46-50%, Poetiq at 54%. But he cautions: "Saturating ARC does not mean we have AGI." ARC-AGI-3 launches March 25 with harder abstractions. For builders, the current benchmark race validates that agent scaffolding improvements (not just model improve...
GPT-5.4 scores 0.26%. Opus 4.6 scores 0.25%. Grok-4.20 scores 0.00%. Humans score 100%. The Decoder covered the ARC-AGI-3 launch on March 25, and the results make every "AGI is here" claim look premature. François Chollet launched ARC-AGI-3 at Y Combinator HQ alongside a fires...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.