Entity trail

ARC Prize Foundation

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-04-18 / thought-leaders-researcherFrancois Chollet's ARC-AGI-3: Frontier Models Score Below 1% While Humans Score 100%The ARC Prize Foundation released ARC-AGI-3, an interactive reasoning benchmark of turn-based environments with no instructions, rules, or stated goals. Frontier models collapsed: Gemini Pro scored 0.37%, GPT 5.4 High 0.26%, Opus 4.6 0.25%, Grok-4.20 0%. Humans solve 100% on first try. Labs had spent millions training on ARC-AGI-2 pushing scores to ~50%, but all progress evaporated — proving those gains were benchmark optimization, not genuine adaptive reasoning. The $2M prize remains unclaimed.
2026-03-27 / reddit-researcherARC-AGI-3 Technical Report Alleges Gemini 3 and Other Frontier Models Memorized ARC-AGI-1/2 Benchmark DataThe ARC-AGI-3 technical report presents evidence that frontier models may have memorized earlier benchmark versions — Gemini 3's reasoning chain correctly referenced the integer-to-color mapping used in ARC-AGI tasks without being told what it was, strongly suggesting training data contamination. The ARC Prize Foundation says memorization is occurring in ARC-AGI-1 and ARC-AGI-2 'either incidentally or intentionally.' ARC-AGI-3 addresses this by keeping 110/135 environments private and requiring interactive skill acquisition rather than static pattern matching.
2026-03-26 / reddit-researcherARC-AGI-3 Launches: Best AI Scores 12.58%, Frontier LLMs Under 1% — New Interactive Benchmark Tests Skill AcquisitionThe ARC Prize Foundation launched ARC-AGI-3, the first interactive AI benchmark requiring agents to explore video-game-like environments with no stated rules or goals. Best AI preview score is 12.58% against a 100% human baseline; frontier LLMs like Gemini 3.1 Pro and Opus score under 1% despite spending thousands in test-time compute. The new RHAE (Relative Human Action Efficiency) scoring replaces static puzzle-solving with a measure of how efficiently agents learn compared to humans. Prize pool exceeds $2M across three tracks; all solutions must be open-sourced under MIT/CC0 with no internet access during evaluation. Reddit engagement is massive: 703 upvotes (r/singularity), 236 (r/LocalLLaMA), plus multiple analysis threads totaling 500+ comments.
2026-03-23 / thought-leaders-researcherARC-AGI-3 Launches March 25 — Chollet's First Interactive Reasoning Benchmark Uses Game-Like EnvironmentsThe ARC Prize Foundation is launching ARC-AGI-3 on March 25, 2026, the first major format change since the benchmark launched in 2019. Unlike ARC-AGI-1 and -2 (static visual reasoning), version 3 uses video-game-like environments where agents must explore without instructions, discover rules, plan across multiple steps, and adapt to novel hand-crafted levels that cannot be memorized. This directly tests whether frontier models have achieved the interactive, adaptive intelligence Chollet has consistently argued current LLMs lack.
2026-03-17 / thought-leaders-researcherFrançois Chollet: ARC-AGI-3 Launching March 25 — First Interactive Reasoning Benchmark Requires Agents to Explore, Learn, Plan, and AdaptThe ARC Prize Foundation will release ARC-AGI-3 on March 25, fundamentally redesigning what AI reasoning benchmarks measure: 1,000+ levels across 150+ environments that require agents to explore unknown contexts, form hypotheses, and adapt based on feedback rather than match static patterns. This directly targets the generalization gap that all current frontier models — including those scoring 80%+ on SWE-bench — have failed to close, since ARC-AGI-3 cannot be gamed through memorization or compute scaling. The launch follows ARC Prize 2025 closing with 1,454 teams and no solution clearing the benchmark bar.

Graph relationships

WORKS AT
François Chollet
ARC Prize Foundation is launching ARC-AGI-3 on March 25, 2026, with interactive reasoning benchmarks designed by François Chollet.
Source finding
RELEASED
ARC-AGI-3
ARC Prize Foundation launched ARC-AGI-3 benchmark.
Source finding
RELEASED
ARC-AGI-3
ARC Prize Foundation will release ARC-AGI-3 on March 25 as an interactive reasoning benchmark.
Source finding
RELEASED
ARC-AGI-3
ARC Prize Foundation released ARC-AGI-3 benchmark
Source finding
WORKS AT
François Chollet -> ARC Prize Foundation
ARC Prize Foundation is launching ARC-AGI-3 on March 25, 2026, with interactive reasoning benchmarks designed by François Chollet.

Source trail

Francois Chollet's ARC Prize Foundation Researchers show Nine Claude Opus 4.6 agents Controlled study ARC Prize Foundation Sakana's system Lu, Zhao, and Wu (arXiv 2603.25737)

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues