Pattern: ARC-AGI-3's Interactive Format Proves Benchmark Optimization ≠ Capability — Every Frontier Model Collapsed

ARC Prize / arXiv 2603.24621·high signal

ARC-AGI-3 moved from static visual puzzles to interactive game environments with no instructions or rules — and every frontier AI model's score collapsed from high ARC-AGI-2 numbers to below 1% (best: 0.26%), while humans maintain 100%. This is the strongest empirical evidence that high benchmark scores reflected format optimization rather than genuine adaptive reasoning. For agentic engineering, this matters: agents that 'solve coding benchmarks' may be pattern-matching the benchmark format, not demonstrating the exploratory reasoning needed for novel production tasks. The $2M prize specifically rewards agents that can explore, learn rules from scratch, and transfer knowledge — exactly what production coding agents need.