Reddit
Opus 4.7 Benchmark Regressions Quantified — MRCR 78.3%→32.2%, NYT Connections 94.7%→41.0%, Thematic Generalization 80.6→72.8
Independent benchmarks confirm the community complaints are not perception bias. Multi-Round Context Retrieval (MRCR) collapsed from 78.3% to 32.2% — a 59% relative decline. The NYT Connections Extended benchmark (lechmazur/GitHub) dropped from 94.7% to 41.0% on Opus 4.7 (high). Thematic Generalization fell from 80.6 to 72.8. Anthropic's own BrowseComp regressed 84.0%→79.3%. The model wins 12 of 14 official benchmarks but the regressions cluster in reasoning and context tasks — exactly what power users rely on.
Source
↳ Follow the thread