Sources
AI Explained: Gemini 3.1 Pro and the Downfall of Benchmarks — Welcome to the Vibe Era of AI
AI Explained (107K views) breaks down Gemini 3.1 Pro's record benchmark scores — 77.1% on ARC-AGI-2 (up from 31.1%), 2887 Elo on LiveCodeBench Pro, 94.3% on GPQA Diamond — while questioning whether benchmarks still meaningfully capture model intelligence. The video argues we've entered a 'vibe era' where subjective user experience increasingly diverges from quantitative scores, featuring comparisons with the new Sonnet. Raises a fundamental question for builders: if benchmarks no longer predict real-world utility, what should guide model selection?
Source
↳ Follow the thread