Voices
Google Gemma 4 26B-A4B: Mixture-of-Experts Model Hits #6 on Arena Leaderboard With Only 4B Active Parameters
Google's Gemma 4 26B-A4B, released under Apache 2.0, achieves striking benchmark results by activating only 3.8B of its 26B total parameters during inference via Mixture-of-Experts routing. Key scores: 88.3% on AIME 2026 math, 77.1% on LiveCodeBench v6, 82.3% on GPQA Diamond graduate-level science, securing #6 on the Arena AI text leaderboard. At ~150 tokens/second on consumer GPUs, it runs essentially at reading speed. GGUF quantized versions are now trending on r/LocalLLaMA with community benchmarks confirming the numbers hold after quantization.
Source
↳ Follow the thread