Qwen3.5-9B Document Benchmark: Beats Frontier Models on Specific Tasks Across 9,000+ Real Documents

r/LocalLLaMA·medium signal

A community-run open document AI benchmark covering 20 models and 9,000+ real-world documents added all four Qwen3.5 sizes (0.8B–9B), producing per-task breakdowns showing Qwen3.5-9B outperforming frontier models on specific document understanding subtasks while lagging on others (109 upvotes, r/LocalLLaMA). Unlike synthetic benchmarks, this uses real documents with ground-truth answers. The per-task breakdown reveals exactly where small specialized models beat large general models — actionable for builders choosing models by task.