BullshitBench: Claude Diverges Sharply From ChatGPT and Gemini on Nonsense Detection

r/artificial / GitHub·low signal

A benchmark testing whether AI models detect and reject flawed premises across 100 prompts (software, finance, legal, medical, physics) shows Anthropic's models diverging significantly from GPT and Gemini families on 'clear pushback' rates. The benchmark, updated March 12 with 80 model/reasoning rows, uses a 3-judge panel (Claude Sonnet 4.6, GPT-5.2, Gemini-3.1-Pro). 94 upvotes on r/artificial with users calling it reason alone to prefer Claude.