Stanford Study: LLMs Solve Image-Based Medical Questions Better Than Radiologists — Without Seeing the Image

r/singularity·medium signal

A Stanford study co-authored by Fei-Fei Li asked LLMs to perform radiology tasks requiring an image to solve, but gave them no image. The models outperformed radiologists on the same questions, suggesting LLMs exploit statistical correlations in question text rather than performing genuine visual reasoning. 104 upvotes, 38 comments on r/singularity. This challenges assumptions about multimodal AI capabilities.