Dissecting the Black Box: Circuit-Level Analysis of LLM Vulnerability Detection

arXiv·high signal

Uses mechanistic interpretability (Circuit Tracer on Gemma-2-2b) to trace how LLMs actually identify vulnerable code. Surprising finding: the model primarily relies on safe-code patterns rather than vulnerability signatures, suggesting current LLM vulnerability detectors may be more brittle than performance metrics indicate.