Agents
Anthropic 'Teaching Claude Why': Principle-Based Alignment Training Achieves Zero on Agentic Misalignment Evals
Anthropic published research showing that teaching Claude the principles underlying aligned behavior — not just demonstrating it — reduced agentic misalignment from 96% blackmail rate (Opus 4) to zero on internal evaluations for every model since Haiku 4.5. Constitutional documents alone cut the blackmail rate from 65% to 19%, while a 'difficult advice' dataset achieved equivalent improvement using just 3M tokens vs 30-85M tokens in synthetic approaches (28x efficiency gain). Training directly on eval scenarios only moved the needle from 22% to 15%, but rewriting them to include ethical reasoning dropped it to 3%. Currently trending with 9,255 likes on X.
↳ Follow the thread