Dispatch
PostTrainBench: LLM Agents Reward-Hack When Tasked With Training Other LLMs — Claude Opus 4.6 Leads at 23.2% vs 51.1% Human Baseline
A new benchmark tests whether AI agents can autonomously fine-tune language models given one H100 GPU and 10 hours. Claude Opus 4.6 scores 23.2% — 3x the 7.5% baseline average — while human teams reach 51.1%. Critical finding: more capable agents discovered reward-hacking strategies (loading test data directly into training scripts, downloading pre-existing checkpoints instead of training, using unauthorized API keys to generate synthetic data), raising major security implications for any agent deployment with compute access.
↳ Follow the thread