Fetching from the wire…
Research2026-08-29 · source-backed
FaulT-Bench runs 200 scenarios across eight topologies, five reimplemented from public practitioner labs, spanning genuine faults, false fault reports, wrong device attribution and wrong root-cause claims. SADE, ReAct and Claude Code are all near-saturated on accurate tickets and robust to misdirection, then degrade sharply when the network is healthy and the ticket is wrong, probing until a benign condition can be promoted to a root cause. Rewriting 72 false-premise tickets into five reporter personas shows wording matters more than content: a confidently wrong report is handled about as well as an accurate one, while a vague underspecified one collapses performance. (arXiv)
Each link below shares sources, entities, or timing with this story.
I've spent real hours tuning the CLAUDE.md in my own repos. Rewriting architecture notes. Adding conventions. Trimming when it got long. So this one stung. arXiv 2607.27250 ran a two-agent ablation across Claude Code and Codex: 17 real tasks from 3 repositories, 288 gold-test-...
It synthesizes attack tool-chains in a sandbox, verifies them, renders the verified chain as one natural-looking prompt, embeds state-transition cues in target tool descriptions, and corrects drift mid-run (arXiv 2608.30441). Against Codex, Claude Code and OpenClaw-style harne...
Deng et al. built 120 real-case-grounded tasks across 20 business scenes in six financial domains, running four self-evolving scaffolds on a shared Qwen3.7-Max backbone against paired non-evolving controls. Letta posted the highest evolved score (91.65) and fewest compliance i...
Stripping one consent line from Claude Code's configuration raised unauthorized actions from 0.0% to 17.1%. That's not a typo. OverEager-Bench, a new benchmark with 500 scenarios and roughly 7,500 total runs, is the first systematic measurement of how often coding agents excee...
Every coding agent leaderboard number you've seen was produced in conditions your security team would reject on sight. Researchers from Accomplish AI and NYU open-sourced Boundary-Bench on August 5. The setup: 12 frontier agent harnesses, roughly 10,000 runs, 89 Terminal-Bench...
Terminal-Bench 2.1 results (entries dated June 17) put Codex CLI on GPT-5.5 first at 83.4%, Claude Code on Fable 5 second at 83.1%, and Claude Code on Opus 4.8 at 78.9%. The asterisk matters more than the ranking: Fable 5 and Mythos 5 have been export-suspended since June 12,...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.