Fetching from the wire…
Research2026-08-18 · source-backed
100 real frontier research tasks across seven scientific domains, full lifecycle, 800 annotated trajectories, 45-pattern failure taxonomy (arXiv 2608.14905). The headline isn't a leaderboard, it's a shared deficit: agents can't check what they produced against what they found, revise when it doesn't hold, or question whether the path was sound. Held across all 8 harness-model combos including the strongest models. That points at a model-level limitation, not a scaffolding one, which means a better harness will not patch it.
Each link below shares sources, entities, or timing with this story.
Seven models. Five harnesses. Controlled fact-withholding with injected faults. arXiv 2608.16630 is the most operationally direct paper I've read on harness design, and it produces three results that each change what I do this week. One: availability decides outcomes, not dist...
Agent Lightning v1.0 (arXiv 2608.17528) inverts the standard agentic RL architecture, and the inversion is the whole point. Normally the training engine owns the environment loop. It drives the agent, collects trajectories, computes rewards. Which means your training setup and...
arXiv 2608.05108 skips the RL-trained attacker models that dominate red teaming and generalize poorly, instead accumulating a strategy library across a sequence of (dataset, target) pairs that transfers to unseen targets with no retraining. AgentDojo: 86.7% ASR against Gemini-...
SpecFirst splits the loop in two: a spec agent probes the binary and fuses observations with documentation into a structured specification, then a separate synthesis agent codes against that fixed reference. Test pass rates rose 6.9-21.3% and binary exploration coverage 9.4-18...
Frontier labs publish demos. This one published the thing they actually page. Anthropic's August 18 writeup describes Claude Tag running as the first responder for CI failures inside the company. Dedicated service account. MCP connectors to Datadog, Grafana, PagerDuty, GitHub...
Four frontier models. Five sealed engineering problems. The result everybody will quote is that Claude Fable 5 won. The result that should actually change how you work is buried three-quarters down the page. JuliaHub published an evaluation on July 30 running four frontier mod...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.