Fetching from the wire…
Public story · 2026-08-24 · high
The paper says the productivity gains hold on new code but shrink on codebases with years of accumulated decisions.
Why now: The paper posted August 20, marking seventeen months of accumulated data on a practice named in February 2025.
Software teams have spent 2026 throwing three numbers at each other over whether AI coding tools help or hurt. Which number a team trusts shapes whether it expands AI tooling or hires more reviewers.
Field experiments that count tasks completed report 26% more work finished per week with AI assistance. METR's randomized trials, which clock wall-clock time on developers' own repositories, found a 19% slowdown. Team telemetry, tracking where the work moved, shows code review time up 441%.
A paper reconciling the evidence posted August 20 argues all three numbers are correct, because each instrument measures something different: tasks finished, time elapsed, or where the labor shifted.
Its most interesting claim is also the most hedged. Gains look real on new code and shrink or reverse on codebases with years of accumulated decisions. The authors call this a conjecture, not a finding.
That split matches what I see on my own projects. Fresh code with an agent moves fast; a codebase where I keep re-explaining constraints a human teammate would've picked up in a week goes slower.
My sample size is one person's side projects. That resemblance is a reason to test the claim, but it doesn't prove it.
Track two weeks of agent-assisted work split by codebase age, and measure wall-clock time to merged rather than time to first draft.
The review-time number holds regardless of that split. A separate study of 248,641 GitHub pull requests found agent-authored code increasingly reviewed by other agents. Cross-vendor review, one company's agent reviewing another's code, grew more than a hundredfold between the first and third quarters of 2025.
Each link below shares sources, entities, or timing with this story.
The most useful AI-productivity dataset I've seen came from a company with every incentive to measure it honestly, because they're 3,500 people trying to run on their own product. The Pragmatic Engineer's July 29 deep dive inside Anthropic reports code output per engineer up 2...
Open issues on the AI SDK went from 1,022 to 844 in four weeks. That's the number I'd lead with if I were writing this post, and Vercel did. Vercel published the internals of the system it built to maintain the AI SDK, a repo with over 20 million npm downloads a week, 26,000+...
On August 5 rust-lang/rust published a project-wide LLM policy built on one line: LLMs may answer, analyze, distill, refine, check, suggest and review, but not create. The specifics have teeth. Autonomous agent contributions are banned outright. LLM-generated code in public do...
$3,054 against $38,370. Same benchmark, better score. Praxist (arXiv 2608.25955, submitted August 26) replaces per-attempt agent memory with a typed evidence graph of findings, plus lane-structured frontiers and agendas, so later attempts inherit validated mechanisms rather th...
Two days from now, on August 14, auto mode becomes the default permission mode for new Pro, Max, and Team sessions (Claude Code Docs, Week 32). Not opt-in. Default. Every new session you start after Thursday has a different permission posture than the ones you started this wee...
Best-in-class computer-use models scored 42% on OSWorld-Verified in early 2025. Today the leader (Claude Fable 5) scores 85%. The human tester baseline is roughly 72%. a16z published the aggregation on August 10, pulling from production interviews and llm-stats leaderboard dat...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.