Fetching from the wire…
Public story · 2026-06-30 · high
The catch: stripping code first costs 12 points on SWE-bench Verified accuracy, per a new arXiv paper.
Why now: The paper posted to arXiv in June and its code is already public on GitHub, so teams running agents over large repos can test the tradeoff themselves right now.
Minifying code cuts a coding agent's input tokens 42% on average, according to a paper posted to arXiv in June. For agents that read whole repositories into context, that's real savings on cost and latency without touching the model itself. It comes at a price: accuracy on SWE-bench Verified drops 12 points when the code gets stripped down first.
The paper's case is that source code, not conversation history or tool output, is the dominant token sink for agents that keep full repo state in context. Minification strips non-essential lexical elements, things like whitespace and dead syntax, while preserving semantics, so the agent still sees working code, just less of it. The code behind the paper is public on GitHub.
I'd skip minifying the whole repo. The smarter move strips only the files an agent reads for context and leaves the ones it's actually editing untouched, since that's probably where the 12-point accuracy hit lands hardest. Worth watching whether anyone publishes numbers on selective minification instead of the blanket version.
The paper posted to arXiv in June and its code is already public, so teams running agents over large repos can test the tradeoff themselves this week.
Each link below shares sources, entities, or timing with this story.
Alibaba released Qwen3.6-27B on April 22. Dense architecture. Open weights. 77.2% on SWE-bench Verified, within 3.7 points of Claude Opus 4.6. On SkillsBench, it scores 48.2% versus its own 397B MoE predecessor's 30.0%. That's a 77% improvement with 14.8x fewer parameters. Let...
This is the most directly usable paper of the day and it does something rare: it bolts onto an existing agent without touching it. Ledger is a deterministic runtime wrapper that distills an agent's completed interactions into explicit state. What has been observed, what has be...
This is the paper of the week. arXiv 2607.28871 introduces BSG-VA, which replays every validation command an agent runs across three code states: the original buggy code (B), the candidate patch (S), and the gold developer fix (G). If a test passes in all three states, it neve...
The most useful AI-productivity dataset I've seen came from a company with every incentive to measure it honestly, because they're 3,500 people trying to run on their own product. The Pragmatic Engineer's July 29 deep dive inside Anthropic reports code output per engineer up 2...
The study extracted 130 clean atomic state transitions from 707 real issues in SWE-bench Lite and Verified. Plain RAG scored 0.57-0.59 answer accuracy; an LLM reranker didn't help and added latency, about 18 seconds against 2.1. A (subject, relation, object) supersession memor...
SWE-Touch mines task-critical regions from repair trajectories, builds plausible Counter-Edits that conflict with task completion, and injects them with contextual user messages when the agent reaches that code. Across nine models on SWE-bench Verified, average resolve rate dr...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.