Fetching from the wire…
01
02
03
04
05
06
07
08
Public story · 2026-03-16 · source-backed
Stop auto-generating your context files. The data says they're actively hurting you.
ETH Zurich tested Claude 3.5 Sonnet, GPT-5.2, GPT-5.1 mini, and Qwen Code across 138 real-world Python tasks and found that LLM-generated context files (AGENTS.md, CLAUDE.md) consistently degraded task success rates by 3% while increasing inference costs by over 20%. The mechanism: agents mechanically followed auto-generated instructions and over-explored — visiting more files, running more commands, and burning more tokens without improving outcomes. InfoQ
Human-written files performed marginally better — +4% success at +19% cost — but architectural overviews provided essentially zero benefit. Agents couldn't translate general guidance like "this project uses a hexagonal architecture" into targeted problem-solving on specific bug fixes.
The practical verdict is precise: avoid auto-generating context files entirely. Reserve human-written CLAUDE.md for information the agent cannot infer from the codebase — custom build commands, non-standard tooling, domain-specific terminology. Everything else is noise that costs you tokens and makes the agent worse. This directly challenges the "vibe-code your setup" trend where teams use Claude to generate their own CLAUDE.md. That practice now has empirical evidence against it. Keep it under 30 lines. Make every line something the agent literally cannot figure out by reading package.json and the directory structure.
Each link below shares sources, entities, or timing with this story.
GPT competes with Claude / Shared entities / Same source / Shared topic / What happened next
Linked by a graph relationship (GPT competes with Claude); both cover CLAUDE, ETH Zurich, GPT, Human; cite the same source (InfoQ).
Claude uses MCP / Shared entities / Shared topic / What happened next
Linked by a graph relationship (Claude uses MCP); both cover Claude, Human, Keep, LLM; overlapping topics (agent, claude, context, cost, llm-generated).
Claude uses MCP / Shared entities / Shared topic / What happened next / Tension
Linked by a graph relationship (Claude uses MCP); both cover CLAUDE, Keep, LLM; overlapping topics (agent, claude, context, token).
Anthropic released Claude / Shared entities / Shared topic / What happened next
Linked by a graph relationship (Anthropic released Claude); both cover Claude, GPT, Python; overlapping topics (agent, context, gpt-5, token).
Gemini competes with Claude / Shared entities / Shared topic / What happened next / Tension
Linked by a graph relationship (Gemini competes with Claude); both cover Claude, GPT, LLM, Sonnet; overlapping topics (against, agent, claude).
Claude uses MCP / Shared entities / Shared topic / What happened next
Linked by a graph relationship (Claude uses MCP); both cover Claude, LLM; overlapping topics (against, agent, claude, context, cost).
Linked by a graph relationship (Claude uses MCP); both cover CLAUDE, LLM; overlapping topics (against, agent, claude, context, token).
Cursor supports Claude / Shared entities / Shared topic / What happened next
Linked by a graph relationship (Cursor supports Claude); both cover CLAUDE, GPT, Sonnet; overlapping topics (claude, task).