Fetching from the wire…
Public story · 2026-03-19 · source-backed
ArXiv paper 2603.17683 benchmarks a deceptively simple idea: instead of stuffing facts into your agent's context window and hoping the model remembers them, treat each fact as a discrete, hash-addressed tuple stored externally and retrieved on demand. The results are stark: 100% accuracy across 7,000+ facts versus in-context approaches where compaction loss destroys 60% of facts in production systems. The cost difference at scale is 252x. arXiv
The architecture treats facts as first-class addressable objects — each gets a content hash, typed metadata, and a retrieval interface. This is the database approach applied to LLM memory: instead of a growing context window that degrades as it fills, you get a stable key-value store where retrieval precision doesn't decay with volume. The 252x cost reduction comes from the obvious place: you stop paying to process 7,000 facts on every inference call and instead retrieve only the relevant subset.
For anyone building agents with persistent memory — and that's increasingly everyone — this paper provides the architectural pattern that actually works. The in-context approach that most production systems use today is a known failure mode being tolerated because alternatives weren't benchmarked. Now they are. Hash-addressed knowledge objects are the RAG equivalent of moving from flat files to a database: same data, fundamentally different reliability characteristics.
Each link below shares sources, entities, or timing with this story.
Treat each fact as a content-hashed tuple with typed metadata and a retrieval interface. Retrieve relevant subsets on demand instead of stuffing everything into context. 100% accuracy at 7,000+ facts where in-context approaches lose 60%. The database approach to LLM memory. arXiv
READ (arXiv 2608.06305, submitted August 6) took a 780-page government financial report and asked 51 verified questions. Top-k embedding retrieval answered 15.7% of them correctly. The same agent loop, given three deterministic tools over MCP instead of a vector index, answere...
Satya Nadella said companies routing everything through a single proprietary lab may not survive. His argument: you hand that lab your most sensitive business context, and the lab can turn it against you as a competitor. His prescription is an orchestration layer — keep the ha...
After 20+ years maintaining Paint.NET, Rick Brewster concluded WINE's Direct2D would never be complete enough for what he needed, so the app now carries its own from-scratch reverse-engineered Direct2D implementation. He puts it at 180,000 lines against 700,000 for the rest of...
CCP announced the migration covering code that has run on Stackless 2.7 since 2010. The approach is to run futurize across the codebase and then manually review roughly 20,000 places where Python 2 and 3 behavior diverges, including integer division (Simon Willison). No comple...
GPT-5.6 Luna went to $0.20 input / $1.20 output per million tokens on July 30. That's an 80% cut. Terra dropped 20%. Luna's input now undercuts Gemini 3.1 Flash-Lite ($0.25/$1.50) and sits at one-fifth of Claude Haiku 4.5's $1 input. Simon Willison covered the announcement and...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.