Fetching from the wire…
Public story · 2026-03-21 · source-backed
Helium models agentic workloads as query plans with LLM invocations as first-class operators, adding proactive KV cache pre-warming for static prefixes and cost-based, cache-aware scheduling. Achieves 1.56x speedup over state-of-the-art agent serving systems with no model changes. If you're running multi-step agent pipelines with overlapping prompts and intermediate results, this architecture directly targets your inference costs.
Each link below shares sources, entities, or timing with this story.
GPT-5.6 Luna went to $0.20 input / $1.20 output per million tokens on July 30. That's an 80% cut. Terra dropped 20%. Luna's input now undercuts Gemini 3.1 Flash-Lite ($0.25/$1.50) and sits at one-fifth of Claude Haiku 4.5's $1 input. Simon Willison covered the announcement and...
After 20+ years maintaining Paint.NET, Rick Brewster concluded WINE's Direct2D would never be complete enough for what he needed, so the app now carries its own from-scratch reverse-engineered Direct2D implementation. He puts it at 180,000 lines against 700,000 for the rest of...
Simon Willison highlighted Sophie Alpert's short internal policy on AI-assisted writing, whose load-bearing rule is accountability: "You must stand behind every idea and every sentence in your docs," because you can't excuse a bad passage by blaming the LLM, and doing so waste...
Simon Willison released it August 4, calling it "the most significant new version since the initial launch of the project," which from him is not marketing. The agent-relevant pieces: tools can raise llm.PauseChain to stop for human approval, and chains resume from pending cal...
Simon Willison shipped a PauseChain exception to cleanly pause a tool chain for human approval, guaranteed unique tool_call_ids (synthesizing ULIDs when providers omit them), and resume-from-history support. He says Fable produced the API design, tests, and docs across both LL...
— "The defining characteristic of a coding agent is that it can execute the code it writes." Never assume LLM-generated code works without verification. Patterns for python -c edge case testing, /tmp demo files, browser automation with Playwright/Rodney. Red/green TDD: when ag...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.