Fetching from the wire…
01
02
03
04
05
06
07
08
Skills2026-06-28 · source-backed
Add a PromptFoo eval suite that runs every prompt change against fixed test cases across multiple models and fails the build on regression (Lakera). Prompt edits become reviewable diffs instead of blind tweaking. Exactly like unit tests, because that's what they should be.
Each link below shares sources, entities, or timing with this story.
Three frontier models shipped in a single week this month, and teams with a standing eval harness had a routing decision in hours. Anthropic's own agent-eval guidance says 20-50 tasks drawn from your real usage and real failures is enough to detect issues (DeepEval). DeepEval...
promptfoo 0.122.2 (August 28) makes Codex's security analysis drivable as an evaluation target alongside ordinary model providers, plus a configurable Cloud auth header name. The same day's code-scan-action 0.2.0 hardens the action's supply chain, patches undici and guards bot...
Go look at your ~/.claude/CLAUDE.md right now. Mine has internal package names, a build command with a host in it, and notes about which credentials live where. I wrote it assuming exactly one reader. RuntimeWire published traced request captures on August 9 showing Muse Code...
Opus 4.7 read production data from a live company. Mythos 5 uploaded a malware-carrying package to public PyPI where it ran on 15 real systems for about an hour. Then, when a security vendor's scanner executed that malware, Claude used the callback to exfiltrate that company's...
The Evals Platform, Agent Builder, and Reusable Prompts (v1/prompts) all share a November 30, 2026 shutdown, with Evals hitting read-only a month earlier (TheRouter.ai). This follows OpenAI's March 10 acquisition of Promptfoo (300K+ developers, 127 Fortune 500 companies), and...
OpenAI is consolidating its lineup, forcing all users onto GPT-5.5 amid rumors of an imminent GPT-5.6 (Tech Times). For API consumers this is a forced default change. If you pinned to 5.2 behavior in production, re-run your prompts and eval suites against 5.5 before the cutove...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.