Fetching from the wire…
Research2026-06-17 · source-backed
A June 15 paper introduces 442 expert-curated Nature Portfolio meta-analyses against a 140,000-article PubMed corpus, benchmarking twelve pipeline configs. No system recovered more than 52.7% of ground-truth included literature, even at 90.9% retrieval recall at K=200. The bottleneck isn't finding documents, it's deciding which ones actually qualify. This is hard evidence that RAG recall metrics overstate real research competence. If you ship anything that screens or filters retrieved content, your recall number is lying to you about end-to-end quality.
Each link below shares sources, entities, or timing with this story.
RAGAS-style evaluation checks correctness against a frozen snapshot, which means routine document updates and corrections can silently break production without moving a dashboard. This ASE 2026 paper defines 11 mutation operators perturbing at both the pre-chunk index level an...
arXiv 2608.00765 compresses retrieved docs into query-conditioned visual representations, sidestepping the trade-off where hard compression is query-aware but weak and soft compression is strong but needs costly offline encoding. Beats both baselines across varying retrieval d...
Two numbers from this paper should change what you do with your .claude/skills directory this week. First: 65.7% of the benefit from agent skills comes from procedural anchoring. Explicit knowledge injection accounts for 4.5%. Second: expand the skill pool from 5 items to 100,...
READ (arXiv 2608.06305, submitted August 6) took a 780-page government financial report and asked 51 verified questions. Top-k embedding retrieval answered 15.7% of them correctly. The same agent loop, given three deterministic tools over MCP instead of a vector index, answere...
Mohamed Jouini evaluates seven agentic strategies on IaC-Eval v2, 186 AWS/Terraform tasks with Rego v1 intent policies (arXiv 2607.20478). ReAct with MCP or ChromaDB-backed RAG lifts Qwen2.5-Coder 7B from 14.0% to 45.7%; iterative refinement on verifier feedback reaches 62.9%...
Red Hat's Emerging Technologies group published ripwire, an Apache-2.0 zero-dependency C++23 binary with vendored tree-sitter grammars for 21 languages, exposed as both a CLI and an MCP server (GitHub). It reached 969 stars on Hacker News on September 7. It returns ranked symb...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.