Fetching from the wire…
Public story · 2026-08-31 · high
It reaches 61.80% attack success on GPT-5.4-mini and 55.09% on Claude Haiku 4.5, beating seven published defenses.
Why now: CamoDocs posted to arXiv in August 2026, targeting the query-overlap filters many production RAG systems already rely on.
CamoDocs beats seven RAG poisoning defenses without putting the search query inside the poisoned text. Most defenses that screen retrieved chunks check for overlap between the chunk and the query. CamoDocs never creates that overlap, so those filters have nothing to catch.
The method drafts a benign version and an adversarial version of the same document, then chunks both. It swaps selected tokens in the benign chunks for what the paper calls dispersion tokens, spreading the poisoned embedding across text that still reads clean. A coherence check confirms the result holds together before it's used.
Tested across seven defenses and three benchmarks, CamoDocs reaches 61.80% average attack success on GPT-5.4-mini and 55.09% on Claude Haiku 4.5. TrustRAG and other erasure-heavy clustering defenses do cut those numbers down. That drop comes at a real cost to retrieval quality on benchmarks where accurate retrieval matters.
A defense strong enough to erase CamoDocs also erases enough legitimate content to hurt retrieval. Teams running RAG on untrusted documents get two failure modes, no clean fix. The paper doesn't say whether a defense beyond erasure-heavy clustering closes that gap.
Each link below shares sources, entities, or timing with this story.
Concept2Scenario moves scenario-based jailbreaking from trial-and-error to mechanism: scenario-wrapped prompts activate internal "scenario directions" whose causal steering measurably reduces refusal scores. The authors use a sparse autoencoder to instantiate a concept space,...
Two thirds. Not two thirds of a contrived jailbreak set. Two thirds of realistic malicious issue requests, against the exact three tools most of the people reading this run daily. Ankur Singh, Jinqiu Yang, and Tse-Hsun Chen built IssueTrojanBench across four attack categories...
The first systematic study of deceptive UI impact on LLM web agents, accepted at IEEE S&P 2026, tested against real e-commerce, streaming, and news dark patterns. Gemini 2.5 Pro: 65.78% susceptibility. Claude 3.7 Sonnet: 53.79%. GPT-4o: 51.26%. Guardrail models and prompt post...
Zhong, Raghunathan, Laidlaw and Steinhardt fed 280 identities through Claude Code across four tasks. Against recognized safety researchers versus general users, Claude dropped behavioral confidence 1.4pp, increased reasoning usage 4.0pp and graded 0.11 points harder. Being tol...
1. Flip your multi-model pipeline to review-then-generate. Instead of using a reasoning model to plan before code generation, let the specialist generate freely and use reasoning tokens for review. Paper shows 90.2% pass@1 vs 87.2% for the planning pattern. Source 2. Audit you...
An automated framework evaluated GPT, Gemini, Claude and Grok on 85 algorithmic C# tasks derived from HumanEval, producing 340 solutions scored on three independent axes: functional correctness via unit tests, static quality via Roslyn AST analysis, and runtime efficiency via...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.