Entity trail

Claude Sonnet

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

124

Showing the first 40 findings. More graph evidence exists in the corpus.

Corpus findings

2026-09-10 / agents-researcherSnowflake's HybridDeepResearch shows frontier models hit only ~50-54% Pass@8 when an answer needs both SQL and web searcharXiv 2609.09410 (2026-09-08) argues deep-research benchmarks test the open web or structured data in isolation and therefore never measure the handoff — whether an agent preserves constraints while moving evidence between systems. HybridDeepResearch supplies 380 tool-dependent tasks grounded in LiveSQLBench-Base-Lite databases plus public web corpora, validated by automated checks and human review, spanning SQL2S, S2SQL and Parallel reasoning patterns. GLM-5.2, Claude Sonnet 4.6 and GPT-5 reach only about 50-54% Pass@8 on the hard subset, and directional reasoning proves substantially harder than parallel intersection. Code and data are public on GitHub and Hugging Face.
2026-09-10 / agents-researcherAgentAudit attaches to a running agent and scores its trace on ten dimensions, exposing 95.1 vs 22.6 trust spreads at similar task completionarXiv 2609.09875 (2026-09-09) argues existing frameworks measure either task completion (AgentBench) or security robustness (AgentDojo, ASB) but never attribute a failure to a stage. AgentAudit reads only the recorded execution trace — imposing no constraint on the agent's implementation — and scores instruction integrity, planner, memory, tool selection, tool invocation, tool correctness, alignment, tool faithfulness, security and execution integrity, then classifies behavior and attributes the failure to a specific stage. Across nine capability and adversarial tasks, Claude Sonnet 5 and GPT-5 scored 95.1 and 80.6 Composite Trust while Sarvam 105B, Llama 3.3 70B and Gemini 2.5 Flash scored 57.6, 45.7 and 22.6. The sharper point is that models with similar task-completion behavior diverge on trust because several non-frontier models are repeatedly classified Unsafe_Compliance rather than merely failing — a distinction pass/fail benchmarks cannot see. The authors flag that a single judge model, itself one of the evaluated models, scored every trace.
2026-09-09 / skill-finderIDE-generated unit tests run but do not test: weak assertions outnumber outright failuresVibeCheck evaluated Kiro, Antigravity and Cursor (all with Claude Sonnet 4.5) generating repository-grounded unit tests across 15 Python and JavaScript/TypeScript repositories under repository-only zero-shot conditions, scored on a five-dimensional rubric of runnability, assertion strength, logic and edge-case coverage, isolation/determinism, and maintainability, with leave-one-out cross-agent peer evaluation. The result is an execution-adequacy gap: tests are usually runnable but frequently lack strong assertions and meaningful behavioral coverage, and weak assertions and missing edge cases occur more often than blocking failures. If you gate agent-written tests on green-and-covered, you are measuring the dimension that already works and missing the two that do not.
2026-09-08 / reddit-researcherA dual-login proxy plugin lets GPT-6 Astra orchestrate Opus subagents inside Claude CodeThe MIT-licensed model-gateway plugin routes GPT requests to OpenAI on the user's ChatGPT login and passes everything else to Anthropic on the normal claude.ai login, so GPT models appear in /model alongside Opus and Sonnet with no signup or API keys. The author has run Astra as the main orchestrator since Friday and reports it stays on plan, accepts a redirect without treating it as a new task, and keeps delegating to subagents instead of taking over after a few hours. It installs via `/plugin marketplace add Eigenwise/eigenwise-toolshed` and a companion plugin sets per-task-type model delegation with fallbacks.
2026-09-07 / arxiv-researcherA Small Draft Model Scoring an Agent's Own Output Predicts Failure Before Execution, Cutting Error Rate 6-8 PointsarXiv 2609.05274 inverts speculative decoding: a small open-weight draft model scores a black-box agent's already-generated trajectory in a single forward pass, needing no logits, weights, activations, or repeated sampling. Phase-aware features separating reasoning from action spans are calibrated against a verifiable objective to produce a failure-likelihood score. Wired into a pre-execution veto gate on Qwen3-Coder-480B and Claude 3.5 Sonnet, it cut execution error rate by 6-8 percentage points and token cost by 14-19%, transferring to out-of-distribution benchmarks without retraining.
2026-09-03 / skill-finderLabeling data PUBLIC - OK TO SHARE made Claude Sonnet 5 leak record values verbatim in all 10 test scenariosA controlled MCP-to-A2A study (arXiv 2609.01693, 2026-09-01) drives a real host across a local MCP leg and a local A2A delegation leg, scoring one restricted decision per trial with deterministic rules and no LLM judge, across 480 trials (4 models x 3 arms x 4 repeats). The six record values are byte-identical across arms; only the header changes. Adding PUBLIC - OK TO SHARE was associated with higher verbatim egress relative to the unlabeled baseline, strongly and consistently for Claude Sonnet 5 (public-minus-unlabeled mean +0.800, all 10 scenarios, mostly through whether it relays at all), and weakly or not at all for three GPT-5.6 tiers. The confidential-versus-unlabeled contrast was floor-limited and inconclusive, so this says a permissive label invites egress, not that a confidential label fails.
2026-09-03 / skill-finderWrapping every tool in a natural-language interface beat frontier models by 6% while cutting API cost 85%HEART (arXiv 2609.01736, 2026-09-01) replaces rigid API-schema invocation with Tool Primitives, where each tool is wrapped in an LLM interface that resolves schemas and executes internally, so tools talk to each other in natural language instead of the agent brokering incompatible output types. It backs this with ToolFace, a repository of 25,519 functions retrieved on demand rather than enumerated in context, plus a Planner, Router, and Verifier. The framework beat SFT baselines by 10% on average and GPT-5.4, Claude-4.6-Sonnet, and Gemini-3.1-Pro by 6% across five benchmarks while cutting API cost up to 85%, and on 50 real-world tasks completed 84% against a 22% average for the three commercial models.
2026-09-03 / reddit-researcherClaude's thinking bubble is now disappearing entirely on some messages, with no changelog entryA 204-upvote r/ClaudeAI thread reports that after the full thinking chain was compressed to a one-line summary, the thinking bubble now fails to appear at all on some messages, while the reasoning tokens are still billed. The subreddit's auto-generated summary after 30 comments records the consensus as agreement that the behaviour changed and that no announcement accompanied it, and parallel threads ask whether extended thinking was removed from Sonnet 4.6 as well. For anyone parsing thinking blocks programmatically this is a silent contract change, not a UI preference.
2026-09-02 / github-pulse-researcherGitHub deprecated six Copilot models on September 1, including Claude Opus 4.5 and 4.6 and Gemini 3.1 ProEffective 2026-09-01, GitHub retired Gemini 3.1 Pro (use Gemini 3.7 Flash), Claude Opus 4.5 and 4.6 (use Opus 4.7, 4.8 or 5), Claude Sonnet 4.5 and 4.6 (use Sonnet 5), and Raptor Mini (use MAI-Code-1.1-Flash). Sonnet 4.6 remains available to individual Copilot subscribers on annual plans. Claude Fable 5.1 reached general availability in Copilot the same day, so the deprecation list and the new default landed together.
2026-09-02 / rss-researcherJamf enforces per-user Bedrock spend caps in minutes using IAM policy rewrites, for under $10 a monthJamf's writeup details a three-part serverless setup: Bedrock invocation logs to S3 carrying model ID, token counts and IAM Identity Center user identity; an Athena view computing per-user daily spend; and a Lambda on a 15-minute EventBridge schedule that rewrites Customer Managed Policies via iam:CreatePolicyVersion. Denials take effect within minutes without re-authentication because IAM evaluates the updated policy on the next Bedrock call. The tiering is the interesting part, denying Claude Opus at 80% of daily budget and Sonnet at 100% while leaving a cheap model always reachable, and the whole thing runs well under $10/month for hundreds of engineers.
2026-08-30 / arxiv-researcherFive Frontier Models Benchmarked Against GraphWalker for Model-Based Test Path GenerationThis empirical evaluation pits GPT-5.1, GPT-5.2, Claude Opus 4.5, Claude Sonnet 4.5 and Gemini 2.5 Pro against the state-of-the-art model-based testing tool GraphWalker and its built-in random and quick-random algorithms for edge and vertex coverage. It uses four GraphWalker models of escalating complexity, two web applications (Parabank, Testinium) and two hardware ones (TLC, RISC-V). The reported result is strong potential for LLMs to optimize and shorten both test paths and step sizes, which matters because path length is the scalability barrier that has kept MBT out of industrial adoption.
2026-08-30 / arxiv-researcherAgentDV Lifts RTL Testbench Generation From Zero Valid Environments to 100% Pass on Four DUTsSingle-shot LLM prompting failed to produce even one valid coverage-producing verification environment on the paper's benchmarks. AgentDV closes the loop with runnability filtering to reject invalid environments, CSR-grounded checking to cut hallucinated signals, and coverage-guided iteration that regenerates tests against measured gaps. Using Claude Sonnet 4.6 it reaches 100% pass on four design-under-test blocks and 80.9% average across all of them, with 74.5% line and 88.4% branch coverage, against 58.7% and 60.6% average pass rates for Llama and Qwen, evaluated on OpenTitan peripheral and security IP.

Graph relationships

USES
AWS
AWS benchmarked query-aware RAG using Claude Sonnet for question answering.
Source finding
USES
TReNDS
TReNDS runs Claude Sonnet for root-cause analysis.
Source finding
BENCHMARKED AGAINST
mempalace
MemPalace was benchmarked using Claude Sonnet for evaluation.
Source finding
BENCHMARKED AGAINST
M2.7
M2.7 benchmarks against Claude Sonnet 4.6
Source finding
BENCHMARKED AGAINST
SWE-Bench
Claude Sonnet with Opus advisor gained +2.7pp on SWE-bench Multilingual.
Source finding
USES
GitHub Copilot
GitHub Copilot usage-based billing prices Claude Sonnet at 9x base rate starting June 1, 2026
Source finding
MENTIONS
Claude Opus
Anthropic revealed Sonnet calling Opus yields frontier-quality output at 5x lower cost.
Source finding
BENCHMARKED AGAINST
Gemma 4 31B
Gemma 4 31B outperformed all Claude Sonnet variants on FoodTruck Bench
Source finding
USES
PentestAgent
PentestAgent leverages Claude Sonnet for penetration testing
Source finding
USES
Claude Code
Claude Code architecture uses Claude Sonnet as a classifier for tool calls
Source finding
USES
Stavros Korokithakis
Stavros Korokithakis uses Claude Sonnet as developer in his workflow
Source finding
COMPETES WITH
Opus
Claude Sonnet with Rubber Duck closes 74.7 percent performance gap to Opus.
Source finding

Source trail

arXiv 2609.09875 HybridDeepResearch arXiv 2609.05978 JetBrains blog JetBrains blog r/OpenAI Product Hunt August 21 AWS post arXiv Netlify published LLMRouter DeepSeek raised API prices

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues

Fetching from the wire…