← The Wire

Agents2026-06-27 · source-backed

Real-MCP benchmarks arrive: MCP-Atlas and Tool-Decathlon.

Confidence
source-backed
Sources
1
Redaction
passed

Story

MCP-Atlas has 1,000 human-verified tasks across 36 real MCP servers and 220 tools, now with a 100-tool-call budget instead of a 20-turn limit. Current leaders: Gemini 3.5 Flash at 83.6%, Claude Opus 4.8 at 82.2%. Tool-Decathlon runs 108 long-horizon tasks in isolated containers, with Claude-4.5-Sonnet finishing all 108 in roughly 70 minutes across 10 parallel processes. (Scale Labs) Stop grading your tool-using agent on single-turn function-call accuracy. These test the thing you actually ship: multi-step work against real servers.


Related stories

Each link below shares sources, entities, or timing with this story.

  1. Shared entities / Shared topic / Earlier coverage / Tension

    The Claude Code Field Guide Hit 53,400 Stars. Here's Why That Matters.

    Both cover Claude, Gemini, MCP, Sonnet; overlapping topics (agent, claude); earlier Claude coverage from 2026-05-17.

  2. LLM Web Agents Fail Dark Patterns 41–72% of the Time

    Both cover Claude, Gemini, Sonnet; overlapping topics (against, agent, claude); earlier Claude coverage from 2026-03-20.

  3. AI Security Arms Race: Codex Security vs Anthropic-Mozilla (22 CVEs)

    Both cover Claude, Claude Opus, Tool; overlapping topics (against, agent, claude); earlier Claude coverage from 2026-03-06.

  4. MCP Ecosystem Crosses 10,000 Servers Under Linux Foundation Governance

    Both cover Claude, Gemini, MCP; overlapping topics (agent, claude, server); earlier Claude coverage from 2026-02-23.

  5. Shared entities / Shared topic / Earlier coverage

    Princeton: frontier models are no more reliable than their predecessors.

    Both cover Claude Opus, Flash, Gemini; overlapping topics (agent, benchmark, claude, task); earlier Claude Opus coverage from 2026-06-07.

  6. AI Benchmark Exploitation Is Now Systemic. Claude Opus Uses Git History to Game SWE-bench. 48-Point Gap Between Verified and Pro Scores.

    Both cover Claude, Claude Opus, Gemini; overlapping topics (agent, benchmark, claude); earlier Claude coverage from 2026-05-27.

  7. 10 Skills of the Day

    Both cover Claude, Flash, MCP; overlapping topics (against, agent, claude); earlier Claude coverage from 2026-05-20.

  8. Skills to Practice Today

    Both cover Claude, Gemini, MCP; overlapping topics (accuracy, agent, claude); earlier Claude coverage from 2026-03-03.

Source trail

Entities

Provenance

AI generated
no
Story unit
2026-06-27-real-mcp-benchmarks-arrive-mcp-atlas-and-tool-decathlon
Labels
source-backed, canonical briefing excerpt
Real-MCP benchmarks arrive: MCP-Atlas and Tool-Decathlon. | MindPattern