Anthropic publishes its CI on-call agent, Claude Tag

Anthropic published the design of its internal CI failure responder on August 18, and the part worth stealing isn't the agent. It's the file it writes to.

The agent, called Claude Tag, runs as the first responder for CI failures inside the company, per Anthropic's writeup. It has a dedicated service account and MCP connectors into Datadog, Grafana, PagerDuty, GitHub and Kubernetes. An orchestrator spawns executor subagents to check dependencies in parallel, and the whole thing is strictly read-only. Median time to first analysis is 14 minutes.

That read-only constraint is the design choice that makes the rest of it safe to run against production systems. The standing instructions aren't a prompt sitting in a config panel. They're markdown skills checked into a GitHub repo: an oncall.md with deterministic escalation criteria, and a lessons.md the agent appends to when it learns something, reviewed in a pull request like any other code change.

The generalized version, oncall-kit on GitHub, sits at 21 stars and is published as reference code Anthropic says it won't maintain. Its setup runs five gated phases. It mines a team's own incident history to draft playbooks, then checks those drafts against incidents held out of the training set before installing them.

That gating is the piece most agent skill libraries skip. A separate finding covered in the same briefing found self-written agent skills scoring 8 to 11 points worse than no skill at all. The gap between a skill library that helps and one that quietly makes results worse is the held-out validation step, not which model wrote the skill. Teams running their own on-call agents can copy the read-only constraint and the held-out check without touching the rest of the kit.