Cloudflare's Agent Readiness Score: Only 4% of Websites Are Ready for the Agent Web

Cloudflare just told the web industry something uncomfortable: only 4% of the top 200,000 websites support AI agent standards. Ninety-six percent of the web is invisible to the agent economy.

During Agents Week (April 15), Cloudflare launched an Agent Readiness Score. Think Google Lighthouse, but for how well your site plays with AI agents. They scanned 200,000 top websites via Radar data. The result: almost nobody has declared AI usage preferences in robots.txt, implemented structured agent-callable actions, or made their content discoverable by autonomous systems.

This arrives alongside two related Cloudflare launches. First, isitagentready.com for self-assessment. Punch in your URL and see where you stand. Second, the WebMCP protocol in Browser Run, which lets websites declare structured actions that agents can discover and call programmatically. Instead of agents screen-scraping your site with brittle CSS selectors, you expose capabilities directly through a protocol.

I think this is a bigger deal than it looks. We're living through a shift where agents will outnumber humans browsing the web. Not next year. Now. Every time someone runs Claude Code with web search, every time an OpenClaw agent browses for context, every time a Codex agent grabs documentation, that's agent traffic. If your site can't serve that traffic intelligently, you're losing a distribution channel you don't even know exists.

The 4% number also explains why AI agents still feel clunky at web tasks. They're doing the equivalent of trying to use a library by reading the building's brickwork instead of the card catalog. WebMCP is the card catalog.

What builders should do: run your sites through isitagentready.com today. Update your robots.txt with explicit AI usage preferences. If you're building a developer-facing product, implement WebMCP declarations for your key actions. The sites that do this first will capture disproportionate agent traffic as the agent economy scales.