Is Your Site Agent-Ready? by Cloudflare

Scan your website to see how ready it is for AI agents.

SEO

Artificial Intelligence

Development

ran this on a couple of my sites and the MCP readiness check was an eye-opener. never even thought about exposing structured endpoints specifically for AI agents before tbh. the part about markdown negotiation is interesting too - most of my pages serve html and never considered that agents would prefer a simpler format. gonna have to rethink my content-type headers now. one thing tho - does it differentiate between different agent types? like a shopping agent vs a research agent would need pretty different access levels right?

oh this is cool — does the scanner actually test how an agent would navigate the site end-to-end, or is it mostly static checks against robots.txt and MCP/agent manifests? curious how deep it goes.

I approve of a way to screen your website to ensure it's ready for AI agents. Does it require interacting with the agent first or does it have an updated catalog that has information on agents that are out right now?

Thanks for this tool! I was just recently wondering if I have everything set up correctly. Now I know exactly what I'm fixing today 😅

@rohanrecommends — does the audit check for llms.txt (the emerging convention for AI crawlability hints alongside robots.txt), or is coverage limited to the established stack? Also curious whether the score differentiates between 'actively blocking AI crawlers' vs 'not explicitly allowing them' — those are pretty different signals for an agent deciding whether to index.

Congrats on the launch! This is a timely tool as AI agents become more prevalent. I'm curious about the implementation side - when the scanner identifies gaps in a site's agent-readiness, how prescriptive is the guidance for fixing them? Are there pre-built solutions or does it mostly flag issues and leave remediation to the developer?