Cloudflare just announced a new feature called “Markdown for Agents,” which allows
AI crawlers to request a lightweight markdown version of web pages via HTTP content negotiation.
How does it work?
When an AI agent sends a request with
Accept: text/markdown(often alongsidetext/html), Cloudflare can intercept it, fetch the normal HTML from your site, and convert it to markdown on the fly.This happens at the CDN edge, so you don’t have to build or host separate markdown pages. The same URL can serve HTML to browsers and markdown to agents.
Cloudflare adds an
x-markdown-tokensresponse header that estimates token count, helping agents decide if the content fits in their context window.
Why they built it
Markdown is optimized for agents and LLMs because its structure is easier and cheaper to parse than full HTML, reducing token usage (often on the order of ~80% fewer tokens compared with raw HTML in their examples).
They position this as infrastructure for the “AI audience” of your site, so both humans (HTML) and AI agents (markdown) can be served efficiently without extra work for content publishers.
Why is it important for web teams?
Roughly 1 in 5 websites use Cloudflare to connect, manage, and secure their digital properties and have access to this functionality (currently in beta).
It’s been reported that Claude Code already uses agent markdown so it’s quite likely to rise in popularity.
It reduces token usage by AI agents allowing more efficient use of AI. Developers can use this to manage context windows or plan chunking strategies.