Skip to main content

Markdown for Agents (Beta)

Jessica Frick
  • Updated

Following the announcement of the Markdown for Agents Beta release, Rocket.net has enabled Cloudflare’s Markdown for Agents feature on our network. The feature is currently in Beta testing, and so it is expected to have flaws and may not be useful in a production environment.

Markdown for Agents is enabled for all Rocket.net sites. No added configuration changes are required. 

This Beta capability allows web content to be served in Markdown format to AI agents and crawlers that explicitly request markdown by passing the following header in the HTTP request:

Accept: text/markdown

Cloudflare fetches the original HTML from the origin, converts it to Markdown at the edge, and returns it with Content-Type: text/markdown. 

For normal browser traffic, nothing changes. Human visitors continue to receive the standard HTML version of the page. 

No application or origin changes are required.

Why this matters

AI systems and agent-based tools often need clean, text-focused content rather than full HTML. Markdown is lighter and easier to process, which can reduce parsing overhead, lower token usage, and simplify ingestion for AI-driven workflows.

When an HTTP request is made without any special headers, plain HTML is served to a browser:

~$ curl -s https://rocket.net | head -02
<!doctype html>
<html lang="en">

When the Markdown for Agents header is added, we can see that it outputs markdown instead of HTML:

~$ curl -s https://rocket.net  -H "Accept: text/markdown"| head -02
---
description: All-in-One WordPress Hosting for Agencies &amp; Creatives. Grow your business with lightning fast, secure and fully optimized websites.

As demonstrated, Markdown for Agents provides a machine-friendly representation of publicly available content without altering the human experience.

Beta status

Markdown for Agents is currently in Beta and must be treated as an emerging capability, not a finalized standard. Behavior, formatting, headers, and implementation details may change as the feature evolves.

Tooling that depends on specific Markdown output should account for potential changes during the beta period.

What Markdown for Agents does not do

Markdown for Agents

  • Does not change your HTML content.
  • Does not modify origin files.
  • Does not expose private content.
  • Does not automatically impact AI search rankings.

Markdown for Agents provides an alternate representation of the same public content when explicitly requested.

Additional considerations

Markdown for Agents improves efficiency and machine readability. It is not a security control or validation layer.

Cloudflare converts whatever HTML the origin serves at request time into Markdown. Consistency between human-facing and agent-facing responses ultimately depends on origin behavior.

Customers using this feature in AI-driven workflows should treat it as a performance optimization, not a trust boundary.

Related articles

Comments

0 comments

Article is closed for comments.