Skip to content

Free tool

llms.txt + robots.txt generator for AI crawlers

Tell ChatGPT, Claude, Perplexity, and Google AI Overviews how to read and quote your site. Paste the output at /llms.txt and /robots.txt.

Your site

AI crawlers — allow each one?

llms.txt

# Fill in the form to generate

Save as /llms.txt at your site root.

robots.txt (AI bots only)


              

Append these blocks to your existing /robots.txt. Keep your existing rules for Googlebot etc.

Why this matters

AI search is rewriting how customers find you.

ChatGPT and Perplexity already pull from your pages — but only if you let them, and only if your content is structured for extraction. Want a full audit of how AI-quotable your site is?

Get free proposal