llms.txt Generator
Crawl any site and generate a ready-to-use llms.txt file for AI systems.
FAQs
What is llms.txt?
llms.txt is a proposed standard: a markdown file at your site root (yoursite.com/llms.txt) that gives AI systems a curated map of your most important pages - a table of contents written for machines.
Does llms.txt improve my AI search visibility?
Mostly no - current crawler data shows GPTBot, ClaudeBot, and PerplexityBot rarely read it. Its proven value is for AI coding assistants (Cursor, Claude Code, Copilot) reading documentation sites. Schema markup and crawler access matter far more for AI citations.
Where do I put the generated file?
Upload it to your site's root so it's reachable at yoursite.com/llms.txt, served as plain text. On most hosts that means dropping llms.txt into your public or static folder.
Should I edit the generated file?
Yes - treat it as a starting point. Curation is the point of llms.txt: keep your 5-15 most important pages, fix any descriptions, and remove anything an AI shouldn't prioritize.