How to Create an llms.txt File | CrawlReady AI
Step-by-step guide to creating llms.txt so AI systems can understand your website structure and important pages.
llms.txt is a plain-text file that summarizes your site for large language models and AI crawlers. Think of it as a concise map of what matters most on your website.
Recommended structure
# Your Site Name
> One-sentence description of your site.
## Important Pages
- Homepage: https://example.com/
- About: https://example.com/about
- Pricing: https://example.com/pricing
## Contact
- Contact page: https://example.com/contactCreate llms.txt automatically
Enter your website URL in the LLMs.txt Generator. We fetch your homepage, extract titles and links, and draft a starter file you can edit before publishing.
Best practices
- Keep descriptions accurate — avoid exaggerated marketing claims
- Update llms.txt when you add major pages or products
- Serve it as plain text with a 200 HTTP status
- Do not put secrets, API keys, or private URLs in llms.txt
Validate your file
After publishing, run a crawl readiness scan on your homepage. The LLM Visibility check confirms llms.txt exists and includes title, description, and important pages.
Frequently Asked Questions
Where does llms.txt go? ▼
Place it at the root of your domain: https://example.com/llms.txt — the same location as robots.txt.
Is llms.txt required by Google? ▼
No. llms.txt is an emerging convention for AI systems, not a Google Search requirement. It complements — not replaces — sitemaps and good on-page SEO.
What should llms.txt include? ▼
A title, short description, sections for important pages with URLs, and optional contact or documentation links.
Important disclaimer
This guide is for educational purposes only. No tool or technique guarantees search rankings, AI inclusion, or specific traffic results. Refer to official documentation from search engines and AI providers for current policies.