AI search fix
How to create an llms.txt file (with example)
Build llms.txt as plain markdown at https://yourdomain.com/llms.txt using the llmstxt.org layout: level-1 title, one-line blockquote summary, short context paragraph, then sections like Docs and Services with markdown list links to priority URLs. Publish only once robots.txt and your CDN let trusted AI crawlers fetch pages — the file cannot substitute for crawl access. Google does not require llms.txt for AI Overviews when your site is crawlable and content is genuinely helpful.
Aim for brevity and accuracy. Point to public HTML pages you want AI systems to notice first — not PDFs behind login walls. Include an Updated line with the ISO date of your last pricing or route change. After each deploy, request the live URL; a CMS draft is not the same as a 200 at /llms.txt.
Create llms.txt in five steps
- Confirm GPTBot, PerplexityBot, or other AI bots are not blocked in robots.txt or WAF.
- Draft H1 title, blockquote summary, and a two-sentence context block.
- Add sections with markdown links to docs, services, pricing, and policies.
- Upload to the site root as /llms.txt with text/plain or text/markdown.
- Request the URL in a browser and fix 404 or redirect chains.
You'll get an HTML report showing whether /llms.txt is reachable and whether crawlers are blocked.
Run the diagnosticRelated questions
Updated
