AI search fix
What is llms.txt and do you need it for AI search?
llms.txt is a plain-text or markdown file at https://yourdomain.com/llms.txt that summarises what your site offers and links to priority pages. The llmstxt.org proposal targets LLM workflows, not traditional search rankings. Google says you do not need llms.txt for generative AI features in Search when crawl access and helpful content are in place. For ChatGPT, Perplexity, Claude and similar tools, publishing a lightweight llms.txt can still be a practical GEO step once robots.txt and WAF rules allow AI crawlers.
Treat llms.txt as an optional briefing layer: a title, a one-line summary, short context, and markdown links to docs, services or policies you want AI systems to notice. It does not replace robots.txt, schema.org JSON-LD or strong on-page answers. Keep the file updated when pricing, product lines or core URLs change.
When llms.txt is worth adding
- AI crawlers already receive 200 responses on key pages.
- You want a stable map for high-priority URLs beyond HTML navigation.
- Your team can maintain a short markdown file after each deploy.
- You accept that citation still depends on content quality and each platform’s policy.
You'll get an HTML report showing whether /llms.txt exists and whether robots.txt or WAF rules block AI crawlers.
Run the diagnosticRelated questions
Updated