AI search fix
llms.txt vs llms-full.txt: which file do you need?
The llmstxt.org proposal defines two optional files at your domain root. llms.txt is a short markdown map with a title, summary, and links to priority pages. llms-full.txt can hold longer excerpts or expanded sections for the same URLs. Most small business sites start with llms.txt only. Neither file replaces robots.txt, crawl access, or strong HTML content, and Google documents that llms.txt is not required for generative AI features in Search.
Choose llms-full.txt when you have stable long-form docs you want AI-oriented readers to see without clicking every HTML page — and you can keep the file updated when those docs change. If maintenance cost is a concern, publish a lean llms.txt and link out to canonical HTML. Always allow trusted AI crawlers before investing in either file.
| File | Typical use |
|---|---|
| llms.txt | Short site map: H1, summary, and markdown links to key public URLs. |
| llms-full.txt | Longer text or expanded sections for the same priorities — more maintenance. |
| Neither | Valid when crawl, schema, and page copy are fixed first — especially for Google Search. |
You'll get an HTML report showing whether /llms.txt exists and whether AI crawlers are blocked beforehand.
Run Express CheckRelated questions
- What is llms.txt and do you need it for AI search?Hub: purpose of llms.txt and Google vs other AI systems.
- How to create an llms.txt file (with example)Step-by-step layout for the short file at /llms.txt.
- Is llms.txt actually used by ChatGPT and other AI bots?Whether bots read /llms.txt after crawl access works.
Updated
