AI search fix
How to check your llms.txt file
To check your llms.txt file, request https://yourdomain.com/llms.txt in a browser or with curl and confirm HTTP 200 over HTTPS without auth. The body should be readable markdown with a title, summary, and working links to public pages. Validate that robots.txt and your CDN still allow trusted AI bots — a perfect llms.txt is useless if GPTBot receives 403. A free llms.txt validator flags broken links and structure; Express Check covers crawl and robots together.
Re-validate after deploys. CMS plugins and CDN rules often break /llms.txt paths or block bots without touching the file content.
Check llms.txt in five steps
- Fetch /llms.txt on the production host — not staging unless that is your crawl target.
- Confirm 200 response, correct Content-Type, no redirect to login.
- Click each linked URL — must be public HTML you maintain.
- Compare Updated date with your last pricing or route change.
- Run crawl check: robots.txt and WAF allow bots you trust.
Free · 2 minutes · no card
See what AI crawlers hit on your site
Technical blockers, missing context, weak AI-readiness signals — in one HTML report.
You'll get an HTML report on /llms.txt reachability and AI crawler blocks.
Frequently asked questions
Is there an official llms.txt validator from Google?
No required official validator. Use HTTP checks, link tests, and crawl audits on your domain.
Should llms.txt validate as JSON?
No. Expect plain text or markdown per llmstxt.org, not JSON or HTML.
Does a valid llms.txt guarantee AI citations?
No. Validation only confirms the file is reachable and consistent.
Related questions
Updated
