Why this matters now
G2 found in 2025 that half of B2B software buyers start vendor research in an AI chatbot instead of Google Search. Semrush found that visitors referred by AI are roughly three times more likely to convert than typical organic visitors — so the channel isn't just growing; it's high-intent.
Google SEO and AI search readiness answer different questions. SEO helps you rank and earn clicks. Readiness helps assistants understand who you are — products, services, location, expertise — before they generate an answer.
A site can pass a traditional SEO audit and still fail here. Human visitors see a polished homepage. AI crawlers hit a locked door.
Example: A regional accounting firm ranks on page one for "tax prep [city]." A scan shows GPTBot — the automated reader OpenAI uses — gets a 403 from Cloudflare. Google still indexes the site. ChatGPT keeps naming two competitors the firm has never heard of.
For how this split shows up in tooling, see GEO tools vs traditional SEO tools.
Five technical barriers that hide you from AI
Most AI visibility problems don't slow down your homepage and don't trigger alerts in a standard SEO dashboard. They're invisible to human visitors — but decisive for assistants.
What we see across Express Check scans: The most common issue isn't missing structured data. It's security rules — especially Cloudflare — that unintentionally block trusted AI crawlers after a hardening pass or a one-click "block AI bots" toggle. Owners fix rankings in Semrush while ChatGPT can't read a single service page.
Blocked AI crawlers
Your robots.txt file (a simple list that tells automated visitors what they may read) or your CDN may tell AI company bots to go away — even when Googlebot is welcome. If OpenAI's, Anthropic's, or Perplexity's readers can't fetch your pages, they can't recommend you. This is the single pattern we flag most often on marketing-led sites behind Cloudflare.
Missing llms.txt
Without this file at yoursite.com/llms.txt, some AI systems have to crawl your entire site to guess what's important. A good llms.txt acts like a short menu written specifically for language models — your key pages, what your business does, where to find pricing or contact info. It won't guarantee inclusion, but it removes a lot of guesswork.
Weak structured data
Your pages may look clear to humans while machines get a wall of unstructured HTML. Structured data — clear machine-readable labels for your organisation, services, products, FAQs, and reviews — gives AI context instead of forcing it to infer from layout and widgets.
Accidental WAF rules
Cloudflare and similar security layers can block trusted AI readers while humans browse normally. This often happens right after enabling a blanket "block AI bots" rule without reviewing each crawler individually. The site feels fine. The bots get 403 errors.
Messy page structure
Important facts buried in tabs, accordions, or JavaScript-only widgets are harder for automated readers to extract. If your core offer lives behind three clicks or loads only after user interaction, assistants may never see it — even when the content is excellent.
None of these necessarily hurt Google rankings. All of them can shrink how well AI systems understand your business. We go deeper on the "green SEO, invisible AI" pattern in good SEO content still invisible in AI search.
What a readiness check should cover
Before spending on rewrites or new content, know where you stand. A useful AI search audit should test the five barriers above and return actionable fixes — not a vanity score.
Example: A B2B SaaS marketing manager gets a board question: "Are we ready for AI search?" The scan finds crawlers allowed, but service pages lack organisation structured data and an overbroad robots rule on the careers page — left from a staging migration — blocks all bots including AI readers. Two targeted fixes. No content rewrite.
For a step-by-step starting point, see how to check ChatGPT visibility.
Owners researching AI search readiness often land in a crowded market. Two jobs, often confused:
Monitoring tools are legitimate for citation tracking. They won't generate a corrected robots.txt or deploy llms.txt on your Shopify store.
GEO Fix focuses on readiness: we scan crawler access, robots.txt, llms.txt, and structured data gaps — then, on paid plans, ship the actual files plus copy-paste CMS steps, not just a score. One-time pricing (£199 Starter, £399 Pro). We don't promise placement in ChatGPT; we remove technical blockers so AI can see and understand your site.
For the full category map, read what is generative engine optimisation.