AI SEO Audit: What a Real Audit Checks, and in What Order
99Visibility Research · Updated October 21, 2026 · 9 min read
Short answer
An AI SEO audit checks whether AI engines can reach, index and correctly describe your site. It starts with access: per-bot robots.txt rules, CDN and firewall reachability, server-side rendering, snippet controls and Google's generative AI inclusion setting. Then it checks index status in Google and Bing separately. Last, it checks accuracy: which facts AI engines state wrongly about your brand. Access comes first because nothing downstream works if crawlers are blocked.
Key takeaways
- The audit levers with real evidence behind them are access levers, and they work by removing blocks, not by adding markup.
- robots.txt is per bot: blocking GPTBot stops training use, while OAI-SearchBot controls whether you appear in ChatGPT search.
- A CDN or firewall can turn away an AI crawler that robots.txt allows, and nothing in your dashboards will tell you.
- Check index status in Google and Bing separately, because each engine can only cite pages its own index holds.
- Accuracy checks show which specific facts engines get wrong, which is the problem most brands actually feel.
What an AI SEO audit actually measures
An AI answer passes through four stages, and an audit is only useful where you have control.
- Parametric: what the model knows with no web access, frozen at a training cutoff. Nobody changes this quickly.
- Access: whether a crawler may fetch and store your page. You and your CDN control this.
- Retrieval: whether your page enters the model's context for a given question. The engine controls this, partly through its index.
- Generation: which retrieved pages the model uses and cites. The model controls this.
A real AI SEO audit spends most of its effort on access and index status, because those are mechanical, checkable and in your hands. It then measures accuracy, because that tells you what the engines are saying today. If you want the contrast with a classic technical audit, see how an AI visibility audit differs from an SEO audit.
Why access comes first
Every later stage depends on access. An engine can't retrieve a page it was never allowed to fetch, and it can't cite a page it never retrieved.
Google states the rule plainly for its own AI surfaces: to appear as a supporting link in AI Overviews or AI Mode, a page must be indexed and eligible to be shown in Search with a snippet, and "there are no additional technical requirements." There is no separate GEO path into Google.
The research points the same way. A 2026 critical survey of 45 GEO studies (arXiv 2607.14035) found that no reviewed technique shows a stable, cross-platform causal effect on discoverability. Nearly every published GEO effect size was measured on pages already sitting inside the model's context, which tells you little about getting there. That gap is covered in what lab GEO studies do and don't transfer to live engines.
So the order is simple: confirm nothing is blocking you, then confirm you're indexed, then look at what the answers say.
The access checks
robots.txt, bot by bot
AI companies run separate crawlers for training, search and user-triggered fetches. OpenAI's crawler documentation says "each setting is independent of the others." GPTBot governs training use only. OAI-SearchBot governs ChatGPT search, and sites that block it won't be shown in ChatGPT search answers. The common mistake is a blanket AI block that removes search eligibility along with training. A site that wants search visibility but no training use looks like this:
User-agent: OAI-SearchBot
Allow: /
User-agent: GPTBot
Disallow: /
Check PerplexityBot, Claude-SearchBot, Meta-WebIndexer, bingbot and Googlebot the same way. There is no robots.txt token for AI Overviews or AI Mode: Googlebot's rules apply to all Google surfaces.
CDN and firewall reachability
robots.txt is a statement. Your firewall is the enforcement. OpenAI's help centre says eligibility means allowing OAI-SearchBot and confirming your host or CDN allows traffic from its published IP addresses. Request a page as each AI crawler and record the status code. A 403 or a challenge page is a silent failure. Also note that since 15 September 2026, Cloudflare blocks Training and Agent crawlers by default on ad-displaying pages for new domains and existing free-tier customers, so access can change without anyone on your team editing a thing. The AI crawler access audit playbook walks through this step by step, and the AI Crawler Checker requests a page as each crawler and shows which ones get turned away.
Rendering
Vercel's crawler study found that ChatGPT and Claude crawlers fetch JavaScript files (11.50% and 23.84% of their requests) but don't execute them. Content that only appears after JavaScript runs may be invisible to them. Googlebot does render. Fetch each key page with JavaScript off and compare it to the rendered page. Prices, product names and core claims should be in the raw HTML.
Snippet controls
noindex, nosnippet, max-snippet:0 and data-nosnippet keep content out of AI answers on Google and Bing. They often arrive by accident, inherited from a template. Scan for them and confirm each one is intentional.
Google's generative AI inclusion setting
Inclusion in AI Overviews and AI Mode is the default. Search Console has an opt-out control, still rolling out to some property owners, and child properties inherit it from the parent. It can't be seen from outside, so whoever owns Search Console has to check it.
Index status, engine by engine
Once crawlers can reach you, check that each engine's index actually holds your pages. Use Google Search Console for Google and Bing Webmaster Tools for Bing. One being healthy tells you nothing about the other.
Otterly's 2026 experiment shows why. Google deindexed both of its 1,000-post AI-generated test sites, and Google's AI surfaces almost stopped citing them. Bing kept them, and Otterly reported that Microsoft Copilot produced 2,718 of the 3,934 citations it tracked for one site. It's one pair of sites on a low-stakes topic, so treat it as an illustration, not a law. The mechanism it illustrates is documented: an engine can't cite what its index no longer holds.
Two first-party reports are worth pulling into the audit. Google's generative AI report in Search Console shows impressions only, with no clicks or position. Bing's AI Performance report shows grounding queries, the searches the AI actually ran. That is the only window anywhere onto real retrieval input, which matters because, as covered in whether tools can see the prompts people actually type, prompt trackers test questions they chose themselves.
Accuracy: what engines get wrong about you
Access and indexing tell you whether engines can use your site. Accuracy tells you what they actually say. AI platforms get specific facts wrong about specific brands: prices, plan names, founding dates, locations, features that no longer exist.
An accuracy check works like this:
- Write the buyer questions a real prospect would ask.
- Ask each engine separately and record every factual claim about your brand.
- Compare each claim against a list of facts you've verified.
- Note whether the answer cited sources. An answer with no citations may come from training data with an older cutoff, not your current site.
Then look at your own site. If your pricing page, about page and footer state the same fact differently, fix that first. Stating a specific fact (a price, a number, a one-line definition) on a page crawlers can fetch gives an engine a sentence it can quote. When engines cite other sites instead of yours, being named accurately on those sites is associated with appearing in the answer, though nobody can promise the effect.
The free checker on this site runs up to three buyer questions and shows how engines answer them. It's a snapshot, not continuous tracking.
What you control and what you don't
Be honest about where an audit ends. Some things are fully yours, some are partly yours, and some belong to the engine.
| Item | Who controls it | What the audit does |
|---|---|---|
| robots.txt rules per bot | You | Check and fix |
| CDN and firewall rules | You and your CDN | Test each crawler, fix blocks |
| Server-side rendering | You | Diff raw vs rendered HTML |
| Snippet controls and noindex | You | Find accidental suppression |
| Google AI inclusion setting | You, in Search Console | Confirm it isn't opted out |
| Index membership | Engine, based on your site | Check Google and Bing separately |
| Retrieval for a given question | Engine | Observe, can't set |
| Which pages get cited | Model | Observe, can't set |
| Training-data knowledge | Model vendor | Note the cutoff, can't change it |
An audit fixes what blocks you. It can't promise a citation, a ranking or a score, and any vendor that does is selling something the evidence doesn't support.
A practical order of work
Run the audit in the same order the engines work.
- robots.txt: list every AI crawler and its rule. Separate training bots from search bots.
- Reachability: request a key page as each crawler. Fix any 403, rate limit or challenge page at the CDN or firewall.
- Rendering: compare raw and rendered HTML on your pricing, product and about pages. Move anything critical into the server response.
- Suppression: scan for
noindex,nosnippet,max-snippetanddata-nosnippet. Remove the ones nobody meant to set. - Google inclusion setting: confirm in Search Console, including inherited settings on child properties.
- Index status: check Google and Bing separately for your key pages.
- Accuracy: ask buyer questions on each engine, log wrong facts, fix contradictions on your own site.
- Re-check: repeat after deploys, CDN changes and platform updates.
Steps one to six are pass or fail. Step seven is where you'll find the problems customers notice. For an ongoing rhythm, the quarterly AI visibility review checklist turns this into a repeatable routine.
Common audit mistakes
Many audits still score things the evidence has ruled out or never supported.
- Treating schema as a quick win. Google says structured data isn't required for generative AI search. Ahrefs' matched-control test found AI Overview citations fell 4.6% after pages added schema. Existing markup does no harm, but it isn't a lever for AI answers.
- Reporting an E-E-A-T score. Google says E-E-A-T isn't a specific ranking factor. There is no score to measure.
- Scoring domain authority. It's a third-party metric. No engine computes it.
- Recommending llms.txt. Google says Search ignores it, and no engine documents reading it.
- Telling you to allow GPTBot for visibility. GPTBot governs training. ChatGPT search uses OAI-SearchBot.
- Reporting an AI rank. Google exposes impressions only. There's no position data to check a rank against.
- Trusting robots.txt alone. Without a reachability test, the audit misses firewall blocks.
- One blended score. Engines behave differently, so measure each one on its own.
Audits should also flag tactics that create risk, such as hidden text or content cloaked for AI crawlers. See auditing your site for risky GEO tactics.
Frequently asked questions
Is a GEO audit different from an AI SEO audit?
Mostly the names differ. Both should check whether AI engines can reach, index and accurately describe your site. The difference is in what vendors put inside them. A GEO audit that scores schema, llms.txt or content chunking is measuring things the evidence doesn't support. Judge any audit by whether it tests crawler access, rendering and index status first, and whether it reports wrong facts per engine rather than one blended number.
Can an AI SEO audit guarantee my brand gets cited?
No. An audit can confirm that crawlers reach your pages, that content is in the HTML, that nothing suppresses snippets, and that you're indexed. Those remove blocks. Whether an engine retrieves and cites you for a given question is decided by the engine and the model. Anyone promising citations, rankings or a specific score is claiming control that no publisher or vendor has.
Should I remove existing schema markup after an audit?
No. Google says existing structured data does no harm, so removing it isn't supported either. The honest position is that schema isn't a lever for AI answers. Keep markup that serves a real purpose, such as product data for classic rich results, and stop treating new schema as a way to get cited. Spend that effort on rendering and access fixes instead.
Does blocking GPTBot remove me from ChatGPT search?
No. OpenAI documents its crawlers as independent settings. GPTBot controls whether your content may be used for training. OAI-SearchBot controls whether your site can appear in ChatGPT search answers. You can block GPTBot and allow OAI-SearchBot. The audit risk runs the other way: a blanket rule that blocks every AI bot also removes ChatGPT search eligibility.
How often should I re-run an AI SEO audit?
Re-run the access checks after any deploy, CDN change or firewall rule update, since those can block crawlers without warning. Re-check accuracy on a regular schedule, such as quarterly, because engines change models and answers drift. Also re-check when a platform announces a default change, like Cloudflare's September 2026 crawler defaults, which altered access for some sites with no edit by the owner.
Sources
- AI Features and Your Website
- Overview of OpenAI Crawlers
- The rise of the AI crawler - Vercel
- 2000 AI Blogs Experiment: Does Google Penalize AI Content?
- We Tracked 1,885 Pages Adding Schema. AI Citations Barely Moved.
- [2607.14035] Optimizing Visibility in Generative Engines: A Critical Survey of Generative Engine Optimization (2023-2026)
This page is AI-assisted. It was written from a verified evidence base and checked against our editorial policy. Engine behaviour changes often; facts are as of October 21, 2026.