AI SEO Tips That Hold Up Under the Evidence
99Visibility Research · Updated October 21, 2026 · 9 min read
Short answer
The AI SEO tips that hold up are access tips. Server-render the facts that matter, allow each AI search crawler by name in robots.txt, confirm your CDN or firewall lets those crawlers through, remove accidental noindex or nosnippet tags, and check your index status in Google and Bing separately. State key facts plainly on pages that can be fetched. Schema, llms.txt, chunking and E-E-A-T scores have no evidence behind them as AI levers.
Key takeaways
- The tips with real evidence remove blocks: rendering, per-bot robots.txt, network reachability, index eligibility and snippet controls.
- Almost every published GEO effect size was measured on pages already inside the model's context, not on whether a page gets found.
- Blocking GPTBot opts you out of OpenAI training, while OAI-SearchBot controls ChatGPT search, and the two settings are independent.
- Schema, FAQ markup, llms.txt, chunking and E-E-A-T scores are not documented levers for AI answers.
- Every tip on this page can be checked with a fetch, a header or a dashboard, so you can verify it instead of trusting it.
Why most AI SEO tips fail a simple check
Most AI SEO tips in circulation were never tested on the thing you care about: whether an AI engine finds your page and uses it. A July 2026 critical survey of 45 GEO studies (arXiv:2607.14035) concluded that already-retrieved content can change how it gets cited, but no reviewed technique showed a stable, cross-platform effect on discoverability.
That gap matters. The famous GEO experiments placed documents directly into the model's context, then rewrote them. They measured what happens after a page is already in the answer pool. They never measured how a page gets into that pool.
The best-designed of those studies found the rewriting tactics ineffective or harmful. C-SEO Bench, a NeurIPS 2025 benchmark, reported that most conversational SEO methods were largely ineffective and frequently lowered a document's ranking.
So a useful tip has to pass one test: is there a documented mechanism, stated by the engine operator or shown in a controlled study, and can you check it yourself? If you want the longer list of claims that fail this test, see GEO claims that don't hold up.
The four stages between your page and an AI answer
An AI answer that mentions your brand passes through four stages. Sorting tips by stage tells you which ones you can actually act on.
| Stage | What it decides | Who controls it |
|---|---|---|
| Parametric | What the model knows with no web access, frozen at a training cutoff | Nobody, in the short term |
| Access | Whether a crawler may fetch and store your page | You and your CDN |
| Retrieval | Whether your page enters the model's context for a query | The engine, partly |
| Generation | Which retrieved pages get used and cited | The model |
The access stage is where the evidence is strong. It's also mostly subtractive. There's no markup or phrasing that makes a page more eligible. There are only ways to be ineligible.
Retrieval is also discretionary. As of October 2026, Google AI Overviews often don't trigger, ChatGPT decides per query whether to search, and Claude.ai search is a user toggle. Any AI visibility number blends answers given with and without live retrieval. That's one reason GEO studies disagree with each other.
AI SEO tips that hold up, and how to check each one
Server-render the facts that matter
Vercel's crawler study found that ChatGPT and Claude crawlers fetch JavaScript files (11.50% and 23.84% of requests) but don't execute them, so they can't read client-side rendered content. Googlebot renders; most AI crawlers don't.
Check: fetch a key page with JavaScript disabled and compare the text with the rendered page. If your pricing, product names or headings appear only after hydration, most AI crawlers never see them.
Allow each AI search crawler by name
robots.txt rules are per bot. OpenAI's crawler documentation says sites opted out of OAI-SearchBot won't be shown in ChatGPT search answers, and that each setting is independent of the others. GPTBot governs training only.
User-agent: OAI-SearchBot
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: Claude-SearchBot
Allow: /
Check: read your live robots.txt for each named retrieval bot. The common failure is a blanket AI block that removes search eligibility along with training.
Confirm your firewall agrees with your robots.txt
OpenAI's help centre says eligibility needs both: allow OAI-SearchBot, and confirm your host or CDN allows traffic from OpenAI's published IP ranges. A CDN can return 403 to a crawler that robots.txt allows. Cloudflare announced that from 15 September 2026 it blocks Training and Agent crawlers by default on ad-displaying pages for new domains and existing free-tier customers, so a site can lose access without anyone editing it.
Check: request a page with each AI crawler's user agent and record the status code. The AI Crawler Checker does this per crawler.
Remove accidental suppression
Google and Bing document noindex, nosnippet, max-snippet and data-nosnippet as the controls that keep content out of AI answers. They often arrive by template.
Check: search your HTML and headers for these directives and confirm each one is intentional.
Check index status engine by engine
Google says a page must be indexed and eligible for a snippet to appear as a supporting link in AI Overviews or AI Mode, with no additional technical requirements. Bing's index backs Microsoft Copilot. In Otterly's 2026 experiment, Google deindexed both test sites and its AI surfaces stopped citing them, while Bing kept them and Copilot kept citing them.
Check: open Google Search Console and Bing Webmaster Tools separately. A healthy one tells you nothing about the other.
State specific facts plainly
A price, a number or a one-line definition on a fetchable page gives an engine a sentence it can quote. This is the only positive experimental signal for on-page content, and it's modest.
Get named where engines already look
When engines cite other sites instead of yours, being named on those sites is the route into the answer. The evidence shows a strong association, not a promised effect.
What you control and what you don't
Be clear with your team about this split before anyone promises results.
In your control:
- Whether your important content exists in raw HTML.
- Which crawlers your robots.txt allows.
- Whether your CDN, firewall or bot manager lets those crawlers through.
- Whether your pages carry noindex or snippet restrictions.
- Whether facts on your own site agree with each other across pricing, about and footer pages.
Not in your control:
- What a model learned before its training cutoff.
- Whether an engine decides to search for a given question.
- The queries the engine actually runs. OpenAI says ChatGPT search rewrites your question into one or more targeted queries.
- Where your page sits in the model's context list, which C-SEO Bench found mattered more than any rewrite.
- Brand prominence, which dominates citation patterns across studies and has no shortcut.
Fixing access doesn't guarantee citation. It decides whether your content can be considered at all. If someone asks whether there's a proven way to increase AI citations, the honest answer is no, but there are proven ways to stop blocking yourself.
A practical order of work
Work from the cheapest, most decisive checks to the slowest ones.
- Read robots.txt per bot. Confirm OAI-SearchBot, PerplexityBot, Claude-SearchBot and Googlebot are allowed. Decide on GPTBot, ClaudeBot and Google-Extended as a separate training question.
- Test network reachability. Request key pages as each crawler. Any 403, 429 or challenge page is a block, whatever robots.txt says.
- Run the rendering diff. Compare raw HTML with rendered text on your homepage, pricing page and top product pages.
- Scan for suppression tags. Look for noindex, nosnippet, max-snippet:0 and data-nosnippet.
- Check index status in Google and Bing. Use Search Console and Bing Webmaster Tools, not a third-party guess.
- Audit your own facts. Make sure your price, founding year and product names match everywhere on your site.
- Then work on presence elsewhere. Earn mentions on the sites engines already cite for your topic.
Steps 1 to 4 usually become developer work. Our guide to developer tickets for AI access fixes shows how to write them so they get done. For the longer-term plan around these steps, see building an AI SEO strategy on evidence.
Popular AI SEO tips the evidence rejects
These appear in many tip lists. Each one fails against a primary source.
- "Add schema to get cited." Google says structured data isn't required for generative AI search. Ahrefs' matched test of 1,885 pages found AI Overview citations fell 4.6% after schema was added. Existing markup does no harm; it just isn't an AI lever.
- "Add FAQ schema." Google deprecated FAQ rich results in May 2026. Q&A content can still be useful to readers. See whether you need an FAQ page for AI.
- "Publish an llms.txt." Google's AI optimization guide says Google Search ignores these files. No other engine documents reading one.
- "Chunk your content for LLMs." Google rejects this and says there's no ideal page length. The chunking research measures segmentation done by the retrieval system, not the publisher. See the document chunking study.
- "Write in an AI-friendly style." Google says you don't need to write in a specific way for generative AI search.
- "Improve your E-E-A-T score." Google says E-E-A-T isn't a specific ranking factor. There is no score.
- "Build domain authority." Domain Authority is a Moz metric. No engine computes it.
- "Allow GPTBot so ChatGPT finds you." GPTBot is for training. Search uses OAI-SearchBot.
- "GEO gets you up to 40% more visibility." That figure came from a lab engine with sources already loaded into context.
- "Ping IndexNow and AI will cite you faster." The IndexNow spec never mentions AI, and Google doesn't use it.
Common mistakes when applying AI SEO tips
- Blocking all AI bots at once. One blanket rule can remove ChatGPT search eligibility when you only meant to opt out of training.
- Trusting robots.txt alone. A firewall rule or CDN default can override it silently. Test the actual response.
- Testing in a logged-in browser. Memory and custom instructions change ChatGPT's search queries. Test logged out, or don't treat results as reproducible.
- Reading one blended score. In Otterly's experiment, Copilot cited the test site thousands of times while ChatGPT and Google's AI surfaces barely did. Measure each engine separately.
- Mass-publishing thin pages. Google's spam policies treat many pages generated to manipulate rankings as scaled content abuse. Otterly's AI-generated test sites were deindexed with no manual action shown.
- Hiding text for AI crawlers. Prompt injection and cloaking exist, and research shows some agents can be manipulated. They're illegitimate and put your whole site at risk.
For the full evidence ranking behind each tip, read AI SEO best practices, sorted by evidence.
Frequently asked questions
Should I remove schema markup if it doesn't help AI answers?
No. Google says existing structured data does no harm, and it still supports some classic search features. The evidence only says schema isn't a lever for AI citations. Ahrefs' matched study found no meaningful lift on any platform and a 4.6% drop on AI Overviews, but every page it tested was already heavily cited. Leave working markup in place and spend new effort on access checks instead.
Does ranking in Google's top 10 still matter for AI Overviews?
It's associated, not decisive. Ahrefs found in March 2026 that 37.9% of URLs cited in AI Overviews also appeared in the top 10 results. Google says a page only needs to be indexed and snippet-eligible to qualify as a supporting link, with no extra optimization required. Treat organic ranking as one input among several, not a guarantee in either direction.
Should I block GPTBot?
That's a training decision, not a visibility decision. OpenAI says GPTBot collects content that may be used to train its models, and that each crawler setting is independent. You can disallow GPTBot and still allow OAI-SearchBot, which controls whether you appear in ChatGPT search. Nothing in the evidence measures whether blocking training changes what a model recalls about your brand later.
Can I track my ranking position inside AI answers?
No reliable position data exists. As of October 2026, Google's Search Console report for AI features shows impressions only, with no clicks or position. Google also says third-party tools don't have access to its internal ranking data. What you can track honestly is whether an engine names you for specific questions, on each platform separately, with the retrieval state noted.
How do I know if an AI engine has my facts wrong?
Ask each engine the questions a buyer would ask, logged out, and compare its answers with the facts on your own site. Look for wrong prices, outdated product names and competitor mix-ups. Then check that your own pages state those facts consistently in raw HTML. The free checker on this site runs up to three buyer questions as a quick snapshot.
Sources
- Overview of OpenAI Crawlers
- The rise of the AI crawler - Vercel
- AI Features and Your Website
- Google's Guide to Optimizing for Generative AI Features on Google Search
- We Tracked 1,885 Pages Adding Schema. AI Citations Barely Moved.
- [2607.14035] Optimizing Visibility in Generative Engines: A Critical Survey of Generative Engine Optimization (2023-2026)
This page is AI-assisted. It was written from a verified evidence base and checked against our editorial policy. Engine behaviour changes often; facts are as of October 21, 2026.