AI Visibility Tracking ToolFree checker

What SEO basics matter most for a small business website now?

99Visibility Research · Updated October 21, 2026 · 6 min read

Short answer

The basics that matter most are mechanical. Search and AI crawlers need to reach your pages. Your key content needs to be in the HTML before JavaScript runs. Your pages must be indexable and allowed to show a snippet. Your core facts need to be stated clearly and consistently. These same basics serve classic Google results and AI answers. Most other AI SEO advice has no evidence behind it.

Key takeaways

  • Google says a page needs to be indexed and snippet-eligible to appear in AI Overviews or AI Mode, with no additional technical requirements.
  • AI crawlers from OpenAI and Anthropic do not run JavaScript, so content that only appears after scripts run may be invisible to them.
  • robots.txt rules are per bot: GPTBot controls training use, while OAI-SearchBot controls whether you can show up in ChatGPT search.
  • Stating a specific fact, like a price or service area, on a fetchable page gives an engine a sentence it can quote.
  • Schema, llms.txt, E-E-A-T scores and AI-friendly rewriting are not levers for getting into AI answers.

Let crawlers reach and read your pages

robots.txt is per bot

Each AI company runs separate crawlers for separate jobs. OpenAI documents that GPTBot is for training, OAI-SearchBot is for ChatGPT search, and "each setting is independent of the others." A blanket block on every AI bot can quietly remove you from ChatGPT search. You can allow search while refusing training:

User-agent: OAI-SearchBot
Allow: /

User-agent: GPTBot
Disallow: /

Check Googlebot, bingbot, PerplexityBot and Claude-SearchBot the same way.

The firewall is a second gate

A CDN or firewall can block a crawler that robots.txt allows. The crawler usually gets a 403 or a challenge page, and nothing in your dashboards tells you. The AI Crawler Checker requests a page as each AI crawler and shows which ones get turned away.

JavaScript hides content from most AI crawlers

Vercel found that ChatGPT and Claude crawlers fetch JavaScript files but do not execute them, so they "can't read client-side rendered content." Googlebot does render JavaScript. If your site builder loads prices or service lists with scripts, view the page source and confirm the text is there.

Keep pages indexable and snippet-eligible

Four on-page controls keep content out of search snippets and AI answers: noindex, nosnippet, max-snippet:0 and the data-nosnippet attribute. Google documents all four. Bing added data-nosnippet support in October 2025 and excludes marked content from AI summaries.

These often arrive by accident. A theme ships with noindex on a staging setting. A developer wraps a section in data-nosnippet to hide a cookie banner and catches the pricing table too.

What to do:

  • View the source of your homepage, service pages and pricing page. Search for noindex and nosnippet.
  • Open Google Search Console and Bing Webmaster Tools separately. Confirm your key pages are indexed in each. One being healthy tells you nothing about the other.
  • Copilot draws on Bing's index, so Bing presence matters even if most of your traffic is from Google.

State your facts clearly, once, everywhere

AI platforms get specific facts wrong about specific businesses. A common cause sits on the business's own site: a price on the pricing page that differs from the footer, or an old address on the about page.

The one positive experimental signal for on-page content is plain: stating a specific fact on a fetchable page gives the engine a sentence it can quote. Write "Our standard cleaning costs $120" rather than "affordable pricing." Say which neighborhoods you serve.

Audit your own pages for contradictions first. Then check what the engines actually say. The local business fact check covers hours, addresses and service areas, and AI local SEO covers how local businesses appear in AI answers. Wrong facts are also worth weighting by harm, not count: a wrong price costs more than a vague true sentence.

The time sinks with no evidence behind them

Plenty of small business SEO advice now carries an AI label. Most of it does not hold up against primary sources.

Advice What the evidence shows
Add schema or FAQ schema to get cited Ahrefs' matched test of 1,885 pages found AI Overview citations fell 4.6% after adding schema. Google says structured data isn't required for generative AI search
Publish an llms.txt Google says Google Search ignores it. No other engine documents reading it
Improve your E-E-A-T score Google says E-E-A-T isn't a specific ranking factor. There is no score
Rewrite or chunk content for AI Google says you don't need to write in a specific way for generative AI search, and there is no ideal page length
Cover every long-tail keyword variant Google says you don't have to worry about capturing every variation

This does not mean you should rip out existing schema. Google says it does no harm. It just is not a lever for AI answers. The studies selling "GEO techniques" mostly measured pages already placed inside the model's context, and the best-designed one, C-SEO Bench, found most methods ineffective or harmful.

What to do this week

Spend one afternoon, not a retainer:

  1. Read your robots.txt and confirm the search bots are allowed.
  2. Test whether your firewall lets AI crawlers through.
  3. View source on your three most important pages and confirm the key text is in the HTML.
  4. Search those pages for noindex and nosnippet.
  5. Check indexing in Search Console and Bing Webmaster Tools.
  6. Fix any contradictory facts across your pages.

The one-afternoon AI visibility check lays this out step by step. After that, the free checker on this site shows whether AI engines name you for up to three buyer questions. If you're weighing outside help, read whether a small business needs an AI search optimization service first. Platform behavior described here is as of October 2026 and changes often.

Frequently asked questions

Should a small business block GPTBot?

That is a training decision, not a visibility one. OpenAI documents GPTBot as the crawler for training its models, and OAI-SearchBot as the one for ChatGPT search. The two settings are independent. You can block GPTBot and still allow OAI-SearchBot, and blocking GPTBot does not remove you from ChatGPT search. Allowing GPTBot also does not help ChatGPT find you.

Do I need schema markup for AI search?

No. Google says structured data isn't required for generative AI search. Ahrefs' matched test found AI Overview citations fell 4.6% after pages added schema, though every page in that test was already heavily cited. Existing markup does no harm and can still support classic rich results. Just don't spend time adding it to get into AI answers.

Will publishing lots of AI-written blog posts help?

It is a risk. Google's spam policies treat generating many pages without adding value for users as scaled content abuse, while appropriate use of AI is allowed. In OtterlyAI's 2026 experiment, Google deindexed two new sites of about 1,000 AI-generated posts each, with no manual action shown. A few accurate pages about your services do more than volume.

How long until these basics show results?

Nobody can promise a timeline or an outcome. Fixing access and indexing removes blocks, but engines decide what to retrieve and cite, and they re-crawl on their own schedules. What you can control is whether each page is reachable, readable and accurate. Check Search Console and Bing Webmaster Tools after fixes to confirm pages are indexed.

Is a free SEO crash course enough for a small business?

For the basics on this page, usually yes, as long as the course teaches from primary documentation rather than vendor claims. Look for coverage of robots.txt per bot, rendering, indexing and snippet controls. Be wary of any course that sells schema, llms.txt or E-E-A-T scores as AI levers. See [what a good AI SEO course covers](/guides/ai-seo-course).

Sources

  1. AI Features and Your Website
  2. Google's Guide to Optimizing for Generative AI Features on Google Search
  3. Overview of OpenAI Crawlers
  4. The rise of the AI crawler - Vercel
  5. We Tracked 1,885 Pages Adding Schema. AI Citations Barely Moved.
  6. Robots Meta Tags Specifications

This page is AI-assisted. It was written from a verified evidence base and checked against our editorial policy. Engine behaviour changes often; facts are as of October 21, 2026.

Keep reading