AI Visibility Tracking ToolFree checker

If I block OAI-SearchBot, can ChatGPT still link to my site?

99Visibility Research · Updated October 21, 2026 · 5 min read

Yes, but only in a limited way. OpenAI says sites that opt out of OAI-SearchBot will not be shown in ChatGPT search answers, though they can still appear as navigational links. Blocking OAI-SearchBot removes you from the answers people read. Blocking GPTBot is a different choice: it only signals that your content should not be used for training. The two settings are independent.

What OpenAI's wording actually means

OpenAI's crawler documentation, as of October 2026, describes OAI-SearchBot like this: it "is used to surface websites in search results in ChatGPT's search features. Sites that are opted out of OAI-SearchBot will not be shown in ChatGPT search answers, though can still appear as navigational links."

That sentence sets up two outcomes:

  • Search answers. These are the responses where ChatGPT summarizes and cites sources. An opted-out site is not shown there.
  • Navigational links. A navigational link is a pointer to your site, typically when someone is looking for you specifically. OpenAI says an opted-out site can still appear this way.

So blocking OAI-SearchBot does not erase your domain from ChatGPT. It removes you from the part of ChatGPT search that answers buyer questions. OpenAI does not spell out on that page exactly when a navigational link appears, so treat it as possible, not guaranteed.

The practical reading: if you block OAI-SearchBot, someone asking ChatGPT for your site may still get a link. Someone asking "what's the best tool for X" should not see your pages cited in the answer.

How this differs from blocking GPTBot

OpenAI runs separate crawlers for separate jobs, and each one reads its own robots.txt rules. The documentation says "Each setting is independent of the others" and gives the exact example: a site can allow OAI-SearchBot to appear in search results while disallowing GPTBot to keep content out of training.

Crawler What it does What blocking it means
GPTBot Crawls content that may be used to train OpenAI's foundation models Signals your content should not be used for training. OpenAI claims no search effect
OAI-SearchBot Surfaces sites in ChatGPT's search features Not shown in ChatGPT search answers, may still appear as navigational links
ChatGPT-User Fetches pages when a user's action triggers it OpenAI says robots.txt rules "may not apply" and it is not used to decide search inclusion

Two common mistakes follow from mixing these up. Allowing GPTBot does not help you get cited in ChatGPT search. Blocking GPTBot does not remove you from ChatGPT search. For the full reasoning, see whether to block GPTBot if you want ChatGPT search.

Decide which outcome you actually want

Most sites want one of three setups. Pick the one that matches your goal, then write the rules to match.

Stay out of training, stay in search

This is the most common choice for brands that want to be recommended. Block GPTBot, allow OAI-SearchBot. The playbook for blocking AI training while keeping AI search covers other vendors too.

User-agent: GPTBot
Disallow: /

User-agent: OAI-SearchBot
Allow: /

Stay out of ChatGPT search answers

Block OAI-SearchBot. Accept that navigational links may still appear, and that you will not be cited when buyers ask ChatGPT open questions.

User-agent: OAI-SearchBot
Disallow: /

Allow everything

Allow both. This is a training decision as much as a visibility one, because GPTBot governs training only.

Say you run a hypothetical accounting firm that wants new clients from ChatGPT. Blocking OAI-SearchBot would cost you the answers where those clients compare firms. Blocking GPTBot would not.

Edge cases that change the picture

A blanket AI block

The most common real-world error is a single rule meant to stop AI training that also catches OAI-SearchBot. Read your robots.txt line by line, per agent. A free robots.txt check for ChatGPT search shows what your current rules say.

Your firewall or CDN

OpenAI's help page says eligibility needs two things: allow OAI-SearchBot to crawl, and confirm your host or CDN allows traffic from OpenAI's published searchbot IP addresses. A firewall that returns 403 blocks the bot even when robots.txt allows it, and nothing in your dashboard tells you. Testing whether your firewall lets AI crawlers in walks through the check.

CDN defaults can move without you. From 2026-09-15, Cloudflare set Training and Agent crawlers to blocked by default on ad-displaying pages for new domains and existing free-tier customers, with Search allowed by default. Check what your zone actually does.

User-triggered fetches

ChatGPT-User is not the search crawler, and OpenAI says robots.txt may not apply to it. Blocking OAI-SearchBot is not a full shutoff for every OpenAI request.

What the model already knows

With search off, ChatGPT answers from training data frozen at a cutoff. OpenAI lists Feb 16, 2026 for the GPT-5.6 models and Aug 31, 2025 for the Instant path. Changing robots.txt today does not reach those answers.

What to do next

  1. Write down the outcome you want for training and for search, separately.
  2. Read your robots.txt rules for GPTBot and OAI-SearchBot as separate entries. Fix any blanket rule that catches both.
  3. Request a page as OAI-SearchBot and confirm it gets a 200, not a 403 or a challenge page. The AI Crawler Checker shows which crawlers your firewall turns away.
  4. Recheck after any CDN or security change, because defaults can shift without an edit on your side.

Allowing OAI-SearchBot buys eligibility, not citations. OpenAI says ranking uses "multiple factors" and placement is not guaranteed. What you control is whether the door is open. For more detail on each bot, see OpenAI's crawler documentation, digested.

More on this

Does blocking GPTBot remove my site from ChatGPT search? No. OpenAI says each crawler setting is independent. GPTBot covers content that may be used for training. OAI-SearchBot covers ChatGPT's search features. You can disallow GPTBot and allow OAI-SearchBot, and OpenAI gives exactly that combination as an example on its crawler page. Your search eligibility depends on the OAI-SearchBot rule and on whether your firewall lets OpenAI's search crawler through.

Will allowing OAI-SearchBot get me cited in ChatGPT? Not by itself. Allowing the bot makes you eligible to appear in ChatGPT search answers. It does not decide whether ChatGPT retrieves or cites your page for a given question. ChatGPT also decides per query whether to search at all, and it rewrites prompts into its own search queries. Access is necessary, but OpenAI says placement is not guaranteed.

My robots.txt allows OAI-SearchBot. Why might I still be missing? Check the network layer first. OpenAI asks that your host or CDN allow traffic from its published searchbot IP addresses, and bot protection can return 403 errors to legitimate crawlers. Also check for JavaScript-only content: tests by Vercel found ChatGPT's crawlers fetch JavaScript files but do not execute them, so content that appears only after scripts run may be invisible.

Can I stop ChatGPT from fetching my page when a user pastes the link? Not reliably through robots.txt. Those fetches come from ChatGPT-User, which acts on a user's request. OpenAI says robots.txt rules may not apply to it, and that it is not used to decide whether content appears in search. If you need to block these requests, that is a server or firewall decision, and it is separate from your OAI-SearchBot rule.

Sources

  1. Overview of OpenAI Crawlers
  2. Searching the web with ChatGPT
  3. OpenAI
  4. The rise of the AI crawler - Vercel

This page is AI-assisted. It was written from a verified evidence base and checked against our editorial policy. Engine behaviour changes often; facts are as of October 21, 2026.

Keep reading