Deindexing: definition and its effect on AI answers

Deindexing is the removal of a URL, a section, or a whole site from one engine's stored index. It is the reverse of indexing. A page that is not in the index cannot be served from it.

There are three common causes:

• The site owner asks for it, usually with a noindex directive.
• An algorithm removes it, for example under a spam policy.
• A human reviewer applies a manual action. The difference matters for diagnosis, and manual action vs algorithmic deindexing covers it in detail.

Only the first cause is fully in your control.

Each engine decides on its own. Google and Bing run separate crawlers and separate indexes, so one can drop a page while the other keeps it.

Owner-initiated removal uses an on-page control. Google documents noindex, nosnippet, max-snippet and data-nosnippet as the on-page controls for its results:

<meta name="robots" content="noindex">

Engine-initiated removal follows the engine's policies. Google's spam policy defines scaled content abuse as "when many pages are generated for the primary purpose of manipulating search rankings and not helping users." Algorithmic removals may come with no notice. In Otterly's experiment, both deindexed sites showed zero manual actions in Search Console. The next move: if traffic drops sharply, check index status directly rather than waiting for a message. Here is how to tell if Google has deindexed your site.

AI answers that use live retrieval draw on an index. If the index loses your page, that answer path loses it too.

Google states that to be eligible as a supporting link in AI Overviews or AI Mode, a page "must be indexed and eligible to be shown in Google Search with a snippet." Deindexing from Google therefore closes Google's AI surfaces to that page.

Otterly's 2026 test showed this in practice. It published about 1,000 AI-generated posts on each of two new domains. Google removed one site after about 14 days and the other after about 90. Google AI Overviews, AI Mode and Gemini then almost never cited them. Bing never deindexed either site, and Microsoft Copilot, which grounds on Bing, produced 2,718 of the 3,934 citations Otterly tracked for one site (69%).

It was one pair of sites on a low-stakes topic, run by a vendor. The method and limits of the Otterly experiment are worth reading before you generalise. What it supports: check each engine separately, as described in checking index status engine by engine.

• "Search Console will warn me." Not for algorithmic removal. Otterly's sites got no manual action notice.
• "Deindexed means gone from AI everywhere." Not in the Otterly test. Copilot kept citing pages Google had dropped, because Bing still held them.
• "Being in Bing gets me into ChatGPT." In the same test, ranking in Bing produced effectively zero ChatGPT citations, even with ChatGPT's crawlers visiting.
• "Google deindexes AI-written content." Google says appropriate use of AI is not against its guidelines. The policy targets many pages made without value for users, however they were produced.

The practical line: you control whether your pages are eligible. You do not control whether an engine keeps them or cites them.

• Indexing: how a page gets stored in the first place.
• Googlebot: the crawler behind Google Search and its AI features.
• Bingbot: the crawler that feeds the Bing index Copilot grounds on.
• Bing and Copilot AI answers: how Microsoft's AI surfaces use that index.

Can an AI answer cite a page Google has deindexed? Yes, if the engine draws on a different index. In Otterly's 2026 test, Microsoft Copilot kept citing sites after Google removed them, because Bing still held them. Perplexity and Claude cited them too. Google's own AI surfaces almost never did, which matches Google's rule that AI Overviews and AI Mode only link to indexed, snippet-eligible pages.

Does a noindex tag keep my page out of AI Overviews? Yes, for Google. Google documents noindex, nosnippet, max-snippet and data-nosnippet as the on-page controls, and AI Overviews and AI Mode require a page to be indexed and snippet-eligible. Bing documents data-nosnippet as excluding content from its snippets and AI summaries. Check templates for accidental directives, because a stray noindex removes pages you wanted shown.

Does deindexing change what a model says without web search? No. When an AI answers without live retrieval, it relies on what it learned in training, frozen at a knowledge cutoff. Deindexing affects index-based retrieval only. A brand can therefore still appear in ungrounded answers after removal, and nothing a site owner does this quarter changes that training snapshot.

Is deindexing the same as a penalty? Not always. A manual action is a reviewer's decision and shows in Search Console. Algorithmic removal happens automatically and may show nothing. An owner can also deindex pages on purpose with noindex. The cause decides the fix, so identify which one applies before changing content.