AI Visibility Tracking ToolFree checker

AI Hallucination vs Outdated Answer: How to Diagnose What AI Gets Wrong About Your Brand

99Visibility Research · Updated October 21, 2026 · 6 min read

Short answer

An AI hallucination about your brand is a fact that was never true. An outdated answer is a fact that was true once but has changed since the model's training data or its source was captured. An unverifiable answer is a claim nobody can check either way. Each needs a different fix: correct the source, publish the current fact on a fetchable page, or accept the model's limits until a later generation.

Key takeaways

  • Sort every wrong AI answer into invented, outdated or unverifiable before you try to fix it, because each one has a different cause.
  • Comparing the answer with search on and search off tells you whether the error lives in the model's memory or in a page it retrieved.
  • Publishing the current fact as plain text on a page AI crawlers can fetch is the main lever you control.
  • Nothing you publish today changes a retrieval-off answer until the vendor ships a model with a later knowledge cutoff.

Three kinds of wrong answer

When ChatGPT has wrong information about your business, the error usually falls into one of three buckets.

  • Hallucination. The AI states something that was never true. A price you never charged, a founder who never existed, an acquisition that never happened.
  • Outdated answer. The AI states something that used to be true. Your old pricing, a feature you dropped, a previous headquarters. The model learned it before a knowledge cutoff, or it retrieved an old page.
  • Unverifiable claim. The AI states something you have no record of either way, or says it has no information about you. Nobody can confirm or refute it from public sources.

The distinction matters because the fixes don't overlap. Correcting a source does nothing for a model that learned the fact before its cutoff. Publishing new facts does nothing if a third-party page keeps repeating the error. Start with the label, then pick the fix.

Hallucination vs outdated vs unverifiable at a glance

Hallucination Outdated answer Unverifiable claim
Was it ever true? No Yes, before a change Unknown
Typical cause Model filling a gap, or a wrong third-party page Training data before the cutoff, or a stale page retrieved No fact on record anywhere the model can reach
Tell-tale sign Specific detail with no source behind it Matches your old site or old press Vague, hedged, or "no information"
Fix you control Correct the source; publish the right fact Publish the current fact on a fetchable page Publish the fact; get named on sites engines cite
What you can't control What the model generates Retrieval-off answers until a later model Whether the engine searches at all

For a full walkthrough of the first column, see the hallucination triage playbook.

How to diagnose which one you have

Run the same question a few ways and write down what changes.

  1. Check the history. Was the stated fact ever true? Look at old pricing pages, archived press releases and past product docs. If it was true once, it's outdated. If never, it's a hallucination.
  2. Look for citations. If the answer links sources, open them. A wrong fact on a cited page is a source problem, not a model problem. OpenAI's help page on ChatGPT search says it rewrites your question into targeted queries it sends to search providers, so the pages it cites are the pages it used.
  3. Compare search on and search off. Retrieval is per query and discretionary on every platform as of October 2026. An answer with no citations may come from the model's trained memory. If the error appears only with search off, it lives in parametric knowledge.
  4. Compare dates. If your change happened after the model's knowledge cutoff, a retrieval-off answer can't know about it. OpenAI's model docs, checked in August 2026, listed a February 16, 2026 cutoff for the GPT-5.6 family and August 31, 2025 for the Instant path. "ChatGPT" is not one knowledge state.

The free checker on this site runs up to three buyer questions and shows what each engine says, which gives you a snapshot to sort before you start fixing.

Fixing a hallucination

A hallucination has two possible origins, and the fix depends on which.

The error comes from a cited page

If a review site, directory or old article states the wrong fact, that page is the problem. Ask the publisher to correct it. Engines that cite other sites instead of yours show a strong association between being named on those sites and appearing in the answer. That's an association, not a promised effect.

Third-party pages can also carry injected instructions aimed at AI agents. A 2026 study of LLM search agents (arXiv:2606.16821) found manipulated content in the result set could sway what agents endorsed, with results varying by model. Treat this as a reputational risk to watch for, never as a tactic to copy.

The error has no source

If nothing is cited, the model is filling a gap. State the correct fact plainly on your own site: one sentence, a specific number, no hedging. Stating a specific fact on a fetchable page gives an engine a sentence it can quote, which is the only positive experimental signal for on-page content. Also check that your own site doesn't state the same fact two ways, for example one price on the pricing page and another in a footer. The pricing-specific guide covers the most common case.

Fixing an outdated answer

Outdated answers split by retrieval state.

With search on, the engine is reading an old page. Update or redirect it, and make sure the current fact is in the raw HTML. Vercel's crawler study found ChatGPT and Claude crawlers fetch JavaScript files but don't execute them, so content that only appears after JavaScript runs may be invisible to them. Then confirm access: OpenAI's crawler docs say sites opted out of OAI-SearchBot will not be shown in ChatGPT search answers. Blocking GPTBot affects training only, and each setting is independent.

With search off, the model learned the old fact before its cutoff. No page edit reaches that answer. It changes only when the vendor ships a model trained on newer data. The outdated facts playbook and the guide on how long AI takes to update brand info cover timing in more detail.

Unverifiable claims and the limits nobody controls

Some answers aren't wrong so much as unanchored. The model asserts a headcount or founding year you've never published, or it says it has no information about your company.

Here the honest position is limited control. You can publish the fact on a fetchable page and you can work to be named on sites engines already cite. You can't make an engine search for a given query, and you can't change what a frozen model knows. Requesting a correction directly from vendors is possible in some cases, and the page on asking OpenAI or Google to correct brand info covers what to expect.

Avoid the shortcuts. Schema markup, llms.txt files and "AI-friendly" rewrites have no credible evidence behind them as citation levers. Ahrefs' matched-control study found AI Overview citations fell 4.6% after pages added schema.

Which to use when

  • The fact was never true and a cited page states it: contact that publisher and ask for a correction.
  • The fact was never true and nothing is cited: publish the correct fact as a plain sentence in server-rendered HTML, and remove contradictions across your own pages.
  • The fact used to be true and the answer cites an old page: update or redirect that page, then check that OAI-SearchBot, PerplexityBot and Claude-SearchBot can reach it.
  • The fact used to be true and the answer appears only with search off: publish the current fact anyway, then wait for a later model generation. Re-check after major model releases.
  • The AI can't verify the fact or says it knows nothing: publish the fact, pursue mentions on sites engines already cite, and accept that retrieval is the engine's choice.

For platform-specific steps, start with fixing ChatGPT errors in trained knowledge vs search.

Frequently asked questions

Why does ChatGPT give different wrong answers about my company on different days?

ChatGPT decides per query whether to search, and it can route between models with different knowledge cutoffs. One day you may get a retrieval-on answer built from a web page, the next a retrieval-off answer from trained memory. Memory and custom instructions can also change how queries are rewritten. Test logged out, with memory off, and note whether citations appear each time.

Can I make ChatGPT forget an outdated fact?

Not directly for retrieval-off answers. The model learned the fact before its knowledge cutoff, and that knowledge is frozen until the vendor releases a newer model. For retrieval-on answers, you can update or redirect the old page it cites and make sure the current fact sits in the raw HTML where OAI-SearchBot can fetch it.

Does allowing GPTBot help ChatGPT get my facts right?

OpenAI documents GPTBot as a training crawler only and asserts no search benefit from allowing it. ChatGPT search uses OAI-SearchBot, and OpenAI says each setting is independent. Whether allowing training crawls improves what future models know about you has not been measured by anyone, so treat it as a policy choice, not a fix.

Is a wrong number worse than a vague answer?

Usually, yes. A specific fabricated price or acquisition can mislead a buyer in a way a vague but true description can't. That's why it helps to rank errors by severity when you triage them: fix wrong prices, ownership and product claims first, then outdated details, then minor unverifiable statements that carry little commercial risk.

Sources

  1. Overview of OpenAI Crawlers
  2. Searching the web with ChatGPT
  3. The rise of the AI crawler - Vercel
  4. [2606.16821] How Much Can We Trust LLM Search Agents? Measuring Endorsement Vulnerability to Web Content Manipulation
  5. We Tracked 1,885 Pages Adding Schema. AI Citations Barely Moved.

This page is AI-assisted. It was written from a verified evidence base and checked against our editorial policy. Engine behaviour changes often; facts are as of October 21, 2026.

Keep reading