AI Visibility Tracking ToolFree checker

What should I look for when switching to a different AI visibility tool?

99Visibility Research · Updated October 21, 2026 · 6 min read

Look for six things when you switch AI visibility tools. Does the tool tell you what to fix, or only count mentions? Does it score each engine separately? Does it disclose whether answers used live web search? Does it flag wrong facts about your brand? Does it check whether AI crawlers can reach your site? Finally, expect your old scores not to compare with the new ones.

The switching checklist, and why each item matters

Most teams switch because the old tool showed a number but never explained it. Use the switch to buy the thing you were missing. Check these six points before you sign.

  1. Fixes or only tracks. A tracker tells you how often you were named. A fixing tool tells you why you were not, and names the specific thing to change. See tracking tools vs fixing tools for the full split.
  2. Per-engine scoring. Each engine should get its own score, with its own prompts and results.
  3. Retrieval state. The tool should say whether each answer came from live web search or from the model's built-in knowledge.
  4. Accuracy checks. It should flag wrong facts (prices, products, ownership), not only count mentions.
  5. Access checks. It should test whether AI crawlers can actually fetch your pages.
  6. A clean break on scores. Old and new numbers measure different things. Treat the switch as a new baseline.

The reasoning behind this list is simple. A critical survey of 45 GEO studies (arXiv:2607.14035, July 2026) found no technique with a stable, cross-platform causal effect on discoverability. What holds up are access fixes and factual corrections. A tool worth switching to should be built around those.

Scoring: per engine, with retrieval state disclosed

Engines are not interchangeable. Google states that AI Overviews and AI Mode "may use different models and techniques" and can return different links. Otterly's public 2,000 AI blogs experiment showed how far engines diverge. Microsoft Copilot produced 2,718 of the 3,934 citations Otterly tracked for one test site (69%), while ChatGPT, Gemini, AI Overviews and AI Mode almost never cited it. A single blended score would have hidden that.

Retrieval state is the second problem. As of October 2026, ChatGPT decides per question whether to search the web. Claude.ai search is a user toggle. Perplexity's Agent API needs web search switched on. An answer with search off reflects what the model learned before its knowledge cutoff. An answer with search on reflects your live pages. Those need separate fixes.

Ask any candidate tool:

  • Which engines do you query, and through which surface (consumer app or API)?
  • Is web search on or off for each engine, and do you record it per answer?
  • Can I see the raw answers and cited URLs, not just the score?

If a tool reports your "AI rank" or "position" in Google's AI features, be skeptical. Google's Search Console report for AI features shows impressions only, so no position data exists to check such a number against. Our guide to prompt-based tracking vs engine-reported data covers what each source can and can't show.

Accuracy and access: the checks that lead to fixes

Accuracy

The complaint most brands actually have is "ChatGPT gets our pricing wrong." A good tool compares AI answers against facts you supply and flags each mismatch by severity. Check how it scores errors. Established factuality metrics such as FActScore divide errors by the number of facts or answers checked. A score that only subtracts penalty points will fall when you add prompts, even if accuracy is unchanged. More on this in choosing a brand accuracy monitoring platform.

Access

Access has the strongest evidence of anything in this field. A good tool should check:

  • robots.txt per bot. OpenAI documents that each bot setting is independent. Blocking GPTBot stops training use. OAI-SearchBot controls whether you appear in ChatGPT search.
  • Firewall and CDN reachability. OpenAI's help center says eligibility means allowing OAI-SearchBot and confirming your host or CDN allows its published IP addresses. A firewall can return 403 to a bot that robots.txt allows.
  • JavaScript rendering. Vercel found ChatGPT and Claude crawlers fetch JavaScript files but don't execute them. Content that only appears after scripts run may be invisible to them.

You can test the firewall question before you choose anything. 99Visibility's free AI Crawler Checker requests a page as each AI crawler and shows which ones get turned away.

Why your old scores won't carry over

Expect a break in your trend line. Two tools differ in prompts, engines, models, retrieval settings and scoring formula. Any one of those changes the number.

Prompt choice alone moves results. ChatGPT rewrites your question into its own search queries, so a prompt set is a proxy for an input nobody outside the engine sees. Prompt samples also undercount. In Otterly's experiment, Microsoft's own report credited the site with 42,817 citations against the 3,934 Otterly's tracker logged, though the windows may not match.

How to manage the switch:

  1. Export raw answers, prompts and cited URLs from the old tool before you cancel.
  2. Run both tools for an overlap month if budget allows, on the same prompts where possible.
  3. Record the new tool's first result as your baseline, with the date and engine list.
  4. Compare movements within one tool only. Never compare one tool's 62 with another's 48.

If you manage several brands, the same rules apply per brand. See what agencies should look for.

Red flags and what to do next

Some features sound impressive and rest on nothing. Walk away from a tool that:

  • Sells an "E-E-A-T score". Google says E-E-A-T isn't a specific ranking factor, so there is no score.
  • Lists schema or FAQ schema as a quick win for AI citations. Ahrefs' matched test found AI Overview citations fell 4.6% after pages added schema.
  • Promises "up to 40% more visibility". That figure came from a lab engine with content already supplied in context.
  • Guarantees citations or rankings. No tool controls what models say.

Then compare cost on like-for-like terms: engines covered, prompts, audit frequency and brands. Our breakdown of what drives GEO tool pricing helps. To see where you stand today at no cost, the free checker on this site runs up to three buyer questions and returns a snapshot score, which gives you a reference point before you commit.

More on this

Should I switch from a tracking tool to a fixing tool? Switch if your current tool shows a number but never tells you what is blocking you. Tracking is useful for watching change over time. Fixing tools add diagnosis: crawler access, JavaScript rendering, snippet controls and wrong facts. The evidence supports access fixes most strongly, so a tool that checks them gives you actions you control. Many teams keep light tracking and add a fixing audit.

How many engines should a replacement tool cover? Cover the engines your buyers use, scored separately. ChatGPT, Google AI Overviews, Gemini, Perplexity and Claude are the common set. Coverage matters less than separation. Engines draw on different indexes, and Otterly's experiment showed one engine citing a site thousands of times while others barely cited it. A tool that blends engines into one number hides the engine where you have a problem.

Can I import my history from the old tool? You can import the raw data, but not the scores. Export prompts, answers, cited URLs and dates so you keep a record. The old scores came from a different formula, prompt set and engine configuration, so plotting them next to new scores creates a fake trend. Start a fresh baseline on the new tool and compare changes within it.

Does a tool that allows GPTBot in my robots.txt help me appear in ChatGPT? No. OpenAI documents GPTBot as a training crawler. ChatGPT search uses OAI-SearchBot, and each setting is independent. A good tool checks each bot separately and reports the documented consequence of blocking it. It should also test whether your firewall or CDN lets the bot through, because robots.txt permission alone isn't enough.

Is a cheaper tool with fewer prompts good enough? Often, yes, if it scores engines separately and shows raw answers. A small, stable prompt set you track consistently tells you more than a large one that changes. Watch the scoring method: if it doesn't divide errors by answers checked, adding prompts later will lower your score for no real reason. Ask the vendor how the formula handles that.

Sources

  1. AI Features and Your Website
  2. Overview of OpenAI Crawlers
  3. Searching the web with ChatGPT
  4. The rise of the AI crawler - Vercel
  5. 2000 AI Blogs Experiment: Does Google Penalize AI Content?
  6. [2607.14035] Optimizing Visibility in Generative Engines: A Critical Survey of Generative Engine Optimization (2023-2026)

This page is AI-assisted. It was written from a verified evidence base and checked against our editorial policy. Engine behaviour changes often; facts are as of October 21, 2026.

Keep reading