Why do Bing's AI citation counts differ from my tracking tool?
99Visibility Research · Updated October 21, 2026 · 6 min read
Short answer
Bing's AI Performance report counts citations from real usage across Microsoft Copilot, Bing's AI summaries and select partner integrations. A prompt tracker counts citations only in answers to the prompts it chooses to ask, on the days it runs them. The tracker is a sample, so its count will usually be far smaller. Trust Microsoft's number for Copilot volume and trust the tracker for cross-engine comparison and answer content.
Key takeaways
- In Otterly's 2026 experiment, Microsoft's report credited one site with 42,817 citations while Otterly's prompt-based tracker logged 3,934 across seven engines, and the time windows may not match.
- The like-for-like comparison is Copilot only: 2,718 tracked Copilot citations against Microsoft's 42,817.
- A prompt set samples a small slice of what real users ask, and engines rewrite queries before they retrieve anything.
- Use engine-reported data for absolute volume on that engine and tracker data for what answers say and how engines compare.
- Never blend the two into one number; trend each separately with matched date windows.
The short answer: your tracker counts a sample
Microsoft's AI Performance report in Bing Webmaster Tools counts citations from real usage. It covers Microsoft Copilot, AI-generated summaries in Bing and select partner integrations. A prompt tracker counts citations only in the answers to its own prompts, run on its own schedule.
So the two numbers answer different questions:
- Microsoft's report: how often did Microsoft's AI surfaces cite my pages across everything users asked?
- Your tracker: how often did each engine cite me for the specific prompts in my prompt set?
The first is close to a full count for one engine family. The second is a sample across several engines. A large gap is the expected result, not a bug. The fix is not to reconcile them into one figure. It's to use each for the job it can do, which the comparison of prompt tracking and engine-reported data covers in more depth.
What the Otterly experiment showed
OtterlyAI ran a public test in 2026: two new domains, each loaded with roughly 1,000 AI-generated posts, tracked across seven AI engines for about four months.
For capybara-world.com, Otterly's prompt-based tracker logged 3,934 citations in total. Of those, 2,718 came from Microsoft Copilot. Microsoft's own AI Performance report credited the same site with 42,817 citations.
Two things matter when you read those numbers:
- Compare like with like. The 3,934 figure spans seven engines. The fair comparison with Microsoft's report is the Copilot slice, 2,718 against 42,817.
- The windows may differ. Otterly's published figures and Microsoft's report may not cover the same dates. Don't read the gap as an exact ratio.
Even with those caveats, the direction is clear. Where an engine publishes its own count, that count sees more than a prompt sample can. The test also has limits: one site, a low-competition topic, and a vendor running it. It shows what a sample is, not how big the gap will be for you.
Why a prompt set can't see everything
A tracker is limited by design. Several mechanisms push its count below the engine's:
- Real users phrase things in endless ways. A tracker asks a fixed list. Every variation it doesn't ask is a citation it can't see.
- Engines rewrite the question. OpenAI says ChatGPT search typically rewrites a query into one or more targeted queries before sending them to search providers. The query that retrieves your page may look nothing like your prompt.
- Retrieval is discretionary. On every major platform, the engine decides per query whether to search at all. A prompt that triggered a search yesterday may not today.
- Trackers run at intervals. A daily or weekly run catches a snapshot. The engine logs every answer in between.
- Some surfaces are out of reach. Microsoft's report includes partner integrations that an outside tracker can't query.
This is why adding more prompts raises raw citation counts without telling you the true total. A bigger sample is still a sample.
When to trust engine data and when to trust the tracker
Each source wins on different questions.
| Question | Better source | Why |
|---|---|---|
| How many times did Copilot cite my pages? | Microsoft's AI Performance report | Counts real usage, not a sample |
| Which queries actually retrieved my content? | Bing grounding queries | The only first-party view of real retrieval input |
| What does ChatGPT, Perplexity or Claude say about me? | Prompt tracker | No equivalent first-party citation report exists for those engines in our evidence base |
| Is an engine getting my pricing wrong? | Prompt tracker | Engine reports count citations, not answer content |
| How do engines compare for the same question? | Prompt tracker | Same prompts, same day, across engines |
Rule of thumb: trust the engine for volume on its own surfaces. Trust the tracker for content, accuracy and side-by-side comparison. Bing's grounding queries are especially useful because they show what the AI actually searched for. You can see which queries Copilot used and feed the best ones back into your prompt set.
Edge cases that distort both numbers
Neither count is perfect. Watch for these:
- Grounding queries are sampled. Microsoft scopes its sampling note to the grounding queries metric, not to the whole report. The details are in whether Bing's AI Performance data is sampled.
- Citation Share is not a scoreboard. Microsoft calls it an observational metric. It can fall while your absolute citations rise, because the denominator grows with competitors.
- The report is new. It entered public preview in February 2026 and expanded in June 2026. Definitions can change, so note the date on every export.
- Cited is not the same as used. OpenAI exposes retrieved sources separately from citations, and the retrieved set is larger. Mechanistic research on how models cite shows citation output can be changed without changing the sources. Both counts are proxies for influence.
- Google shows less. As of October 2026, Google's Search Console report for AI Overviews and AI Mode shows impressions only, with no clicks or position. Google also says the two surfaces may use different models.
- Trackers have partial runs. If an engine errors on some prompts, the count drops for reasons unrelated to you.
What to do next
- Verify your site in Bing Webmaster Tools and open the AI Performance report. The Bing Webmaster Tools setup playbook walks through it.
- Export on a fixed schedule. As of our August 2026 evidence, the report had no API, so manual exports are the only route.
- Match windows before comparing. Line up the exact dates in both sources, and compare Microsoft's total with your tracker's Copilot-only count.
- Mine the grounding queries. Add real retrieval phrasing to your prompt set so your sample looks more like actual traffic.
- Trend each source separately. Never average an engine count with a tracker count. They have no shared denominator.
- Use a tracker for what answers say. For a quick snapshot, the free checker on this site shows whether engines name you for up to three buyer questions. It's a sample too, so read it alongside Microsoft's report.
If Copilot citations are low in both sources, check access first: whether Bing has indexed your pages and whether your CDN lets bingbot through. How Copilot grounds answers in Bing explains why the Bing index comes first.
Frequently asked questions
Is the gap always as large as in the Otterly test?
Nobody knows. Otterly's experiment is one site on a low-competition topic, and its date windows may not match Microsoft's report. The size of the gap depends on how many prompts you track, how often you run them, and how varied real user questions are in your category. The only safe conclusion is direction: a prompt sample will usually see fewer citations than an engine's own count.
Can I pull Bing's AI citation data into my dashboard automatically?
As of the evidence reviewed in August 2026, no. The AI Performance report lived in the Bing Webmaster Tools interface, and the Bing Webmaster API documentation had no citation or grounding fields. Microsoft has indicated API access may arrive during 2026, so check the current documentation. Until then, export manually on a fixed schedule and record the date range of each export.
Should I add prompts until my tracker matches Microsoft's number?
No. More prompts raise raw counts, but you'll never reach a census by sampling, and chasing a match distorts your trend line. Keep a stable prompt set so changes over time mean something. Improve it by adding real grounding queries from Bing, not by inflating volume. Report tracker results as rates per prompt, not as totals meant to rival the engine.
Do ChatGPT or Perplexity publish a citation report like Bing's?
Not in the evidence we reviewed. For those engines, prompt trackers and API-based checks are the main way to see what answers say. ChatGPT adds a utm_source=chatgpt.com parameter to referral links, so your analytics can show some ChatGPT clicks. That tagging is incomplete, so treat referral counts as a lower bound on visits, not a citation count.
Which number should I report to leadership?
Report both, clearly labelled. Use Microsoft's count for Copilot volume and say which dates it covers. Use tracker results for cross-engine presence, accuracy and competitor mentions, and say it's a sample of a fixed prompt set. Don't combine them into one visibility figure. A blended number hides which engine moved and why.
Sources
This page is AI-assisted. It was written from a verified evidence base and checked against our editorial policy. Engine behaviour changes often; facts are as of October 21, 2026.