Should I trust GEO case studies that show big citation gains?
99Visibility Research · Updated October 21, 2026 · 6 min read
Short answer
Not until they pass four checks. A GEO case study is credible only if it has a matched control group, accounts for brand size, ran on a live engine rather than a lab setup, and defines its metric. The best-known figure, up to 40% more visibility, came from a lab engine with the content already loaded into context. Most published gains fail at least one of these tests.
Key takeaways
- The '40% more visibility' figure was measured on a research engine with sources supplied in context, not on live ChatGPT or Google.
- A critical survey of 45 GEO studies found no technique with a stable, cross-platform causal effect on discoverability.
- Without a matched control group, a citation gain can't be separated from brand size, seasonality or engine changes.
- An undefined metric, such as a 'citation rate' with no denominator, makes any percentage unreadable.
- Single-site tests run by vendors are worth reading but are not proof, including tests run by AI visibility vendors like us.
The answer: treat big gains as unproven until they pass four checks
Most GEO case studies don't show what their headline says. The reason is structural, not a matter of honesty.
A critical survey of 45 GEO studies (arXiv:2607.14035, July 2026) concluded that "already-retrieved content can causally alter its citation or use, but no reviewed technique shows a stable, longitudinal, cross-platform causal effect on organic discoverability." In plain terms: research can show that editing a page changes how a model uses it once the page is already in front of the model. Nobody has shown that a GEO technique gets a page in front of the model in the first place.
That gap is where most case studies break. Run any claim through four questions:
- Was there a control group? Matched pages that didn't get the change.
- Was brand size accounted for? Big brands get cited more regardless of tactics.
- Was it a live engine or a lab? Lab engines often hand the model the content directly.
- How is the metric defined? If the number has no stated denominator, you can't read it.
If a study fails any one of these, treat its gain as a hypothesis. Our red flags guide covers the specific claims that fail most often.
Lab engines versus live engines: where the 40% figure came from
The most quoted number in GEO is "up to 40% more visibility." It comes from the original GEO paper (Aggarwal et al., arXiv:2311.09735, KDD 2024).
The authors built their own two-step engine and supplied the source documents in the model's context. Even the one test on Perplexity uploaded source text as file attachments, because Perplexity didn't let users specify source URLs. No part of the study touched how a live engine finds pages.
The metric also inflates the result. Position-Adjusted Word Count counts words from a source that appear in the answer, and the interventions added words to the source. The paper reports a 30 to 40% band across three methods, not the itemised per-method figures often quoted. We break this down in the 40% GEO claim, examined.
Later, better-designed studies found the opposite. C-SEO Bench (arXiv:2506.11097, NeurIPS 2025) found most conversational SEO methods "largely ineffective" and often harmful to a document's ranking. The "SEO" arm that did work simply moved the target document to position 1 in the model's context, which no publisher can do. See our C-SEO Bench summary for the method.
Control groups and brand size
A before-and-after chart with no control tells you almost nothing. Engines change models, retrieval behaviour and citation formats often. A gain over three months could be the engine, not the tactic.
A proper test compares treated pages against matched pages that weren't changed. Ahrefs ran one: 1,885 pages that added schema, each matched to 3 control pages. It found no major uplift on any platform, and a statistically significant 4.6% fall in AI Overviews citations. Ahrefs also disclosed its boundary: every treated page already had 100+ AI Overview citations. That honesty is what good studies look like.
Brand size is the biggest confounder in this field. A study of AI search citing patterns (arXiv:2507.05301) found the top 20 news sources accounted for 67.3% of citations for OpenAI models. If a case study features a well-known brand, its citations may reflect the brand, not the work.
Watch for jumps that sit exactly at a presence-versus-absence line, such as "brands with a review profile were cited far more." Brands with no profile tend to be small. The gap may be measuring company size.
How the metric is defined
A percentage is only as good as its denominator. Before trusting a number, find out:
- What counts as a citation. A linked source, a brand mention, or a quoted span? Engines cite differently, so totals across platforms aren't comparable.
- Which prompts were asked. Trackers count answers to prompts the vendor chose. The Otterly 2,000 AI blogs experiment logged 3,934 citations for one site, while Microsoft's own report credited it with 42,817. Time windows may differ, but any prompt set is a sample.
- Whether search was on. ChatGPT and Claude decide per query whether to search. A score that mixes searched and unsearched answers averages two different systems.
- Whether cited means used. OpenAI documents that the sources a model consulted usually outnumber the ones it cites.
If the study won't publish the prompt list or define the metric, you can't check the result.
A checklist for reading any GEO claim
Use this on any case study, vendor deck or LinkedIn post:
- Is there a matched control group, and how many pages are in each arm?
- Were treated and control sites similar in brand size?
- Did the test run on a live engine, with real retrieval, or on content placed in context?
- Is the metric defined, with a denominator?
- Are the prompts, dates and model versions published?
- Was search on, off, or mixed?
- Who ran it, and what do they sell?
- Has anyone independent replicated it?
A study can pass every item and still describe only one engine at one date. Results from 2025 models haven't been retested on the current generation as of October 2026.
What to do instead
Ask vendors for evidence on the levers that do hold up. These are access levers: content in the HTML before JavaScript runs, per-bot robots.txt rules, a firewall or CDN that lets AI crawlers through, and snippet controls set on purpose. They work by removing blocks, and you can check each one yourself.
Be wary of anyone promising a citation lift. Our page on agencies that guarantee AI citations explains why no one can promise that. For a wider view of what studies support, see what AI SEO research actually shows.
If you want a baseline before talking to any vendor, the free checker on this site shows whether AI engines name you for up to three buyer questions. It's a snapshot, not proof of cause.
Frequently asked questions
Are vendor-run GEO experiments worthless?
No. Public experiments with published numbers are more useful than private claims. The limits are design limits: one site per arm, no human-written control, and prompt sets nobody outside can inspect. Read them as signals worth replicating. The vendor's incentive doesn't make the data wrong, but it is a reason to wait for independent confirmation before changing your strategy.
What does a good GEO study look like?
It compares many treated pages with matched controls, states its sample size, defines its metric, runs on live engines, and discloses its limits. Ahrefs' schema study is a reasonable model: 1,885 treated pages with 3 matched controls each, plus a stated boundary that all pages were already heavily cited. That boundary tells you who the result applies to.
Why do lab studies show gains that don't appear in real engines?
Lab studies usually give the model the documents directly, so they skip the hardest step: getting retrieved at all. They measure how a model uses content already in front of it. Live engines rewrite queries, choose whether to search, and pick from large candidate pools. A gain inside the context window says little about reaching that window.
Can a case study prove a tactic works for my brand?
Rarely. Results depend on brand size, category, engine and date. A tactic that moved citations for a large brand on informational questions may do nothing for a small brand in a commercial category. Treat outside results as hypotheses, and fix the access problems you can verify on your own site first.
Should I ignore any claim with a big percentage in it?
Not automatically, but ask what the percentage is of. A 17x gain from 100 citations, measured with one tracker on one site, is a real observation with a small base. Check the denominator, the starting point, the control and the prompt set before treating the number as something you can expect.
Sources
- [2311.09735] GEO: Generative Engine Optimization
- [2607.14035] Optimizing Visibility in Generative Engines: A Critical Survey of Generative Engine Optimization (2023-2026)
- [2506.11097] C-SEO Bench: Does Conversational SEO Work?
- We Tracked 1,885 Pages Adding Schema. AI Citations Barely Moved.
- [2507.05301] News Source Citing Patterns in AI Search Systems
- 2000 AI Blogs Experiment: Does Google Penalize AI Content?
This page is AI-assisted. It was written from a verified evidence base and checked against our editorial policy. Engine behaviour changes often; facts are as of October 21, 2026.