Bing Rank Tracking for ChatGPT Citations: What a 38-Query Test Shows
A 38-query exploratory test found some overlap between Bing page-one results and ChatGPT-cited sites, but the evidence supports using Bing as context rather than as a ChatGPT citation ranking metric.
· 13 min read
A 38-query experiment found that 25% of sites cited by ChatGPT appeared on Bing’s first page for the original query, while 60.5% appeared on neither Bing nor Google page one. For teams evaluating Bing rank tracking for ChatGPT citations, the practical payoff is a clearer reporting method: retain Bing rankings as search context, but measure observed ChatGPT citations separately rather than presenting either as the other.
The original discussion was posted in r/seo, not r/TechSEO. It compared Bing and Google page-one results for 38 queries with sites surfaced and cited during ChatGPT web-search answers. The sample is useful exploratory evidence, but it does not establish a universal formula for how ChatGPT retrieves or cites sources.
Bing rank tracking for ChatGPT citations: the short answer
Bing rankings and ChatGPT citations answer different questions. A Bing rank tracker measures where a page or domain appears in Bing’s conventional results for a specified query, location, language, device, and time. A citation observation records whether ChatGPT displayed a link to a source in one particular answer to one particular prompt.
In the r/seo experiment, ChatGPT visibly searched the web for 26 of 38 prompts and answered the other 12 without a visible web search. Across the 26 searched prompts, the researcher recorded 147 distinct cited sites. Of those cited sites:
- 25% were also on Bing page one for the original query.
- 24.5% were also on Google page one for the original query.
- 10% were on both Bing and Google page one.
- 60.5% were on neither engine’s first page for that exact original query.
Those numbers do not make Bing irrelevant. They show that a first-page Bing appearance for a short, fixed keyword cannot be treated as a ChatGPT citation prediction. Conversely, failure to rank on Bing page one for that phrase does not prove that a site cannot be cited for a related ChatGPT prompt.
OpenAI’s published help documentation states that ChatGPT Search can search the web when current web information would help answer a request and can use search queries to find relevant sources. That documented behavior is sufficient to explain why a conventional keyword rank and a final cited source may not align one-to-one; it does not reveal a public citation-ranking formula.
What the r/seo experiment measured
The r/seo post used 38 keywords spanning software, shopping, how-to, and brand searches. The researcher checked Bing and Google page-one results for the same original queries using a browser configured for US English, then recorded the sites that appeared in ChatGPT’s visible web-search activity and the sites cited in final answers.
Clear units matter here. The post measured sites, not verified page-to-page matches:
- A site is the source property or domain-level entity counted in the experiment.
- A page is a specific URL, such as a pricing page, article, help document, or product page.
- A source-pool site is a site recorded among sources surfaced during visible search activity.
- A cited site is a site represented by a citation displayed in ChatGPT’s completed answer.
This distinction prevents a common overstatement. If Bing ranks a site’s homepage and ChatGPT cites a different page on that same site, the experiment can identify site-level overlap, but it cannot prove that the Bing-ranking page caused or directly supplied the citation.
The researcher reported 220 sites in the broader source pool across the 26 prompts that visibly triggered search. In that pool, 18.6% were on Bing page one for the original query, compared with 10% on Google page one. That is an association in this small dataset, not evidence of a fixed provider relationship or a causal mechanism.
Why 18.6% and 25% should not be described as a decline
The original article’s comparison needs a mathematical correction. The 18.6% figure applies to the broader pool of 220 source-pool sites. The 25% figure applies to 147 cited sites. Since 25% is greater than 18.6%, Bing page-one representation did not “fall” from 18.6% to 25%.
More importantly, the two percentages have different denominators and describe different sets. Rounded to approximate site counts, 18.6% of 220 is about 41 sites, while 25% of 147 is about 37 sites. The exact counts cannot be reconstructed safely from rounded percentages alone, and the cited set is not necessarily a simple subset that can be compared as a funnel without the underlying record-level data.
The defensible reading is narrower:
- In the 220-site source pool, Bing page-one overlap was reported at 18.6%.
- In the 147-site final citation set, Bing page-one overlap was reported at 25%.
- These results show that some overlap existed in both sets, but neither percentage converts a Bing position into a citation forecast.
This is also why reports should avoid phrases such as “Bing sources were filtered out” unless the test records precisely which individual source-pool sites later became citations. The r/seo post provides helpful directional data, but not a complete trace of ChatGPT’s source-selection process.
The original keyword may not be the research query
A short user prompt can represent a much broader research task. Someone entering “best CRM for small business” may want a recommendation based on prices, features, integrations, business size, support, security, or a specific industry. A conventional rank tracker usually follows the literal tracked phrase; a web-answer system may search for related formulations.
The r/seo post supplied a CRM example, but its scope should be kept precise. For a prompt about the best CRM for small businesses, the researcher reported observing a substantially expanded search query containing concepts including software, pricing, features, and comparisons. The experiment reported that only one of nine cited sites for that answer ranked on Bing page one for the initial keyword.
That observation does not establish the full chain of internal query reformulation, nor does it prove that every cited page was found through the expanded wording. It does demonstrate why testing only one head term can give an incomplete picture of visibility.
A more useful prompt inventory
As an editorial audit recommendation—not a finding from the 38-query experiment—teams can group prompts by the decision a reader is trying to make:
- Brand and comparison: “Brand A vs Brand B,” alternatives, reviews, and migration questions.
- Commercial category: software, service, or product recommendations for a defined audience.
- Problem-solving: implementation, troubleshooting, compliance, or educational questions.
- High-intent detail: prices, compatibility, integrations, locations, delivery, and setup requirements.
For example, an accounting-software company could observe “best accounting software for freelance designers,” “accounting software with Stripe reconciliation,” and “alternatives to Xero for a five-person agency.” These are distinct prompts, not synonyms, and each can produce a distinct citation set.
When a conventional tracking system shows an apparent movement, audit the measurement before declaring lost visibility. Similar discipline is useful in traditional search reporting, including when Google.com/goto URLs create false ranking-loss signals.
Category results were suggestive, not benchmarks
The r/seo post’s category breakdown showed different degrees of overlap. Brand comparison searches had the closest conventional-search alignment: 37% of cited sites were reported on Bing page one and 33% on Google page one. For software searches, the reported overlap was lower: 17% on Bing page one and 20% on Google page one.
These figures are useful hypotheses for future testing, not industry benchmarks. The total sample was only 38 queries, the post did not establish equal category sizes in the available summary, and individual query wording can substantially alter the source set. A 37% rate in this sample does not mean every brand comparison should have a 37% Bing overlap.
Brand comparisons are often more constrained because they name products or companies. A prompt such as “Asana vs Monday” can reasonably lead to vendor documentation, pricing information, review publishers, and comparison pages. A broad term such as “help desk software” leaves more possible interpretations, including listicles, product sites, forums, implementation guides, and sources tailored to an inferred company type.
For an agency, the practical use is prioritization. Brand-comparison prompts may be efficient places to compare conventional rankings with observed citations. Broad category prompts deserve wider prompt coverage and more careful analysis of the cited pages’ content type rather than a single rank-tracking verdict.
Record citations at URL level while reporting the study at site level
The experiment’s headline percentages should remain site-level because that is what it measured. A new audit, however, can capture URL-level evidence without rewriting the historical result as if it had done the same.
A cited site can contain many materially different pages. Bing might show a homepage for a tracked query while ChatGPT displays a citation to a pricing page, a knowledge-base article, original research, or a comparison guide. Domain-level reporting conceals that difference.
A practical observation sheet can include the following fields:
| Field | What it establishes |
|---|---|
| Exact prompt | The request being tested. |
| Test date and locale | The context for a time-sensitive observation. |
| Visible web search? | Whether the answer exposed search activity or citations. |
| Cited URL | The exact page displayed to the user. |
| Cited site | A domain-level roll-up for competitors and publishers. |
| Page type | For example, documentation, product, editorial, forum, or government page. |
| Bing and Google context | Positions for defined matching queries, recorded separately from citations. |
| Notes | Changes in prompt wording, answer format, or source availability. |
This separation is especially valuable when multiple pages compete for similar intent. A site’s homepage, category page, and comparison page should have distinct purposes rather than all trying to serve the same query. The same underlying ambiguity can be addressed through a home page keyword cannibalization audit, although citation behavior should still be measured directly rather than inferred from that audit.
A cautious workflow for citation observation
The following workflow is an editorial recommendation for repeatable measurement. It is not a result or prescribed testing cadence from the r/seo experiment.
Define a bounded prompt set
Start with a commercially meaningful set, such as 20 to 50 prompts, rather than one trophy keyword. Include branded comparisons, category questions, problem-solving questions, and high-intent details. The correct number varies with a site’s size, markets, and available audit time; the key is to document the list so later observations are comparable.
Keep conditions visible
Record the date, language, country or locale setting where known, account state where relevant, browser or app, and exact prompt. The original researcher noted an important limitation: the browser was physically outside the United States despite being configured for US English. That caveat may matter more for local, shopping, and location-sensitive prompts.
Classify outcomes without overdiagnosing them
Separate answers with visible citations from answers without visible web search. In the source test, 12 of 38 prompts did not visibly trigger web searching. A non-citation on one run is therefore not, by itself, proof that a page is technically blocked, unhelpful, or excluded from all future answers.
When Audra is used in this process, its answer-engine observations can sit alongside technical SEO, performance, accessibility, and link-audit findings in a local desktop workflow. The responsible interpretation remains the same: an observed citation is evidence of one answer at one time, while a technical audit identifies conditions worth investigating rather than guaranteeing citation eligibility.
How to use Bing without calling it a ChatGPT ranking
Bing still has legitimate value in an AI-visibility audit. It provides conventional-search context, a competitor benchmark, and a way to identify pages that deserve closer prompt testing. The r/seo dataset also reported higher Bing than Google overlap in the broader source pool—18.6% versus 10%—for the original keyword comparison.
That finding supports including Bing in a research workflow. It does not support claims that a particular Bing position causes a citation, that Bing page one is a required threshold, or that ChatGPT publishes an equivalent organic ranking system.
A clear client report can show three separate metrics:
- Bing visibility: the page or site’s position for a documented conventional query.
- ChatGPT citation visibility: the count or share of tested prompts where a specified cited URL or site appeared.
- Citation context: the prompt, date, answer type, competitors or publishers cited, and whether web search was visible.
This structure avoids a misleading single “AI rank.” It also makes changes easier to investigate. If ChatGPT referral traffic appears to drop, for example, citation observations should be considered alongside analytics implementation and attribution before assuming demand or visibility vanished; ChatGPT referral-traffic diagnosis requires that same distinction.
Limits of the evidence
The 38-query r/seo analysis is a useful field test, not a comprehensive study of ChatGPT source selection. Its stated constraints include 38 keywords, one observation per keyword, one day of testing, a browser located outside the US, and comparison at the site level rather than exact URL level.
The result can also vary with wording, geography, language, timing, source updates, and whether a prompt visibly invokes web search. The published OpenAI help article describes web search behavior at a high level, but it does not provide a stable public formula for ranking or citation selection. No analyst should infer one from this sample.
The durable takeaway is compact: Bing is useful context for answer-engine auditing, and it may overlap with sources seen in some ChatGPT searches. It is not a substitute for recording the pages ChatGPT actually cites for the prompts a business cares about.
FAQ
Does Bing rank tracking tell you what ChatGPT will cite?
No. In the r/seo 38-query test, 25% of cited sites were on Bing page one for the original query, while 60.5% were on neither Bing nor Google page one. Bing rankings are useful conventional-search context, but observed ChatGPT citations need their own measurement.
Did Bing overlap fall from 18.6% to 25% in the experiment?
No. The 18.6% figure describes Bing page-one overlap among 220 source-pool sites, while 25% describes overlap among 147 cited sites. Since 25% is higher, it is not a fall; more importantly, the two figures use different denominators and should not be framed as a direct funnel.
Does the study prove that ChatGPT uses Bing results?
No. The experiment found an association between Bing page-one results and some sites in its source pool and citation set. It did not expose a complete retrieval process, establish causation, or prove a fixed source relationship. The results should be treated as exploratory evidence.
How often should a business check ChatGPT citations?
There is no frequency established by the 38-query experiment. An editorially sensible approach is to choose a cadence that matches how quickly the market and content change, then keep prompts and conditions documented. More frequent testing can be appropriate for volatile topics, but each run remains a dated observation rather than a permanent ranking.
Why can ChatGPT cite a site that is not on Bing page one?
The original query may not represent every search formulation used during research, and the study reported an expanded CRM-related query example. A site may also be cited for a specific page or claim even when it does not rank on page one for the initial broad phrase. The experiment measured site-level overlap, not a universal rule.