How to Run a ChatGPT Local Business Visibility Audit
A reliable ChatGPT local business visibility audit uses structured local prompts, repeated fresh-chat tests, source logging, and technical checks rather than isolated screenshots.
· 15 min read
A local business can appear first in one ChatGPT response, disappear in the next, and be replaced by a competitor when web search is enabled. A ChatGPT local business visibility audit turns that volatility into a measurable baseline, so agencies and site owners can identify where a brand is mentioned, which sources support the answer, and what needs fixing before the next audit.
The method below builds on a practical testing framework shared in an r/SEO discussion: use 15–20 prompts across three intent groups, run each prompt three times in fresh conversations, test different search conditions, and record mentions, sources, accuracy, and competitors. That produces evidence instead of a persuasive-looking one-off screenshot. For a local business, it also produces a clear list of technical, entity, content, and local-data issues to investigate.
Why one ChatGPT screenshot is not a visibility metric
A screenshot can prove that ChatGPT mentioned a company in one specific response at one point in time. It cannot prove consistent recommendation visibility. The original r/SEO workflow makes this distinction well: repeated prompts are necessary because outputs can vary between runs, and cited sources can change when search is used.
For example, a searcher might ask for “best emergency plumber in Austin” three times. One reply may name a company in position two, another may name it in a grouped list without an order, and a third may recommend only national lead-generation platforms. Calling any one of these results “ranking number one in ChatGPT” overstates the evidence.
ChatGPT can search the web and show links to sources when it uses web search. OpenAI also says its search experience can use location information for local results. That means results can be influenced by wording, search availability, geographic context, sources retrieved, and the model’s final synthesis. (help.openai.com)
A useful audit therefore measures a defined test environment rather than promising a permanent universal position. The question is not “does ChatGPT recommend this business once?” It is: how often does the business appear across a representative set of high-intent local questions, under documented conditions?
Define the scope before running the audit
A credible audit begins with a concise brief. Without one, prompt selection drifts and month-to-month comparisons become unreliable. The brief should define one business, one primary market, a defined service set, and a target testing period.
At minimum, record these six items:
- Business identity: official name, website, phone number, primary address or service area, and Google Business Profile URL.
- Market definition: city, neighborhood, ZIP-code area, or metro area. “Dallas” and “North Dallas” are not interchangeable tests.
- Priority services: three to five revenue-driving services, such as dental implants, water-damage restoration, family law, or roof repair.
- Competitor set: five to 10 businesses that repeatedly appear in Google results, local packs, directories, or prior AI answers.
- Test conditions: ChatGPT account type, model if displayed, search setting, approximate tester location, date, and time zone.
- Success measure: a baseline mention rate, an improvement target, or a requirement to reduce inaccurate answers.
The local market must be fixed before a score has meaning. A Tampa HVAC contractor may serve 25 nearby communities, but a prompt set that tests only “Tampa” will not measure visibility in Clearwater, Brandon, or St. Petersburg. Separate prompt clusters should be created for areas that matter commercially.
This is also where an agency should decide whether the goal is broad discovery, direct brand recognition, competitor displacement, or answer accuracy. Those are related but distinct outcomes. A business that is regularly cited as a source might still not be named in a recommendation, while a business named in an answer may be described with an incorrect phone number or service area.
Build 15–20 prompts across three local intent groups
The source method uses three prompt types: category plus city, problem-based prompts, and comparison or brand prompts. Keeping the total set to 15–20 makes manual testing practical while producing enough observations to avoid drawing conclusions from a handful of answers.
1. Category-plus-city prompts
These test direct commercial discovery. They should use the terminology a prospective customer would naturally type or say, not only the exact wording on a service page.
Examples for a roofing company in Phoenix include:
- Best roof repair companies in Phoenix
- Reliable residential roofers near downtown Phoenix
- Phoenix companies that replace tile roofs
- Who should a homeowner call for emergency roof repair in Phoenix?
- Licensed roofers in Phoenix with strong customer reviews
A business does not need to be named in every response to have useful visibility. But these prompts show whether it has a chance of entering shortlist-style answers where buyers are actively comparing providers.
2. Problem-based prompts
Problem prompts tend to reveal whether the business is associated with a useful service outcome rather than merely a category label. They are especially important when customers do not know the formal service name.
For the same roofer, the prompts could include “My roof is leaking after a monsoon in Phoenix; who can inspect it quickly?” or “Who repairs cracked clay roof tiles in Phoenix?” These queries test service-page clarity, topical specificity, and whether third-party sources describe the business in the right context.
3. Comparison and brand prompts
Comparison prompts measure the market around the business, while brand prompts diagnose basic entity recognition and factual reliability. They should not be used alone, because asking “Is Acme Roofing good?” practically hands the model the business name.
Examples include:
- Compare Acme Roofing with three Phoenix roof repair companies.
- Is Acme Roofing a good choice for tile roof repair in Phoenix?
- Which Phoenix roofers offer emergency leak repairs: Acme Roofing, Competitor A, or Competitor B?
- What services, address, and contact details does Acme Roofing have?
The comparison group helps document which competitors repeatedly occupy recommendation space. The brand group helps detect incorrect details before a client or customer sees them.
Use fresh conversations and repeat every prompt three times
For 15–20 prompts, three runs per prompt creates 45–60 responses per test condition. If the same set is tested with search enabled and with search unavailable or deliberately not invoked, the audit contains 90–120 outputs. That is still manageable manually, but materially stronger than one response per phrase.
Each run should start in a new conversation. A fresh chat limits the influence of earlier prompts within the same thread, such as a previous discussion of competitors or a request to favor a particular company. It does not guarantee a completely neutral environment: account-level settings, custom instructions, and available personalization can still affect behavior.
OpenAI describes Temporary Chat as separate from chat history and says it does not create or use memories, although custom instructions may still apply. For comparable tests, auditors should document whether they used a normal new chat or Temporary Chat and should use the same approach throughout the audit. (help.openai.com)
A disciplined run sequence looks like this:
- Open a new or Temporary Chat and confirm the intended search condition.
- Paste one exact prompt without adding clarifications or follow-up questions.
- Save the complete output, sources shown, date, time, and test-condition notes.
- Start a completely new conversation before the next repetition.
- Repeat until the prompt has three independent observations.
Avoid editing a prompt halfway through the test. “Best roofers in Phoenix” and “best roofing companies Phoenix AZ” may appear equivalent, but they are separate queries. If both matter, each should be a separate row in the prompt library.
Test ChatGPT search conditions separately
Search-enabled responses and non-search responses should never be mixed into the same metric without a label. ChatGPT may decide that web information would improve an answer, and users can manually invoke search where that option is available. When ChatGPT searches, it can retrieve current web material and attach source links; without search, the response may rely on what the model learned during training. (help.openai.com)
For a local business audit, the two modes answer different questions:
| Test condition | What it helps assess | What to log |
|---|---|---|
| Search used | Current discoverability, source selection, crawl and access issues | Cited domains, URLs, business details, named competitors |
| Search not used | Broader brand/entity recognition in the model response | Mention, position, accuracy, and competitor set |
Auditors should not force an artificial conclusion when a particular interface does not provide a reliable on/off control. Instead, label the observed condition honestly: “web sources displayed,” “no web sources displayed,” or “search condition uncertain.” The source display is the practical evidence that an answer used web retrieval.
For local prompts, tester geography can be another confounder. A company may be appropriate for “near me” in one location but irrelevant in another. Use explicit city or neighborhood wording unless the audit intentionally evaluates location-aware discovery. Never compare a Chicago test run against a Miami test run as though they were interchangeable.
For more context on why the same brand can look different across AI surfaces, see Audra’s comparison of Google AI Overviews, ChatGPT, and Perplexity citations. Different products retrieve, cite, and present supporting material differently, so results should not be treated as one shared AI ranking system.
Log the fields that make results actionable
A spreadsheet is sufficient for an initial 90-response audit. The key is a consistent schema, not a sophisticated dashboard. Each row should represent one prompt run, rather than one aggregate prompt result.
A practical audit sheet includes:
| Field | Example |
|---|---|
| Prompt ID | PB-04 |
| Exact prompt | “Who repairs cracked clay roof tiles in Phoenix?” |
| Run number | 2 of 3 |
| Search evidence | Sources displayed |
| Brand mentioned | Yes |
| Mention position | 2 of 4 named providers |
| Recommendation type | Direct recommendation / list / citation only / not mentioned |
| Competitors named | Competitor A, Competitor C, directory site |
| Sources cited | Google Business Profile, Yelp, company service page |
| Facts correct | Service correct; phone number incorrect |
| Notes | Answer says 24/7, but site does not claim that |
The most useful top-line metric is:
Mention rate = number of prompt runs where the business is mentioned ÷ total prompt runs × 100
If a business appears in 21 of 60 runs, its mention rate is 35%. That is more informative than saying it “ranked” in ChatGPT. It is also helpful to calculate separate mention rates for category, problem, and comparison prompts. A 60% brand-prompt mention rate alongside a 10% problem-prompt mention rate often signals that the business is known by name but not strongly associated with the customer need.
Position should be captured, but cautiously. Lists are frequently unordered, and some replies name a company in prose without making a ranked recommendation. Use labels such as “first named,” “second named,” and “unranked mention,” rather than inventing a precise rank where none exists.
Diagnose patterns behind a weak mention rate
The audit is useful only if the findings lead to checks that can be completed. Three recurring patterns from the source workflow deserve special attention: crawler access, inconsistent business information, and service pages that do not provide a direct answer early enough.
Check access before changing content
OpenAI documents OAI-SearchBot as the crawler used to surface websites in ChatGPT search features. Its documentation says that sites opting out of OAI-SearchBot will not be shown in ChatGPT search answers, though they can still appear as navigational links. OpenAI recommends permitting OAI-SearchBot in robots.txt and allowing its published IP ranges. (developers.openai.com)
That makes a crawl review a sensible first diagnostic when search-enabled answers never cite the client site. Check the production robots.txt, redirecting subdomains, CDN or WAF rules, and server logs where available. A permissive homepage rule is not enough if a security layer blocks the crawler before it reaches a service page.
Audra’s guide to OpenAI crawlers and robots.txt checks explains the distinction between crawler directives and actual request access. Allowing a bot does not guarantee a recommendation, but accidentally blocking it can remove a pathway for search-based discovery.
Reconcile business facts across the web
A local business should maintain consistent name, address, phone number, hours, service area, and core categories across its site and the major profiles that appear in answers. This is not a claim that matching NAP data automatically causes ChatGPT mentions. It is a quality-control issue: conflicting facts create weak or confusing source material for systems and customers alike.
Use the audit log to identify the exact conflict. If ChatGPT repeatedly cites an outdated directory phone number, record the directory, correct it if the business controls the listing, and retest after the source updates. If competing locations share near-identical names, publish clear location-specific details on the relevant landing pages.
Improve the page most relevant to the prompt
When problem prompts fail, the answer may not be a generic “write more AI content” project. A service page may simply fail to answer the customer’s need clearly. A page titled “Roof Repair” should quickly state what types of roof repair the company handles, where it works, how urgent jobs are managed, and what a customer should do next.
For example, a first-page answer block might say that the contractor repairs tile, shingle, and flat-roof leaks across Phoenix and offers emergency inspections subject to availability. It should be accurate, visible in crawlable HTML, and supported by the rest of the page. Unsupported superlatives and invented availability claims create accuracy risks rather than durable visibility.
The broader local evidence in Audra’s analysis of AI search visibility for local businesses is a useful reminder that local answer visibility should be tracked as a pattern of mentions and sources, not a single keyword position.
Separate visibility from accuracy and trust
A business can have a high mention rate and still perform poorly in a client-ready audit. If ChatGPT states the wrong opening hours, claims a service is offered when it is not, or sends users to an obsolete phone number, the visibility is not fully valuable.
Create a separate factual-accuracy score:
Accuracy rate = responses with no material factual error ÷ responses where the business was mentioned × 100
Consider a legal firm mentioned in 18 out of 45 runs. If six responses state it handles personal-injury cases when it only practices estate planning, its mention rate is 40%, but its accurate-mention rate is just 26.7% (12 accurate mentions divided by 45 total runs). That distinction prevents an agency from celebrating a misleading result.
Source quality belongs in the same review. A recommendation supported by the company’s current service page and a well-maintained business profile deserves different scrutiny from one based on a thin lead-generation page. The audit does not need to declare one source universally authoritative; it should identify which sources recur and whether they are correct, controllable, and aligned with the business’s actual offering.
Turn the findings into a fix-and-retest plan
The first audit establishes a baseline, not a verdict. Prioritize fixes by the clearest observed bottleneck, assign an owner, and preserve the original prompt set for the next measurement cycle.
A simple priority framework is:
- High impact, high confidence: unblock OAI-SearchBot, repair a broken service-page canonical, update incorrect owned-profile details, or fix a wrong address on the website.
- High impact, lower confidence: expand a thin primary service page, improve location relevance, or earn better third-party coverage.
- Lower impact: refine prompts, add supporting FAQ content, or improve pages tied to rarely searched services.
Retest with the same 15–20 prompts, the same three-run rule, and documented conditions. Changes in the answer interface, model behavior, web results, and local business data mean no fixed retest interval will fit every company. For active campaigns, a monthly or quarterly cadence is often more interpretable than daily spot checks, provided the business also retests promptly after major website migrations, robots.txt changes, rebrands, or directory corrections.
A local-first auditing workflow can reduce the manual burden here. Audra is designed to combine AI answer-engine visibility checks with technical SEO, performance, accessibility, best-practice, and link auditing in a desktop workflow, helping teams tie an AI visibility finding to the page or crawl issue that may be worth investigating. It should still be used as evidence gathering, not as a promise that any edit will produce a specific ChatGPT recommendation.
For agencies needing to explain the strategic value of this kind of measurement, Audra’s article on ChatGPT business analytics and organic visibility provides useful framing: the operational value comes from repeatable observation and decisions, not a vanity screenshot.
FAQ
How many prompts should a ChatGPT local business visibility audit use?
A practical starting point is 15–20 prompts split across category-plus-city, problem-based, and comparison or brand queries. Running each prompt three times creates 45–60 observations for one test condition. That is enough to expose obvious response variance without making a manual local-business audit unmanageable.
Should every prompt be run in a Temporary Chat?
Temporary Chat is useful because it keeps the conversation separate from normal history and does not create or use memories, but custom instructions can still apply. The critical requirement is consistency: use the same fresh-chat process throughout, document it in the audit, and avoid carrying context from one prompt into the next.
Does allowing OAI-SearchBot guarantee that ChatGPT will recommend a business?
No. Allowing OAI-SearchBot only removes one potential access barrier for ChatGPT search features. Recommendation visibility can still vary based on the prompt, location, available web sources, business relevance, source quality, and the response generated for that individual run. It is a technical prerequisite check, not a ranking guarantee.
What is a good ChatGPT mention rate for a local business?
There is no universal benchmark because competition, service category, city size, prompt design, and test conditions vary. A better starting point is a baseline: compare category, problem, and brand mention rates; identify gaps; then use the same prompt library over time. Accuracy and cited-source quality should be reviewed alongside mention rate.
Can an agency automate this audit with an API?
Some data collection can be automated, but the output must still preserve test conditions, exact prompts, timestamps, cited sources, and human accuracy review. Automation should not hide variance or turn generative answers into a fictional fixed ranking. For many local clients, a structured spreadsheet plus repeatable desktop audit workflow is sufficient at the baseline stage.
Sources
- https://www.reddit.com/r/SEO/comments/1xvgnhd/simple_method_for_checking_if_chatgpt_recommends/
- https://help.openai.com/en/articles/9237897-searching-the-web-with-chatgpt
- https://developers.openai.com/api/docs/bots
- https://help.openai.com/en/articles/8914046-temporary-chat-in-chatgpt
- https://help.openai.com/en/articles/12677804-what-is-chatgpt-faq
- https://help.openai.com/en/articles/10093903-chatgpt-search-for-enterprise-and-edu