What AI visibility actually measures
Two numbers get reported as though they were the same measurement. One is a statistic over a corpus; the other is one answer at one moment. Confusing them is the fastest way to a confident wrong conclusion.
Chris Good
Founder, Boosh Digital
“Are we showing up in AI answers?” is now a normal question in a marketing meeting. It deserves a better answer than the one most tools give it.
Two different things wearing the same name
A mentions index is a statistic. Across the answers already collected in a market, how often does this domain get mentioned, on which topics, and which domains get cited instead? It is a rate, computed over a corpus, and it is reasonably stable.
A live answer is one response, from one model, at one moment. Ask the same question twice and you will not get the same answer twice. That is not a fault in the model; it is what the model is.
Both are useful. They measure different things, and putting an index count beside a live citation as though they were the same measurement produces a chart that looks authoritative and means nothing.
Why the distinction matters more here than in search
With classic search, a position is a position. Two tools checking the same term on the same day in the same market should broadly agree, and where they disagree you can usually explain it.
With assistants, there is no ranked list to read. There is an answer, and the answer varies by phrasing, by session, by model version, and by whatever the model happened to retrieve. A number derived from that needs its method attached, or it is just a number.
Three habits that keep it honest
Establish coverage first. Which engines were actually checked, and over what? A figure without its denominator is not a figure. If a tool cannot tell you what it counted across, that is the finding.
Keep NULL and zero apart. “No run has measured that” and “we measured it and found nothing” are completely different, and collapsing them into a blank cell loses the more important one.
Label a candidate explanation as a candidate. Why something moved is usually contested. A fluent, confident, wrong explanation is worse than no explanation, because it stops the investigation.
What to report to a client
Not a score. Report:
- Which engines were checked, and when
- How often the domain was mentioned, out of what
- Which domains are being cited in its place
- One or two live answers, quoted and dated, as illustration rather than evidence
That last distinction is the whole thing. Live answers are how you show someone what is happening. The index is how you tell whether it is changing.
For the strategy side of this rather than the measurement side, I have written about how to optimise for AI search and how to optimise for AI recommendation. BooshSEO is the tool that does the counting: its run types explain which question each one actually answers.
Chris Good
Founder, Boosh Digital
Chris builds the Boosh apps and runs the studio they came out of. Everything here is written from doing the work rather than reading about it. The apps exist because the tools he needed either did not exist or wanted a monthly fee for the privilege.
