r/SnoikaLounge • u/Darblee • 19h ago
GEO/AEO Tips The most expensive AI hallucination might be just two words: "doesn't support"
Imagine you're selling B2B software.
Your product supports SSO, has a SOC 2 Type II report available under NDA, and integrates with Salesforce.
Pretty normal enterprise stuff.
Now imagine someone asks an AI assistant:
“Find me 5 tools in this category that support SSO, have SOC 2 Type II, and integrate with Salesforce.”
Your company doesn't make the shortlist.
Not because it lacks those things. But because the AI couldn't find enough public evidence to verify them.
Here's the imaginary incident report:
CUSTOMER REQUIREMENT: SOC 2 Type II
ACTUAL PRODUCT: Compliant, report available on request
PUBLIC WEBSITE: "Contact our sales team for security documentation"
AI'S POSSIBLE CONCLUSION: Unable to verify compliance
WORST-CASE AI RESPONSE: "This vendor doesn't meet your security requirements."
See the problem?
Not publicly documented and not supported are two completely different things.
One means there isn't enough evidence. The other is a claim about the product itself.
And in a recommendation system, that tiny difference can decide whether a company makes the shortlist at all.
This is a hypothetical scenario, not a documented incident. But I think it's a failure mode worth actively testing.
It also raises a pretty interesting question about GEO.
Everyone's trying to get their brand mentioned more frequently. But perhaps there's another metric worth tracking:
False Exclusion Rate.
How often does an AI assistant exclude a qualified company because it couldn't verify something that the company actually offers?
You could test it by taking 20 real buyer requirements, checking them against verified product documentation, and comparing the results with the model's recommendations.
Three outcomes would matter:
- Correct exclusion: the company genuinely doesn't meet the requirement.
- Uncertain exclusion: the model can't verify the requirement.
- False exclusion: the company meets it, but the model incorrectly says otherwise.
That last category is potentially expensive.
And there's an uncomfortable consequence for businesses: sometimes the problem isn't that you need more content. It's that your most commercially important facts are effectively invisible to anyone who hasn't spoken to sales.
I'd love to see AI search tools become better at distinguishing "I couldn't verify this" from "this isn't supported."
Because if I were buying enterprise software, I'd definitely want to know the difference.
Would you trust an AI-generated vendor shortlist if it didn't explain why certain companies were excluded?