I have been looking at AI tools for ecommerce lately, and it feels like every vendor now claims their product id hallucination free.
That sounds great, but isn't hallucination kind of a built in limitation of LLMs? They generate the most likely next token they don't actually know whether something is true.
So I am curious what these companies really mean when they make the claim. And they relying on retrieval from a product catalog, adding strict guardrails, or just refusing to answer when the model isn't confident? or is it mostly marketing for technology that's still capable of getting things wrong?
For anyone who's actually deployed these at scale, how reliable are they in practice? Do they genuinely avoid making things up, or is it more about reducing the number of bad answers rather than eliminating them entirely?