The question: An AI gave a confident answer with citations. Isn’t that proof?
A confident AI answer can contain false information and fabricated citations.
Fluent wording and a source-shaped citation are not proof. Open the source and check whether it exists and supports the claim.
Show me why
NIST identifies confabulation as a generative-AI risk. A plausible reference may name a nonexistent work, misstate a real source or fail to support the answer. Presentation confidence does not substitute for evidence.
A common misconception
Confidence in wording is different from independently verified accuracy.
Where the limits are
Not every AI answer is false. Error rates vary by system, task and available evidence; this entry assigns no universal percentage. A correct result does not validate every explanation the system gives for it.
How we know
For a practical check, locate the cited publication through its publisher or identifier. Match its title, authors and date; then inspect the actual passage, methods and limits relevant to the claim. A working link proves only that a page exists. Retrieval tools can help ground answers, but the final claim still needs to match the retrieved material.
What would change this conclusion?
New systems may reduce particular error rates. Any stronger reliability claim should be supported by reproducible evaluations of that system and task; documented existing failures would remain historical facts.
Sources you can inspect
- National Institute of Standards and TechnologyArtificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile
Section 2.2 discusses confabulation; the profile recommends verification of generated sources and citations.
July 2024 · Checked in initial research 2026-10-08
Links were located in source research. Some publishers restrict automated access. Source presence is not institutional endorsement. Our citation standard
Revision history
- Source research and scoped explanation prepared with AI assistance. Published under the owner’s explicit instruction to add all ten proposed topics on October 8, 2026.