LEVEL 01 · LESSON 07
Hallucinations
Treat fluency as presentation quality, not evidence of truth.
What it is
A hallucination is an output that is fabricated, unsupported, or inconsistent with the relevant evidence. It can sound just as confident as a correct answer.
Why it matters
Fluent language makes errors easy to trust. A made-up feature, policy exception, or reference can undermine an otherwise useful business process.
A business example
A sales assistant claims a product supports a requested integration because similar products do. A representative forwards the answer, creating a commitment the company cannot meet.
How it actually works
Language generation optimizes for patterns learned during training and shaped by the current request; it is not inherently a fact-checking procedure. Supply relevant evidence, ask for traceable support, verify important claims, and allow the system to abstain. Retrieval can reduce unsupported answers but can also supply irrelevant or stale information. Measure whether the final claims are supported, not just whether the answer contains a citation.
A common misconception
A confident tone, a low temperature, or a plausible citation is not proof. A citation may exist while failing to support the specific claim.
ONE SENTENCE TO REMEMBER
Treat fluency as presentation quality, not evidence of truth.
CHECK YOUR UNDERSTANDING
An AI answer about your returns policy is confidently worded and cites your policy page. What should you check before relying on it?
Show the answer
Answer: C.
A citation can exist while failing to support the specific claim, and confident language is presentation, not evidence. A low temperature does not prevent fabrication either. Verify that important claims are supported by the source.
Take it into your next meeting
What evidence would a reviewer need before acting on an answer?
One more concept, understood.
Mark this lesson complete to keep your place.