TruthfulQA
Questions where a plausible-sounding answer is false.
Overview
TruthfulQA poses questions whose common misconceptions make a confident wrong answer more likely than the correct one. It solves the problem that a benchmark measuring knowledge rewards recall of what is written, including what is written falsely. It exists because it measures truthfulness rather than plausibility, which is the failure mode hallucination describes.
Technology Graph
How TruthfulQA connects to the rest of the stack.
Applied to
- Hallucination concept Models TruthfulQA used for Hallucination High ✓ source