TruthfulQA
Questions where a plausible-sounding answer is false.
Aperçu
TruthfulQA poses questions whose common misconceptions make a confident wrong answer more likely than the correct one. It solves the problem that a benchmark measuring knowledge rewards recall of what is written, including what is written falsely. It exists because it measures truthfulness rather than plausibility, which is the failure mode hallucination describes.
Graphe des technologies
Comment TruthfulQA se rattache au reste de la pile.
Appliqué à
- Hallucination concept Models TruthfulQA used for Hallucination High ✓ source