TruthfulQA
Questions where a plausible-sounding answer is false.
Resumen
TruthfulQA poses questions whose common misconceptions make a confident wrong answer more likely than the correct one. It solves the problem that a benchmark measuring knowledge rewards recall of what is written, including what is written falsely. It exists because it measures truthfulness rather than plausibility, which is the failure mode hallucination describes.
Grafo de tecnologías
Cómo se conecta TruthfulQA con el resto del stack.
Aplicado a
- Hallucination concept Models TruthfulQA used for Hallucination High ✓ source