RLAIF
Reinforcement learning from AI feedback instead of human feedback.
Aperçu
RLAIF replaces the human labellers in RLHF with a model that judges outputs against given criteria. It solves the bottleneck that human preference data is slow and expensive to collect at the scale alignment training needs. It exists because the judge can be given explicit principles and applied consistently, and the open question it leaves is whether a model's judgement is a good enough substitute for a person's.
Graphe des technologies
Comment RLAIF se rattache au reste de la pile.
Utilise et dépend de
- LLM-as-a-Judge technique Evaluation RLAIF uses LLM-as-a-Judge High ✓ source
- RLHF technique Techniques RLAIF based on RLHF High ✓ source
Appliqué à
- Alignment technique Safety & Alignment RLAIF used for Alignment High ✓ source