GRPO
Policy optimisation that scores a group of answers relative to each other.
Überblick
Group Relative Policy Optimization drops the value model that PPO needs by sampling a group of answers to the same question and using their relative scores as the baseline. It solves the problem that critic models are large, expensive and another thing to train. It exists because removing the critic makes reinforcement learning on reasoning tasks practical at scale, which is how it became central to reasoning-model training.
Technologiegraph
Wie GRPO mit dem übrigen Stack zusammenhängt.
Nutzt und hängt ab von
- Reinforcement Learning concept Algorithms GRPO based on Reinforcement Learning High ✓ source