Temperature
Scaling the logits to make sampling more or less random.
Resumen
Temperature divides the logits before the softmax, so a low value sharpens the distribution toward the most likely token and a high value flattens it. It solves the problem that a model's raw distribution is often too peaked for open-ended text and too flat for factual answers. It exists as the simplest control over the trade between coherence and variety.
Grafo de tecnologías
Cómo se conecta Temperature con el resto del stack.