Anwendungsfall
Customise a model
Adapt a general model to a specific task or style, and keep the cost of doing so proportionate.
Empfohlenen Stack ansehen, mit Begründungen und Alternativen →
Was nötig ist
In der Reihenfolge ihrer Einführung. Jeder Schritt öffnet sich im Wissensgraphen.
-
Family of decoder-only Transformer language models trained with a generative objective.
-
Continue training a pre-trained model on task-specific data to adapt its behaviour.
-
Fine-tuning by training small low-rank adapter matrices instead of all weights.
-
Cached attention keys and values that make generating one token at a time affordable.