Caso de uso
Customise a model
Adapt a general model to a specific task or style, and keep the cost of doing so proportionate.
Lo que se necesita
En el orden en que las adoptarías. Cada paso se abre en el grafo de conocimiento.
-
Family of decoder-only Transformer language models trained with a generative objective.
-
Continue training a pre-trained model on task-specific data to adapt its behaviour.
-
Fine-tuning by training small low-rank adapter matrices instead of all weights.
-
Cached attention keys and values that make generating one token at a time affordable.