应用场景
Customise a model
Adapt a general model to a specific task or style, and keep the cost of doing so proportionate.
所需技术
按采用的先后顺序排列。每一步都可以在图谱中打开。
-
Family of decoder-only Transformer language models trained with a generative objective.
-
Continue training a pre-trained model on task-specific data to adapt its behaviour.
-
Fine-tuning by training small low-rank adapter matrices instead of all weights.
-
Cached attention keys and values that make generating one token at a time affordable.