Рекомендуемый стек
Что вы создаёте? Customise a model
Одна технология на позицию, с обоснованием и тем, чем её можно заменить.
Base model
modelFamily of decoder-only Transformer language models trained with a generative objective.
Why выведено из графа
The agents converse through a model backend, with the hosted models among the supported ones.
Альтернативы
Method
techniqueContinue training a pre-trained model on task-specific data to adapt its behaviour.
Альтернативы
Efficient alternative
techniqueFine-tuning by training small low-rank adapter matrices instead of all weights.
Why выведено из графа
QLoRA adds 4-bit quantisation of the frozen base model on top of LoRA adapters.
Serving
techniqueCached attention keys and values that make generating one token at a time affordable.
Why выведено из графа
Reusing a shared prefix means reusing the cached keys and values for it.