推荐技术栈
你在构建什么？Customise a model
每个位置一项技术，并说明推荐理由以及可以改用什么。
Base model
modelFamily of decoder-only Transformer language models trained with a generative objective.
Why 由图谱推导
The agents converse through a model backend, with the hosted models among the supported ones.
Method
techniqueContinue training a pre-trained model on task-specific data to adapt its behaviour.
Efficient alternative
techniqueFine-tuning by training small low-rank adapter matrices instead of all weights.
Serving
techniqueCached attention keys and values that make generating one token at a time affordable.