Обзор

5 technologies shown

• Self-RAG technique Model decides for itself when to retrieve and critiques what it retrieved.
• Diffusion technique Generates data by learning to reverse a gradual noising process.
• Distillation technique Training a small model to reproduce the behaviour of a larger one.
• LoRA technique Fine-tuning by training small low-rank adapter matrices instead of all weights.
• Tokenization technique Splitting text into the subword units a language model actually reads.