LLM
Large language model: a Transformer trained on text at a scale that yields general capability.
Обзор
A large language model is a Transformer network trained on a very large text corpus to predict the next token. It solves the problem of building one system that can perform many language tasks without task-specific training data. It exists because capability in language tasks turned out to improve predictably with model size, data and compute, which made a single general-purpose text model a better investment than a fleet of narrow ones. Most AI techniques in this graph exist either to adapt an LLM to a domain or to make one cheaper to run.
Граф технологий
Как LLM связана с остальным стеком.
Использует и зависит от
- Tokenization technique Techniques LLM uses Tokenization High ✓ source
- Chatbot application Applications Chatbot based on LLM High ✓ source
- Claude model Models Claude based on LLM Medium ✓ source
- Code Generation application Applications Code Generation based on LLM High ✓ source
- Few-Shot Learning technique Prompting Few-Shot Learning based on LLM High ✓ source
- Gemini model Models Gemini based on LLM Medium ✓ source
- In-Context Learning concept Prompting In-Context Learning based on LLM High ✓ source
- LLaVA model Multimodal LLaVA based on LLM High ✓ source
- Multi-Agent technique AI Agents Multi-Agent based on LLM High ✓ source
- Query Rewriting technique Techniques Query Rewriting based on LLM High ✓ source
- Transformer architecture Algorithms LLM based on Transformer High ✓ source
- Zero-Shot concept Prompting Zero-Shot based on LLM High ✓ source
Используется в
- AI Agent application AI Agents LLM used by AI Agent High ✓ source
- GraphRAG technique Techniques LLM used by GraphRAG High ✓ source
- RAG technique Techniques LLM used by RAG High ✓ source
Применяется к
- Alignment technique Safety & Alignment Alignment used for LLM High ✓ source
- B200 hardware Hardware B200 used for LLM High ✓ source
- Beam Search technique Techniques Beam Search used for LLM High ✓ source
- Distillation technique Techniques Distillation used for LLM Medium ✓ source
- GPQA benchmark Benchmarks GPQA used for LLM High ✓ source
- GSM8K benchmark Benchmarks GSM8K used for LLM High ✓ source
- H100 hardware Hardware H100 used for LLM High ✓ source
- H200 hardware Hardware H200 used for LLM High ✓ source
- HellaSwag benchmark Benchmarks HellaSwag used for LLM High ✓ source
- HumanEval benchmark Benchmarks HumanEval used for LLM High ✓ source
- KV Cache technique Infrastructure KV Cache used for LLM High ✓ source
- LMArena benchmark Benchmarks LMArena used for LLM High ✓ source
- MMLU benchmark Benchmarks MMLU used for LLM High ✓ source
- MT-Bench benchmark Benchmarks MT-Bench used for LLM High ✓ source
- MoE architecture Algorithms MoE used for LLM High ✓ source
- Pretraining technique Techniques Pretraining used for LLM High ✓ source
- Prompt Engineering technique Prompting Prompt Engineering used for LLM High ✓ source
- Quantization technique Techniques Quantization used for LLM High ✓ source
- SQuAD dataset Datasets SQuAD used for LLM High ✓ source
- Softmax concept Algorithms Softmax used for LLM High ✓ source
- TPU hardware Hardware TPU used for LLM High ✓ source
- Temperature technique Techniques Temperature used for LLM High ✓ source
- TensorRT-LLM tool Infrastructure TensorRT-LLM used for LLM Medium ✓ source
- The Pile dataset Datasets The Pile used for LLM High ✓ source
- Tokenizer tool Infrastructure Tokenizer used for LLM High ✓ source
- Top-p Sampling technique Techniques Top-p Sampling used for LLM High ✓ source
- vLLM tool Infrastructure vLLM used for LLM High ✓ source
- Transformer architecture Algorithms Transformer enables LLM High ✓ source
Classification
- Context Window concept Models Context Window part of LLM Medium ✓ source
- Hallucination concept Models Hallucination part of LLM High ✓ source
- Inference concept Infrastructure Inference part of LLM High ✓ source
- Logits concept Models Logits part of LLM High ✓ source
- Token concept Models Token part of LLM High ✓ source
- Tokenizer tool Infrastructure Tokenizer part of LLM High ✓ source