Transformer technology graph
Como Transformer se liga ao resto do stack de IA. Clique num nó para percorrer o grafo, ou abra a página da tecnologia para ver o detalhe.
Zoom
·
Tipos de relação
- technical
- alternative
- integration
- evolution
- application
- classification
A carregar o grafo interativo…
Todas as relações
Usa e depende de
- Attention concept Algorithms Transformer based on Attention High ✓ source
- BERT model Models BERT based on Transformer High ✓ source
- CLIP model Multimodal CLIP based on Transformer High ✓ source
- DeepSeek model Models DeepSeek based on Transformer High ✓ source
- GPT model Models GPT based on Transformer High ✓ source
- Gemma model Models Gemma based on Transformer High ✓ source
- LLM concept Models LLM based on Transformer High ✓ source
- Llama model Models Llama based on Transformer High ✓ source
- Mistral model Models Mistral based on Transformer High ✓ source
- Multimodal AI application Multimodal Multimodal AI based on Transformer High ✓ source
- Phi model Models Phi based on Transformer High ✓ source
- Pretraining technique Techniques Pretraining based on Transformer High ✓ source
- Qwen model Models Qwen based on Transformer High ✓ source
- Scaling Laws concept Algorithms Scaling Laws based on Transformer High ✓ source
- Speech Recognition application Applications Speech Recognition based on Transformer High ✓ source
- ViT architecture Multimodal ViT based on Transformer High ✓ source
- Whisper model Multimodal Whisper based on Transformer High ✓ source
Usado por
- BERT model Models Transformer used by BERT High ✓ source
- GPT model Models Transformer used by GPT High ✓ source
- Hugging Face Transformers library LLM Frameworks Transformer used by Hugging Face Transformers High ✓ source
Aplicado a
- Layer Normalization concept Algorithms Layer Normalization used for Transformer High ✓ source
- RoPE technique Techniques RoPE used for Transformer High ✓ source
- LLM concept Models Transformer enables LLM High ✓ source
Alternatives
- LSTM architecture Algorithms Transformer alternative to LSTM High ✓ source
- RNN architecture Algorithms Transformer alternative to RNN High ✓ source
Classification
- Feed-Forward Network concept Algorithms Feed-Forward Network part of Transformer High ✓ source
- Multi-Head Attention concept Algorithms Multi-Head Attention part of Transformer High ✓ source
- Positional Encoding concept Algorithms Positional Encoding part of Transformer High ✓ source
- Residual Connection concept Algorithms Residual Connection part of Transformer High ✓ source
- Self-Attention concept Algorithms Self-Attention part of Transformer High ✓ source