Attention technology graph
How Attention connects to the rest of the AI stack. Click a node to move through the graph, or open the technology page for detail.
Zoom
·
Relationship types
- technical
- alternative
- integration
- evolution
- application
- classification
Loading the interactive graph…
All relationships
Uses and depends on
- Transformer architecture Algorithms Transformer based on Attention High ✓ source
Used by
- Image Generation application Applications Attention used by Image Generation High ✓ source
- LLaVA model Multimodal Attention used by LLaVA High ✓ source
- Multimodal AI application Multimodal Attention used by Multimodal AI High ✓ source
- Speech Recognition application Applications Attention used by Speech Recognition High ✓ source
Provided by
- FlashAttention technique Techniques Attention implemented by FlashAttention High ✓ source
Applied to
- Softmax concept Algorithms Softmax used for Attention High ✓ source