ViT
Transformer that treats an image as a sequence of patches.
Überblick
ViT splits an image into fixed-size patches, embeds each as a token, and processes the sequence with an ordinary transformer. It solves the problem that convolutional architectures bake in assumptions about locality that a large enough model does not need. It exists because it showed that the architecture which won in language transfers to vision once there is enough data, which removed the main reason the two fields had different toolkits.
Technologiegraph
Wie ViT mit dem übrigen Stack zusammenhängt.
Nutzt und hängt ab von
- Transformer architecture Algorithms ViT based on Transformer High ✓ source
Angewendet auf
- Multimodal AI application Multimodal ViT used for Multimodal AI High ✓ source
Alternativen
Vergleiche
Detaillierte Gegenüberstellungen mit den Alternativen oben.