Перейти к содержимому
Меню
Русский

ViT

Transformer that treats an image as a sequence of patches.

architecture Мультимодальные Apache-2.0 3 relationships

Обзор

ViT splits an image into fixed-size patches, embeds each as a token, and processes the sequence with an ordinary transformer. It solves the problem that convolutional architectures bake in assumptions about locality that a large enough model does not need. It exists because it showed that the architecture which won in language transfers to vision once there is enough data, which removed the main reason the two fields had different toolkits.

Граф технологий

Как ViT связана с остальным стеком.

Использует и зависит от

Применяется к

Альтернативы

  • CNN architecture

    Альтернатива для ViT · source

Сравнения

Подробные сопоставления с альтернативами выше.