Ir para o conteúdo
Menu
Português

CNN vs ViT

Convolutional neural network, sharing weights across positions to exploit spatial structure.

Comparação de características

Ainda não foram registados atributos comparáveis para estas duas tecnologias.

Qual deve escolher?

Gerado a partir das diferenças acima por regras estruturadas, não por um modelo.

Choose CNN if…

Nenhum dos atributos registados o distingue a seu favor.

Choose ViT if…

Nenhum dos atributos registados o distingue a seu favor.

Sobre esta página

A página permanece acessível mas fica excluída dos índices de busca até conter detalhe suficiente com fontes (PRD SEO-08).

CNN

architecture · Algorithms

A convolutional neural network applies the same small filter at every position of an input, so it learns a pattern once and recognises it anywhere. It solves the parameter explosion that a fully connected layer would suffer on an image, where each pixel would need its own weight. It exists because locality and translation invariance are true of images and largely untrue of language, which is why vision and language ended up with different architectures.

ViT

architecture · Multimodal

ViT splits an image into fixed-size patches, embeds each as a token, and processes the sequence with an ordinary transformer. It solves the problem that convolutional architectures bake in assumptions about locality that a large enough model does not need. It exists because it showed that the architecture which won in language transfers to vision once there is enough data, which removed the main reason the two fields had different toolkits.