Zum Inhalt springen
Menü
Deutsch

CNN vs ViT

Convolutional neural network, sharing weights across positions to exploit spatial structure.

Merkmalsvergleich

Für diese beiden Technologien sind noch keine vergleichbaren Merkmale erfasst.

Welche sollten Sie wählen?

Aus den Unterschieden oben durch feste Regeln erzeugt, nicht von einem Modell.

Choose CNN if…

Keines der erfassten Merkmale zeichnet es zu Ihren Gunsten aus.

Choose ViT if…

Keines der erfassten Merkmale zeichnet es zu Ihren Gunsten aus.

Über diese Seite

Die Seite bleibt erreichbar, wird aber aus den Suchindizes ausgeschlossen, bis sie genug belegte Details enthält (PRD SEO-08).

CNN

architecture · Algorithms

A convolutional neural network applies the same small filter at every position of an input, so it learns a pattern once and recognises it anywhere. It solves the parameter explosion that a fully connected layer would suffer on an image, where each pixel would need its own weight. It exists because locality and translation invariance are true of images and largely untrue of language, which is why vision and language ended up with different architectures.

ViT

architecture · Multimodal

ViT splits an image into fixed-size patches, embeds each as a token, and processes the sequence with an ordinary transformer. It solves the problem that convolutional architectures bake in assumptions about locality that a large enough model does not need. It exists because it showed that the architecture which won in language transfers to vision once there is enough data, which removed the main reason the two fields had different toolkits.