跳到正文
菜单
简体中文

CNN vs ViT

Convolutional neural network, sharing weights across positions to exploit spatial structure.

功能对比

这两项技术尚未记录可对比的属性。

该选哪个?

由上述差异按固定规则生成,不是模型生成的。

Choose CNN if…

已记录的属性中,没有任何一项显示它更有优势。

Choose ViT if…

已记录的属性中,没有任何一项显示它更有优势。

关于本页

页面保持可访问,但在积累足够的带来源细节之前不纳入搜索索引(PRD SEO-08)。

CNN

architecture · Algorithms

A convolutional neural network applies the same small filter at every position of an input, so it learns a pattern once and recognises it anywhere. It solves the parameter explosion that a fully connected layer would suffer on an image, where each pixel would need its own weight. It exists because locality and translation invariance are true of images and largely untrue of language, which is why vision and language ended up with different architectures.

ViT

architecture · Multimodal

ViT splits an image into fixed-size patches, embeds each as a token, and processes the sequence with an ordinary transformer. It solves the problem that convolutional architectures bake in assumptions about locality that a large enough model does not need. It exists because it showed that the architecture which won in language transfers to vision once there is enough data, which removed the main reason the two fields had different toolkits.