Обзор

7 technologies shown

• Transformer architecture Attention-based neural architecture that replaced recurrence with self-attention.
• ViT architecture Transformer that treats an image as a sequence of patches.
• CNN architecture Convolutional neural network, sharing weights across positions to exploit spatial structure.
• MoE architecture Mixture of Experts: route each token to a few expert subnetworks instead of all parameters.
• GAN architecture Generator and discriminator trained against each other to synthesise realistic data.
• RNN architecture Recurrent neural network that carries a hidden state along a sequence.
• LSTM architecture Recurrent network with gating that lets it retain information over longer sequences.