RNN

Обзор

A recurrent neural network processes a sequence one step at a time, carrying a hidden state that summarises what it has seen. It solves the problem that a fixed-size input cannot represent a sequence of arbitrary length. It exists because order matters in language and time series. Training it is slow and unstable over long sequences, which is the limitation the Transformer was designed to remove.

Граф технологий

Как RNN связана с остальным стеком.

Альтернативы

• Transformer architecture

  Альтернатива для RNN · source

Сравнения

Подробные сопоставления с альтернативами выше.

• Transformer vs RNN