RNN
Recurrent neural network that carries a hidden state along a sequence.
Visão geral
A recurrent neural network processes a sequence one step at a time, carrying a hidden state that summarises what it has seen. It solves the problem that a fixed-size input cannot represent a sequence of arbitrary length. It exists because order matters in language and time series. Training it is slow and unstable over long sequences, which is the limitation the Transformer was designed to remove.
Grafo de tecnologias
Como RNN se liga ao resto do stack.
Usa e depende de
- Neural Network concept Algorithms RNN based on Neural Network High ✓ source
Evolution
- LSTM architecture Algorithms LSTM extends RNN High ✓ source
Alternativas
-
Transformer
architecture
Uma alternativa a RNN · source
Comparações
Comparações detalhadas com as alternativas acima.