RNN
Recurrent neural network that carries a hidden state along a sequence.
Resumen
A recurrent neural network processes a sequence one step at a time, carrying a hidden state that summarises what it has seen. It solves the problem that a fixed-size input cannot represent a sequence of arbitrary length. It exists because order matters in language and time series. Training it is slow and unstable over long sequences, which is the limitation the Transformer was designed to remove.
Grafo de tecnologías
Cómo se conecta RNN con el resto del stack.
Usa y depende de
- Neural Network concept Algorithms RNN based on Neural Network High ✓ source
Evolution
- LSTM architecture Algorithms LSTM extends RNN High ✓ source
Alternativas
-
Transformer
architecture
Una alternativa a RNN · source
Comparativas
Comparativas detalladas con las alternativas anteriores.