RNN

Overview

A recurrent neural network processes a sequence one step at a time, carrying a hidden state that summarises what it has seen. It solves the problem that a fixed-size input cannot represent a sequence of arbitrary length. It exists because order matters in language and time series. Training it is slow and unstable over long sequences, which is the limitation the Transformer was designed to remove.

Technology Graph

How RNN connects to the rest of the stack.

Alternatives

• Transformer architecture

  An alternative to RNN · source

Comparisons

Side-by-side breakdowns with the alternatives above.

• Transformer vs RNN