NLP & Transformers
Module 3 · NLP & Transformers · ~35 min

The Transformer

The architecture that changed everything: attention is all you need.

  1. The attention mechanism7 minUp next
  2. Multi-head attention7 min
  3. Positional encoding7 min
  4. Full transformer architecture7 min
  5. Why transformers beat RNNs7 min