25. Transformers

25.1. Pre-Reading

• YouTube Transformers, explained: Understand the model behind GPT, BERT, and T5

25.1.1. Objectives

• Gain a basic understanding of attention, self-attention, and transformers.