Transformers

Why Transformers over LSTM

• Because LSTM take tokens sequentially, making them slow. Whereas transformers takes in all the tokens together, allowing for faster computation.

The Illustrated Transformer

How Transformers Work: A Detailed Exploration of Transformer ArchitectureDataCamp

Transformer Math 101EleutherAI

Transformer Inference Arithmetic | kipply's blogkipply's blog