Transformers, the tech behind LLMs | Deep Learning Chapter 5

Transformers, the tech behind LLMs | Deep Learning Chapter 527:15

Download information and video details for Transformers, the tech behind LLMs | Deep Learning Chapter 5

Uploader:

3Blue1Brown

Published at:

4/1/2024

Views:

8.9M

Description:

Breaking down how Large Language Models work, visualizing how data flows through. 0:00 - Predict, sample, repeat; 3:03 - Inside a transformer; 6:36 - Chapter layout; 7:20 - The premise of Deep Learning; 12:27 - Word embeddings; 18:25 - Embeddings beyond words; 20:22 - Unembedding; 22:22 - Softmax with temperature; 26:03 - Up next.