Transformers, the tech behind LLMs | Deep Learning Chapter 5

Опис:

Breaking down how Large Language Models work, visualizing how data flows through. 0:00 - Predict, sample, repeat; 3:03 - Inside a transformer; 6:36 - Chapter layout; 7:20 - The premise of Deep Learning; 12:27 - Word embeddings; 18:25 - Embeddings beyond words; 20:22 - Unembedding; 22:22 - Softmax with temperature; 26:03 - Up next.