Let's build GPT: from scratch, in code
Andrej Karpathy builds a small GPT model, making the architecture concrete.
Andrej Karpathy
2 saved items
Visit source Let's build the GPT tokenizer
A companion deep dive into the tokenisation layer beneath language models.