nanoGPT

Let's reproduce GPT-2 (124M)

Andrej Karpathy

Reference minimal GPT implementation (the video builds toward a similar minimal implementation).

Andrej Karpathy: Software Is Changing (Again)

Y Combinator

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 1: Overview, Tokenization

Stanford Online

A project whose speedruns are compared to the leaderboard challenge in Assignment 1.