MassiveWeb

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 13: Data (Sources, Datasets)

Stanford Online

A dataset created by DeepMind, trained on C4, books, news, GitHub, and Wikipedia, with undisclosed data sources for some components.