Common Pile

Software / App

A project that aimed to create a model using only permissively licensed data, scouring the internet for sources like Stack V2, government proceedings, and wikis, resulting in 8TB of data.

Mentioned in 1 video

Videos Mentioning Common Pile

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 13: Data (Sources, Datasets)

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 13: Data (Sources, Datasets)

Stanford Online

A project that aimed to create a model using only permissively licensed data, scouring the internet for sources like Stack V2, government proceedings, and wikis, resulting in 8TB of data.