RefinedWeb

Software / App

A dataset created by asserting that web data alone is sufficient for training. Its loosely filtered version was used as negative examples in DCLAM.

Mentioned in 1 video

Videos Mentioning RefinedWeb

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 13: Data (Sources, Datasets)

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 13: Data (Sources, Datasets)

Stanford Online

A dataset created by asserting that web data alone is sufficient for training. Its loosely filtered version was used as negative examples in DCLAM.