RedPajama V2

Book

An updated version of the RedPajama dataset with 30 trillion tokens and an emphasis on data quality through modular filtering.

Mentioned in 1 video

Videos Mentioning RedPajama V2

Building an open AI company - with Ce and Vipul of Together AI

Building an open AI company - with Ce and Vipul of Together AI

Latent Space

An updated version of the RedPajama dataset with 30 trillion tokens and an emphasis on data quality through modular filtering.