SlimPajamas

BookMentioned in 1 video

A diverse dataset used for the initial continual pre-training phase of Gradient's context extension.

Videos Mentioning SlimPajamas

How to train a Million Context LLM — with Mark Huang of Gradient.ai

How to train a Million Context LLM — with Mark Huang of Gradient.ai

Latent Space

A diverse dataset used for the initial continual pre-training phase of Gradient's context extension.