SlimPajamas

How to train a Million Context LLM — with Mark Huang of Gradient.ai

Latent Space

A diverse dataset used for the initial continual pre-training phase of Gradient's context extension.