RedPajama

Software / AppMentioned in 1 video

Mentioned as an example of an available cleaned dataset (RedPajama/slim) suitable for language-model training.

Videos Mentioning RedPajama

Let's reproduce GPT-2 (124M)

Let's reproduce GPT-2 (124M)

Andrej Karpathy

Mentioned as an example of an available cleaned dataset (RedPajama/slim) suitable for language-model training.