Chinchilla scaling laws

Study / Research

Scaling laws research that assumed IID data, which Ari Morcos critiques for overlooking data quality's impact.

Mentioned in 2 videos

Videos Mentioning Chinchilla scaling laws

[LLM Paper Club] Llama 3.1 Paper: The Llama Family of Models

[LLM Paper Club] Llama 3.1 Paper: The Llama Family of Models

Latent Space

A set of scaling laws that previously guided model training, contrasted with Meta's new approach in the Llama 3.1 paper.

Better Data is All You Need — Ari Morcos, Datology

Better Data is All You Need — Ari Morcos, Datology

Latent Space

Scaling laws research that assumed IID data, which Ari Morcos critiques for overlooking data quality's impact.