Beyond Neural Scaling Laws

Study / Research

A foundational paper for Datlogy that demonstrated how data quality can bend scaling laws, showing a duality between power-law scaling and marginal information gain decay.

Mentioned in 1 video

Videos Mentioning Beyond Neural Scaling Laws

Better Data is All You Need — Ari Morcos, Datology

Better Data is All You Need — Ari Morcos, Datology

Latent Space

A foundational paper for Datlogy that demonstrated how data quality can bend scaling laws, showing a duality between power-law scaling and marginal information gain decay.