Scaling Laws for Neural Language Models
Book
A paper discussed that explores how model performance scales with compute, data, and parameters, and introduces concepts like inverse scaling.
Mentioned in 2 videos
Videos Mentioning Scaling Laws for Neural Language Models
ChatGPT with Rob Miles - Computerphile
Computerphile
A paper discussed that explores how model performance scales with compute, data, and parameters, and introduces concepts like inverse scaling.
How Scaling Laws Will Determine AI's Future | YC Decoded
Y Combinator
An influential paper that revealed the consistent improvement in model performance by scaling parameters, data, and compute.