Scaling Law
Concept
An empirical law observed in AI development stating that increasing data, model size, and compute leads to more capable models, a principle that drove early AI excitement but later faltered for pre-training.
Mentioned in 1 video
An empirical law observed in AI development stating that increasing data, model size, and compute leads to more capable models, a principle that drove early AI excitement but later faltered for pre-training.
