benchmark scaling laws

Concept

A key innovation in the LLaMA 3 paper, allowing prediction of downstream task performance based on compute budget and training flops.

Mentioned in 1 video

Videos Mentioning benchmark scaling laws

Llama 405b: Full 92 page Analysis, and Uncontaminated SIMPLE Benchmark Results

Llama 405b: Full 92 page Analysis, and Uncontaminated SIMPLE Benchmark Results

AI Explained

A key innovation in the LLaMA 3 paper, allowing prediction of downstream task performance based on compute budget and training flops.