45 billion parameter number

Concept

The number derived from LLaMA 3's compute budget and benchmark scaling laws. Note: This seems to be a typo in the transcript, it should likely refer to the 405B model.

Mentioned in 1 video

Videos Mentioning 45 billion parameter number

Llama 405b: Full 92 page Analysis, and Uncontaminated SIMPLE Benchmark Results

Llama 405b: Full 92 page Analysis, and Uncontaminated SIMPLE Benchmark Results

AI Explained

The number derived from LLaMA 3's compute budget and benchmark scaling laws. Note: This seems to be a typo in the transcript, it should likely refer to the 405B model.