3B

Concept

Refers to a model size of 3 billion parameters, used as an example when discussing teacher-student model capabilities in distillation.

Mentioned in 1 video