Mini CPM

Book

A high-performance small language model from the Chinese open-source community, used as a case study for scaling laws and special initializations like MUP.

Mentioned in 1 video

Videos Mentioning Mini CPM

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 11: Scaling Laws

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 11: Scaling Laws

Stanford Online

A high-performance small language model from the Chinese open-source community, used as a case study for scaling laws and special initializations like MUP.