MiniCPM

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 4: Attention Alternatives

Stanford Online

A Chinese model company that performed upcycling experiments, transforming a dense model into an MoE with strong results.