Qwen 1.5

Software / App

A model resulting from upcycling a smaller Qwen model into a larger MoE, showcasing successful scale-up.

Mentioned in 1 video

Videos Mentioning Qwen 1.5

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 4: Attention Alternatives

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 4: Attention Alternatives

Stanford Online

A model resulting from upcycling a smaller Qwen model into a larger MoE, showcasing successful scale-up.