Q

Qwen 3

Software / AppMentioned in 1 video

An MoE model that was initially slower to train than Mixtral without optimizations, but became feasible with new kernel and optimizations.

Videos Mentioning Qwen 3

⚡ Open Model Pretraining Masterclass — Elie Bakouch, HuggingFace SmolLM 3, FineWeb, FinePDF

⚡ Open Model Pretraining Masterclass — Elie Bakouch, HuggingFace SmolLM 3, FineWeb, FinePDF

Latent Space

An MoE model that was initially slower to train than Mixtral without optimizations, but became feasible with new kernel and optimizations.