strong to weak distillation

OpenAI vs. Deepseek vs. Qwen: Comparing Open Source LLM Architectures

Y Combinator

A technique used by Qwen's developers for training smaller models from larger ones.