Progressive Distillation

Concept

A distillation technique where a student model is trained by progressively working on problems of approximate constant difficulty, halving the number of steps at each iteration to reach a single-step generation.

Mentioned in 3 videos

Save the 3 videos on Progressive Distillation to your own pod.

Sign up free to keep building your knowledge base on Progressive Distillation as more episodes are added.

Get Started Free