Warm-up Stable Decay
Concept
A learning rate schedule strategy characterized by a warm-up phase, a long stable phase, and a rapid decay phase, allowing for easier continuation of training runs.
Mentioned in 1 video
A learning rate schedule strategy characterized by a warm-up phase, a long stable phase, and a rapid decay phase, allowing for easier continuation of training runs.
