Super-Convergence
Concept
A technique discovered by Leslie Smith that allows certain neural networks to be trained 10 times faster with a 10 times higher learning rate and better accuracy, but was initially rejected by academic publishers.
Mentioned in 1 video
