Synthetic Gradients

Torch Tutorial (Alex Wiltschko, Twitter)

Lex Fridman

An approximation of gradients used to speed up training in deep learning by decoupling layers.