Symbolic Differentiation

Torch Tutorial (Alex Wiltschko, Twitter)

Lex Fridman

A method of calculating derivatives by manipulating mathematical expressions, which can lead to very complex and unwieldy expressions for neural networks.