Checkpointing

Torch Tutorial (Alex Wiltschko, Twitter)

Lex Fridman

A technique in automatic differentiation where intermediate computations are selectively recomputed rather than stored to save memory.