Paged Optimizer

Concept

An optimization technique used during training to prevent out-of-memory errors, discussed in the Q-LoRA paper.

Mentioned in 1 video