CPU offloading

Concept

A memory optimization technique where activations are moved from GPU to CPU memory to free up GPU VRAM.

Mentioned in 1 video

Videos Mentioning CPU offloading

Stanford CS25: Transformers United V6 I The Ultra-Scale Talk: Scaling Training to Thousands of GPUs

Stanford CS25: Transformers United V6 I The Ultra-Scale Talk: Scaling Training to Thousands of GPUs

Stanford Online

A memory optimization technique where activations are moved from GPU to CPU memory to free up GPU VRAM.