CPU DRAM

Product

Used for storing KV cache when GPU memory runs out, crucial for large-scale inference systems.

Mentioned in 1 video

Videos Mentioning CPU DRAM

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Guest Lecture: Dan Fu

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Guest Lecture: Dan Fu

Stanford Online

Used for storing KV cache when GPU memory runs out, crucial for large-scale inference systems.