HBM
Product
A type of high-performance RAM typically found on GPUs, characterized by large capacity but slower access speeds compared to on-chip memory.
Mentioned in 3 videos
Save the 3 videos on HBM to your own pod.
Sign up free to keep building your knowledge base on HBM as more episodes are added.
Videos Mentioning HBM

FlashAttention-2: Making Transformers 800% faster AND exact
Latent Space
A type of high-performance RAM typically found on GPUs, characterized by large capacity but slower access speeds compared to on-chip memory.

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 5: GPUs, TPUs
Stanford Online
High Bandwidth Memory, a type of global memory on GPUs.

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 6: Kernels, Triton, XLA
Stanford Online
High-Bandwidth Memory, a key component of GPU architecture, contrasted with faster local memory like registers and L1 cache.