NVIDIA H100
Product
High-performance GPU hardware used to train large language models; discussed price and cluster use.
Mentioned in 5 videos
Save the 5 videos on NVIDIA H100 to your own pod.
Sign up free to keep building your knowledge base on NVIDIA H100 as more episodes are added.
Videos Mentioning NVIDIA H100

Deep Dive into LLMs like ChatGPT
Andrej Karpathy
High-performance GPU hardware used to train large language models; discussed price and cluster use.
![[Paper Club] Weight Streaming on Wafer-Scale Clusters (w/ Sarah Chieng of Cerebras)](https://i.ytimg.com/vi/eNKe04apEaE/maxresdefault.jpg)
[Paper Club] Weight Streaming on Wafer-Scale Clusters (w/ Sarah Chieng of Cerebras)
Latent Space
A high-performance GPU compared to Cerebras' Wafer Scale Engine, noted to have significantly fewer transistors and significant memory bandwidth bottlenecks.

The State of Silicon and the GPU Poors - with Dylan Patel of SemiAnalysis
Latent Space
NVIDIA's flagship GPU, serving as a benchmark for performance and cost.

H-1B Shakeup, Kimmel Apology, Autism Causes, California Hate Speech Law
All-In Podcast

Stanford CS153 Frontier Systems | Amit Jain from Luma AI on Unified Intelligence Systems
Stanford Online
GPUs currently used by Luma for training their models.