NVIDIA H100

Deep Dive into LLMs like ChatGPT

Andrej Karpathy

High-performance GPU hardware used to train large language models; discussed price and cluster use.

[Paper Club] Weight Streaming on Wafer-Scale Clusters (w/ Sarah Chieng of Cerebras)

Latent Space

A high-performance GPU compared to Cerebras' Wafer Scale Engine, noted to have significantly fewer transistors and significant memory bandwidth bottlenecks.

The State of Silicon and the GPU Poors - with Dylan Patel of SemiAnalysis

Latent Space

NVIDIA's flagship GPU, serving as a benchmark for performance and cost.

H-1B Shakeup, Kimmel Apology, Autism Causes, California Hate Speech Law

All-In Podcast