torch.compile
Software / App
PyTorch compiler used to fuse kernels and reduce Python overhead — large speedups discussed and demonstrated.
Mentioned in 4 videos
Save the 4 videos on torch.compile to your own pod.
Sign up free to keep building your knowledge base on torch.compile as more episodes are added.
Videos Mentioning torch.compile
Let's reproduce GPT-2 (124M)
Andrej Karpathy
PyTorch compiler used to fuse kernels and reduce Python overhead — large speedups discussed and demonstrated.
llm.c's Origin and the Future of LLM Compilers - Andrej Karpathy at CUDA MODE
Latent Space
A feature in PyTorch for compiling models to optimize performance, which Karpathy experienced difficulties with during the development of his YouTube video.
Open Source AI is AI we can Trust — with Soumith Chintala of Meta AI
Latent Space
A PyTorch feature that could potentially be used to consume Mojo subgraphs, improving interoperability.
Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 6: Kernels, Triton, XLA
Stanford Online
A PyTorch function used to compile naive implementations into more efficient kernels, often generating Triton code.