torch.compile

Software / App

PyTorch compiler used to fuse kernels and reduce Python overhead — large speedups discussed and demonstrated.

Mentioned in 3 videos

Videos Mentioning torch.compile

Let's reproduce GPT-2 (124M)

Let's reproduce GPT-2 (124M)

Andrej Karpathy

PyTorch compiler used to fuse kernels and reduce Python overhead — large speedups discussed and demonstrated.

llm.c's Origin and the Future of LLM Compilers - Andrej Karpathy at CUDA MODE

llm.c's Origin and the Future of LLM Compilers - Andrej Karpathy at CUDA MODE

Latent Space

A feature in PyTorch for compiling models to optimize performance, which Karpathy experienced difficulties with during the development of his YouTube video.

Open Source AI is AI we can Trust — with Soumith Chintala of Meta AI

Open Source AI is AI we can Trust — with Soumith Chintala of Meta AI

Latent Space

A PyTorch feature that could potentially be used to consume Mojo subgraphs, improving interoperability.