XLA
The compiler layer below Jax that optimizes Jax code into machine code for accelerators like GPUs and TPUs, handling automatic distribution and communication primitives.
Save the 4 videos on XLA to your own pod.
Sign up free to keep building your knowledge base on XLA as more episodes are added.
Videos Mentioning XLA
Ep 18: Petaflops to the People — with George Hotz of tinycorp
Latent Space
XLA is mentioned as a complex instruction system, contrasted with tiny grad's restricted instruction system.
Chris Lattner: Compilers, LLVM, Swift, TPU, and ML Accelerators | Lex Fridman Podcast #21
Lex Fridman
Google's compiler system for TensorFlow, one of the hardware-specific compilers that MLIR aims to integrate.
AI Dev 25 x NYC | Robert Crowe: JAX Made Simple: An Intuitive Guide to Building Fast Neural Networks
DeepLearningAI
The compiler layer below Jax that optimizes Jax code into machine code for accelerators like GPUs and TPUs, handling automatic distribution and communication primitives.
Why Inference Matters 12x More Than Training | YC Paper Club
Y Combinator
A component primarily developed by Red Hat Arc, responsible for deployments and the ideal backend for Miles RL training.