Shampoo

Multi-GPU Kernels, Intelligence per Watt, Heterogeneous Inference, and More | YC Paper Club

Y Combinator

An optimizer that relies on QR factorization, mentioned as a reason for slow deployment due to performance limitations in PyTorch.