Ultra-scale Playbook

Stanford CS25: Transformers United V6 I The Ultra-Scale Talk: Scaling Training to Thousands of GPUs

Stanford Online

A book published by HuggingFace that inspired the talk, covering ultra-scale training.