Broadcast

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 7: Parallelism

Stanford Online

A collective communication operation where one rank sends its data to all other ranks.