Torus

Concept

A network topology used in Google's TPU infrastructure, particularly for ML training with all-reduce collectives, offering reliability and efficient data dissemination.

Mentioned in 1 video

Videos Mentioning Torus

Stanford CS153 Frontier Systems | The Discipline of Delivering Value per Gigawatt

Stanford CS153 Frontier Systems | The Discipline of Delivering Value per Gigawatt

Stanford Online

A network topology used in Google's TPU infrastructure, particularly for ML training with all-reduce collectives, offering reliability and efficient data dissemination.