SPMD

Concept

Single Program Multiple Data, a paradigm used by Jax for distributed training, allowing users to work with many accelerators as if they were one large computer.

Mentioned in 1 video

Videos Mentioning SPMD

AI Dev 25 x NYC | Robert Crowe: JAX Made Simple: An Intuitive Guide to Building Fast Neural Networks

AI Dev 25 x NYC | Robert Crowe: JAX Made Simple: An Intuitive Guide to Building Fast Neural Networks

DeepLearningAI

Single Program Multiple Data, a paradigm used by Jax for distributed training, allowing users to work with many accelerators as if they were one large computer.