S
SPMD
ConceptMentioned in 1 video
Single Program Multiple Data, a paradigm used by Jax for distributed training, allowing users to work with many accelerators as if they were one large computer.
Single Program Multiple Data, a paradigm used by Jax for distributed training, allowing users to work with many accelerators as if they were one large computer.