S

SPMD

ConceptMentioned in 1 video

Single Program Multiple Data, a paradigm used by Jax for distributed training, allowing users to work with many accelerators as if they were one large computer.