Data Parallelism
Concept
A distributed training technique where the model is replicated across multiple devices, and data is split.
Mentioned in 1 video
A distributed training technique where the model is replicated across multiple devices, and data is split.