Data Parallelism

Concept

A distributed training technique where the model is replicated across multiple devices, and data is split.

Mentioned in 1 video