Reduce
Concept
A collective communication operation that applies an associative and commutative operation (like sum, max, min) to data across ranks, with the result on one rank.
Mentioned in 1 video
A collective communication operation that applies an associative and commutative operation (like sum, max, min) to data across ranks, with the result on one rank.