Reduce

Concept

A collective communication operation that applies an associative and commutative operation (like sum, max, min) to data across ranks, with the result on one rank.

Mentioned in 1 video