Nickel

Multi-GPU Kernels, Intelligence per Watt, Heterogeneous Inference, and More | YC Paper Club

Y Combinator

A library for collective communication operations, mentioned as an off-the-shelf option with coarse-grained primitives.