cuBLAS

Why Inference Matters 12x More Than Training | YC Paper Club

Y Combinator

NVIDIA's matrix multiplication library, used as an example of a host-level operation that can be invoked from the CPU.