NVFP4

Concept

A quantization format used to optimize models for maximum Blackwell compatibility and throughput.

Mentioned in 1 video

Videos Mentioning NVFP4

The Inference Frontier: 10x Faster Models to Self-Optimizing AI — Philip Kiely & Ali Taha, Baseten

The Inference Frontier: 10x Faster Models to Self-Optimizing AI — Philip Kiely & Ali Taha, Baseten

Latent Space

A quantization format used to optimize models for maximum Blackwell compatibility and throughput.