Disaggregated Inference

Concept

NVIDIA's fundamental technology for its AI factory, involving breaking down the inference pipeline to run on different GPUs for efficiency.

Mentioned in 1 video

Videos Mentioning Disaggregated Inference

Jensen Huang: Nvidia's Future, Physical AI, Rise of the Agent, Inference Explosion, AI PR Crisis

Jensen Huang: Nvidia's Future, Physical AI, Rise of the Agent, Inference Explosion, AI PR Crisis

All-In Podcast

NVIDIA's fundamental technology for its AI factory, involving breaking down the inference pipeline to run on different GPUs for efficiency.