Triton Inference Server

Software / App

An inference serving software developed by NVIDIA, which Truss has had to extend and sometimes replace with custom versions for specific performance and reliability needs.

Mentioned in 1 video

Videos Mentioning Triton Inference Server

DeepSeek V3, SGLang, and the state of Open Model Inference in 2025 (Quantization, MoEs, Pricing)

DeepSeek V3, SGLang, and the state of Open Model Inference in 2025 (Quantization, MoEs, Pricing)

Latent Space

An inference serving software developed by NVIDIA, which Truss has had to extend and sometimes replace with custom versions for specific performance and reliability needs.