BF16
Concept
A 16-bit floating-point format mentioned in comparison to NVIDIA's TF32.
Mentioned in 2 videos
Videos Mentioning BF16
DeepSeek V3, SGLang, and the state of Open Model Inference in 2025 (Quantization, MoEs, Pricing)
Latent Space
A default precision format (Bfloat16) often used for training LLMs, contrasted with FP8 which requires specific kernel implementation for inference.
⚡️Accelerators @ 3x NVIDIA H200 perf, Made in the USA - Thomas Sohmers + Mitesh Agrawal, Positron AI
Latent Space
A 16-bit floating-point format mentioned in comparison to NVIDIA's TF32.