F
FP64, FP32, FP16
conceptNumerical precision formats used in AI model training. US models typically use FP16, while Chinese models are pushing to FP8 and FP4.
Mentioned in 1 video
Numerical precision formats used in AI model training. US models typically use FP16, while Chinese models are pushing to FP8 and FP4.
Mentioned in 1 video