FP16
Concept
Half-precision floating-point format using 16 bits, discussed for its reduced memory footprint but poor dynamic range, leading to training instability.
Mentioned in 1 video
Half-precision floating-point format using 16 bits, discussed for its reduced memory footprint but poor dynamic range, leading to training instability.
