Model Flops Utilization

Concept

A metric used to measure compute utilization, discussed in terms of its limitations and how high MFU is not always the primary goal.

Mentioned in 1 video