GLUE benchmark

Concept

A benchmark task mentioned in the context of fine-tuning MOE models, illustrating significant overfitting with sparse models compared to dense ones.

Mentioned in 1 video