GLUE benchmark
Concept
A benchmark task mentioned in the context of fine-tuning MOE models, illustrating significant overfitting with sparse models compared to dense ones.
Mentioned in 1 video
A benchmark task mentioned in the context of fine-tuning MOE models, illustrating significant overfitting with sparse models compared to dense ones.