Sparse Expert Models in Deep Learning

Book

A survey paper from Google that explains the differences between dense and sparse models, linked within the Mixtral paper.

Mentioned in 1 video