Sparse Expert Models in Deep Learning
Book
A survey paper from Google that explains the differences between dense and sparse models, linked within the Mixtral paper.
Mentioned in 1 video
A survey paper from Google that explains the differences between dense and sparse models, linked within the Mixtral paper.
