Mixtral AX22B
Software / App
A large mixture-of-experts model where parallelism configurations were investigated, using expert, pipeline, and tensor parallelism.
Mentioned in 1 video
A large mixture-of-experts model where parallelism configurations were investigated, using expert, pipeline, and tensor parallelism.
