Nemo

[Paper Club] Upcycling Large Language Models into Mixture of Experts

Latent Space

A framework providing high-level interfaces for training LLMs, customizable with configurations.