A framework providing high-level interfaces for training LLMs, customizable with configurations.
Latent Space
![[Paper Club] Upcycling Large Language Models into Mixture of Experts](https://i.ytimg.com/vi/e_mkhFkKPEk/maxresdefault.jpg)