Llama Chat

[Paper Club] Upcycling Large Language Models into Mixture of Experts

Latent Space

A variant of Llama mentioned in comparison to Llama base regarding cosine similarity.