Jamba
Software / App
A hybrid Mixture-of-Experts (MoE) model trained by AI2, identified as a state-of-the-art non-Transformer architecture.
Mentioned in 2 videos
Save the 2 videos on Jamba to your own pod.
Sign up free to keep building your knowledge base on Jamba as more episodes are added.
Videos Mentioning Jamba
![2024 in Post-Transformer Architectures: State Space Models, RWKV [Latent Space LIVE! @ NeurIPS 2024]](https://i.ytimg.com/vi/LPe6iC73lrc/maxresdefault.jpg)
2024 in Post-Transformer Architectures: State Space Models, RWKV [Latent Space LIVE! @ NeurIPS 2024]
Latent Space
A hybrid Mixture-of-Experts (MoE) model trained by AI2, identified as a state-of-the-art non-Transformer architecture.
The Inference Frontier: 10x Faster Models to Self-Optimizing AI — Philip Kiely & Ali Taha, Baseten
Latent Space
A model from AI21 that specifically designs its architecture dimensions for a target hardware to maximize saturation.