DBRX
Software / App
Databricks' Mixture-of-Experts language model, featuring 132 billion total parameters and 36 billion active parameters on any input, pre-trained on 12 trillion tokens.
Mentioned in 2 videos
Save the 2 videos on DBRX to your own pod.
Sign up free to keep building your knowledge base on DBRX as more episodes are added.
Videos Mentioning DBRX

State of the Art: Training 70B LLMs on 10,000 H100 clusters
Latent Space
Databricks' Mixture-of-Experts language model, featuring 132 billion total parameters and 36 billion active parameters on any input, pre-trained on 12 trillion tokens.

The Agent Cloud: Databricks’ Bet on the Future of AI — Matei Zaharia and Reynold Xin
Latent Space
An open-source large language model released by Databricks, positioned as being above LLaMA 3 scale, with a focus on usefulness and data querying capabilities.