CARBS

Software / App

A hyperparameter optimizer that models the cost of different configurations, enabling efficient identification of scaling laws for model parameters and data mix.

Mentioned in 1 video

Videos Mentioning CARBS

State of the Art: Training 70B LLMs on 10,000 H100 clusters

State of the Art: Training 70B LLMs on 10,000 H100 clusters

Latent Space

A hyperparameter optimizer that models the cost of different configurations, enabling efficient identification of scaling laws for model parameters and data mix.