CARBS

Software / AppMentioned in 1 video

A hyperparameter optimizer that models the cost of different configurations, enabling efficient identification of scaling laws for model parameters and data mix.

Videos Mentioning CARBS

State of the Art: Training 70B LLMs on 10,000 H100 clusters

State of the Art: Training 70B LLMs on 10,000 H100 clusters

Latent Space

A hyperparameter optimizer that models the cost of different configurations, enabling efficient identification of scaling laws for model parameters and data mix.