Ensembling

Concept

A technique that combines multiple models to improve performance and data efficiency, shown to be effective in modern pre-training.

Mentioned in 1 video