King K2

Software / App

A recent optimizer technique being explored, which uses a Newton-Raphson method for stability and better exploration.

Mentioned in 1 video

Videos Mentioning King K2

⚡ Open Model Pretraining Masterclass — Elie Bakouch, HuggingFace SmolLM 3, FineWeb, FinePDF

⚡ Open Model Pretraining Masterclass — Elie Bakouch, HuggingFace SmolLM 3, FineWeb, FinePDF

Latent Space

A recent optimizer technique being explored, which uses a Newton-Raphson method for stability and better exploration.