DataPro

Software / App

A Hugging Face library for data filtering and tokenization at scale, considered underrated and used for FineWeb and FinePDF.

Mentioned in 1 video

Videos Mentioning DataPro

⚡ Open Model Pretraining Masterclass — Elie Bakouch, HuggingFace SmolLM 3, FineWeb, FinePDF

⚡ Open Model Pretraining Masterclass — Elie Bakouch, HuggingFace SmolLM 3, FineWeb, FinePDF

Latent Space

A Hugging Face library for data filtering and tokenization at scale, considered underrated and used for FineWeb and FinePDF.