LMQ

Software / App

A combined dataset (concatenation of SHQ and LDQ) used to study the impact of high-quality data in pre-training.

Mentioned in 1 video

Videos Mentioning LMQ

Stanford CS25: Transformers United V6 I From Next-Token Prediction to Next-Generation Intelligence

Stanford CS25: Transformers United V6 I From Next-Token Prediction to Next-Generation Intelligence

Stanford Online

A combined dataset (concatenation of SHQ and LDQ) used to study the impact of high-quality data in pre-training.