Unicode

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 1: Overview, Tokenization

Stanford Online

A character encoding standard used for representing text, which tokenizers convert to integer sequences.