O

OpenAI encoder.py (GPT-2 encoder implementation)

Tool / ProductMentioned in 1 video

The inference implementation released by OpenAI that applies saved merges and vocabulary — the lecture walks through how it performs BPE at inference time.

Videos Mentioning OpenAI encoder.py (GPT-2 encoder implementation)

Let's build the GPT Tokenizer

Let's build the GPT Tokenizer

Andrej Karpathy

The inference implementation released by OpenAI that applies saved merges and vocabulary — the lecture walks through how it performs BPE at inference time.