OpenAI encoder.py (GPT-2 encoder implementation)

Software / App

The inference implementation released by OpenAI that applies saved merges and vocabulary — the lecture walks through how it performs BPE at inference time.

Mentioned in 1 video

Videos Mentioning OpenAI encoder.py (GPT-2 encoder implementation)

Let's build the GPT Tokenizer

Let's build the GPT Tokenizer

Andrej Karpathy

The inference implementation released by OpenAI that applies saved merges and vocabulary — the lecture walks through how it performs BPE at inference time.