fill-in-the-middle special tokens (FIM)

Software / App

Special tokens (prefix/middle/suffix) used to encode fill-in-the-middle tasks; briefly mentioned as part of GPT-4 tokenizer special tokens.

Mentioned in 1 video

Videos Mentioning fill-in-the-middle special tokens (FIM)

Let's build the GPT Tokenizer

Let's build the GPT Tokenizer

Andrej Karpathy

Special tokens (prefix/middle/suffix) used to encode fill-in-the-middle tasks; briefly mentioned as part of GPT-4 tokenizer special tokens.