f

fill-in-the-middle special tokens (FIM)

Tool / ProductMentioned in 1 video

Special tokens (prefix/middle/suffix) used to encode fill-in-the-middle tasks; briefly mentioned as part of GPT-4 tokenizer special tokens.

Videos Mentioning fill-in-the-middle special tokens (FIM)

Let's build the GPT Tokenizer

Let's build the GPT Tokenizer

Andrej Karpathy

Special tokens (prefix/middle/suffix) used to encode fill-in-the-middle tasks; briefly mentioned as part of GPT-4 tokenizer special tokens.