Auto-regressive Decoding

ConceptMentioned in 1 video

The process by which language models generate text token by token, where each new token is conditioned on the previously generated ones.