Auto-regressive Decoding
ConceptMentioned in 1 video
The process by which language models generate text token by token, where each new token is conditioned on the previously generated ones.
The process by which language models generate text token by token, where each new token is conditioned on the previously generated ones.