Auto-regressive Decoding

Concept

The process by which language models generate text token by token, where each new token is conditioned on the previously generated ones.

Mentioned in 1 video