Stochasticity
Concept
The inherent randomness or unpredictability in LLM outputs due to token selection on a distribution, leading to varied and sometimes surprising responses.
Mentioned in 1 video
The inherent randomness or unpredictability in LLM outputs due to token selection on a distribution, leading to varied and sometimes surprising responses.
