s
softmax
Tool / ProductMentioned in 2 videos
The neural-network layer that exponentiates logits and normalizes them into a probability distribution over next characters.
Videos Mentioning softmax

The spelled-out intro to language modeling: building makemore
Andrej Karpathy
The neural-network layer that exponentiates logits and normalizes them into a probability distribution over next characters.

Elon Musk on DOGE, Optimus, Starlink Smartphones, Evolving with AI, Why the West is Imploding
All-In Podcast