tanh

The spelled-out intro to neural networks and backpropagation: building micrograd

Andrej Karpathy

A specific activation (hyperbolic tangent) implemented both as a single op and later reconstructed from primitives to show equivalence; its local derivative is used in backpropagation examples.