torch.nn.init.kaiming_normal_

Software / App

PyTorch initializer (Kaiming/He initialization) for weights; described as a common way to set weight std = gain / sqrt(fan_in) depending on nonlinearity.

Mentioned in 1 video

Videos Mentioning torch.nn.init.kaiming_normal_

Building makemore Part 3: Activations & Gradients, BatchNorm

Building makemore Part 3: Activations & Gradients, BatchNorm

Andrej Karpathy

PyTorch initializer (Kaiming/He initialization) for weights; described as a common way to set weight std = gain / sqrt(fan_in) depending on nonlinearity.