torch.nn.init.kaiming_normal_

Software / AppMentioned in 1 video

PyTorch initializer (Kaiming/He initialization) for weights; described as a common way to set weight std = gain / sqrt(fan_in) depending on nonlinearity.

Videos Mentioning torch.nn.init.kaiming_normal_

Building makemore Part 3: Activations & Gradients, BatchNorm

Building makemore Part 3: Activations & Gradients, BatchNorm

Andrej Karpathy

PyTorch initializer (Kaiming/He initialization) for weights; described as a common way to set weight std = gain / sqrt(fan_in) depending on nonlinearity.