torch.nn.Linear

Software / AppMentioned in 1 video

PyTorch linear (fully-connected) layer; discussed as the basic building block for MLPs and how fan_in/fan_out determine weight initialization scales.

Videos Mentioning torch.nn.Linear

Building makemore Part 3: Activations & Gradients, BatchNorm

Building makemore Part 3: Activations & Gradients, BatchNorm

Andrej Karpathy

PyTorch linear (fully-connected) layer; discussed as the basic building block for MLPs and how fan_in/fan_out determine weight initialization scales.