C
CUDA
Tool / ProductMentioned in 3 videos
Mentioned when tracing PyTorch internals (there are separate CPU and GPU kernels for operations such as tanh backward).
Videos Mentioning CUDA

The spelled-out intro to neural networks and backpropagation: building micrograd
Andrej Karpathy
Mentioned when tracing PyTorch internals (there are separate CPU and GPU kernels for operations such as tanh backward).

The $3 Trillion AI Coding Opportunity
a16z Deep Dives

Jensen Huang on GPUs - Computerphile
Computerphile