C
CUDA
Software / AppMentioned in 6 videos
Mentioned when tracing PyTorch internals (there are separate CPU and GPU kernels for operations such as tanh backward).
Videos Mentioning CUDA
The spelled-out intro to neural networks and backpropagation: building micrograd
Andrej Karpathy
Mentioned when tracing PyTorch internals (there are separate CPU and GPU kernels for operations such as tanh backward).
The Shape of Compute (Chris Lattner of Modular)
Latent Space
NVIDIA's parallel computing platform and API, which Modular aims to replace or abstract away with its own stack.
The $3 Trillion AI Coding Opportunity
a16z Deep Dives
Jensen Huang on GPUs - Computerphile
Computerphile
Information Theory for Language Models: Jack Morris
Latent Space
A parallel computing platform and programming model mentioned as a valuable skill to learn, though not the only path to high employability.
DeepWiki: The GitHub Encyclopedia
Latent Space
A parallel computing platform and programming model used for comparison with Python implementations in research projects.