NVIDIA A100 SXM 80 GB

Let's reproduce GPT-2 (124M)

Andrej Karpathy

GPU model used in the author's machine (discussed with precision and TF32/BF16 capabilities).