Kim K 2.6

Stanford CS25: Transformers United V6 I The Ultra-Scale Talk: Scaling Training to Thousands of GPUs

Stanford Online

An example of a recent large language model with one trillion parameters.