AdamW
Concept
Optimizer chosen for training (AdamW variant) with recommended betas and epsilon following GPT-3 guidance.
Mentioned in 2 videos
Save the 2 videos on AdamW to your own pod.
Sign up free to keep building your knowledge base on AdamW as more episodes are added.
