Features Discover Use Cases Pricing Blog

Discover TopicsPretraining

Pretraining

1 video summary

Videos About Pretraining

Let's reproduce GPT-2 (124M)

Let's reproduce GPT-2 (124M)

Andrej Karpathy

Tools & Products

AdamW Lambda Labs nanoGPT torch.compile RedPajama NVIDIA A100 SXM 80 GB Common Crawl / C4

Studies & Research

FlashAttention (paper)G (approximate GELU)NVIDIA 2018 online softmax (paper)GPT-3 paper

People

Summify

Capture knowledge from anything you watch, read, or say.

Product

Pricing
Discover
Blog
Affiliate Program

Features

Summarize YouTube
Transcribe YouTube
Translate YouTube
PDF Summarizer
Voice Notes
AI Chat

Legal

Terms of Service
Privacy Policy

Contact

Contact Us
contact@summify.io

© 2026 Betastate Ltd. All rights reserved.