Quantization
Concept
A technique to reduce the precision of model weights, leading to smaller and faster models.
Mentioned in 2 videos
Save the 2 videos on Quantization to your own pod.
Sign up free to keep building your knowledge base on Quantization as more episodes are added.
Videos Mentioning Quantization
A Comprehensive Overview of Large Language Models - Latent Space Paper Club
Latent Space
A technique to reduce the precision of model weights, leading to smaller and faster models.
Building with Instruction-Tuned LLMs: A Step-by-Step Guide
DeepLearningAI
A technique used to reduce the memory footprint and computational requirements of LLMs, particularly relevant with Q-LoRA and bitsandbytes.