Quantization of Large Language Models

Generative AI · 01 Day · 08 Hours · intermediate

This course focuses on quantizing large language models and other generative AI models to enhance efficiency, speed, and accessibility. It covers various quantization methods, including linear quantization and downcasting, and provides practical experience in building and customizing quantizers.