Udemy
    •  
    •  
    •  
    •  
    •  
    •  
    •  
    •  
Turn what you know into an opportunity and reach millions around the world.
Learn More
Your cart is empty.
Keep shopping
[NEW] 2026: Quantization for Gen-AI
Rating: 3.9 out of 5(2 ratings)
16 students

[NEW] 2026: Quantization for Gen-AI

Enhancing Performance and Reducing Costs
Created byMG Analytics
Last updated 2/2026
English

What you'll learn

  • Generative AI
  • LARGE LANGUAGE MODEL
  • Quantization of Gen-AI Models
  • Types of quantizations

Course content

1 section10 lectures2h 2m total length
  • What is Gen-AI4:19
  • LLM configuration parameters9:33
  • Stateless LLMs14:15
  • Base LLM VS INSTRUCTION TUNED LLM.6:57
  • Intuition17:48
  • Impact of dtypes in quantization14:07
  • Quantized models18:17
  • PQT VS QAT4:57
  • Packages6:00
  • Quantization of Model26:25

Requirements

  • Interest in Generative AI
  • Python
  • Gen-AI LLM

Description

In today's rapidly evolving technological landscape, Large Language Models (LLMs) have emerged as a cornerstone of generative AI, capable of revolutionizing industries from content creation to customer service. This comprehensive course is designed to equip you with the essential knowledge and skills to master LLMs and harness their full potential.

Course Objectives

  • Gain a deep understanding of the foundational concepts and principles of generative AI and LLMs.

  • Explore the intricacies of LLM configuration parameters and their impact on performance.

  • Differentiate between stateless and stateful LLMs and their applications.

  • Understand the distinction between base LLMs and instruction-tuned LLMs.

  • Delve into the economics of model training, including cost considerations and the insights from the Kalpan Paper.

  • Explore the groundbreaking research presented in the Chinchilla Paper and its implications for LLM development.

  • Master the art of quantization to optimize model size and efficiency.

  • Differentiate between Post-Training Quantization (PQT) and Quantization-Aware Training (QAT) techniques.

  • Explore the landscape of quantization packages and tools available.

  • Learn the practical process of quantizing LLMs to enhance performance and reduce computational requirements.

Why Choose This Course?

  • Comprehensive Coverage: Our course provides a thorough understanding of LLMs, from foundational concepts to advanced techniques.

  • Hands-On Learning: Engage in practical exercises and projects to apply your knowledge and build real-world applications.

  • Expert Guidance: Benefit from the expertise of our experienced instructors who will guide you through the learning process.

  • Up-to-Date Content: Stay informed with the latest advancements in generative AI and LLM technology.

Enroll today and embark on a journey to become a master of generative AI and LLMs!

Who this course is for:

  • AI Practitioners
  • Data Scientists