
Identify the causes of hallucinations in generative AI and practice hands-on experiments to manage, reduce, or prevent them using science-backed techniques and papers.
Learn how large language models work, from a generative pre-trained transformer and attention mechanisms to tokenization and next-word prediction, and see how fine-tuning with human feedback helps reduce hallucinations.
Define hallucinations in generative AI and explore causes such as data gaps, training data limitations, over generalization, and lack of real-time knowledge. Learn detection and mitigation to protect user trust.
Explore the root causes of hallucinations in generative ai by examining training data biases and diversity, architecture limits, and contextual inference errors, plus practical prompts and external validation strategies.
Conduct hands-on hallucination experiments across multiple models using prompts to provoke and analyze errors. Compare GPT-4, Gemini, and llama variants, noting real-time data limits and upcoming temperature effects.
Explore how temperature and maximum tokens shape AI outputs and hallucinations, and how top P, frequency penalty, and presence penalty balance cost and reliability in the OpenAI playground.
Explore how training data and model architecture shape hallucinations in generative ai, and compare how different architectures influence responses to the same prompt and data gaps.
Compare models to reduce hallucinations in generative AI and choose the best version for your task. Refine prompts and address data gaps in training and pre-training data to improve reliability.
Explore prompt mitigation to reduce hallucinations by adjusting your prompts rather than blaming the model; see how aggressive prompts can trigger hallucinations across models and why prompt design matters.
Ground your large language model outputs by grounding responses in factual data from pre-training sources and citing authoritative references, using Rotten Tomatoes or IMDb to reduce hallucinations.
Use chain of verification to double-check model responses by generating verification questions, revising the initial answer into a final verified one, reducing hallucinations across tasks.
Step back prompting uses 'let's think step by step' to force reasoning, abstract concepts, and decompose questions, a method in prompt engineering that reduces hallucinations and improves reliability.
Developers learn to implement LangChain in Python to reduce hallucinations by grounding responses to authoritative sources and building a simple OpenAI-based prototype.
Explore retrieval augmented generation (rag) and augmented generation to reduce hallucinations. Learn how vector databases, custom GPT, and on-premise models securely provide niche information and improve lms responses.
Design a custom GPT called Culinary Companion to provide detailed cooking recipes and step-by-step instructions. Use a rag structure and uploaded PDFs to reduce hallucinations, and add Dall-E visuals.
See a practical RAG implementation example using link chain, chroma vector database, and a grounded question answering prompt with a hallucination grader to verify factual grounding.
Explore fine tuning as a method to reduce hallucinations in generative AI by training with prompt–response examples, using few-shot learning, and applying OpenAI fine-tuning workflows.
Fine-tune a GPT-4 model with a few-shot dataset and monitor training loss, then compare the fine-tuned model to the base in a playground to reduce hallucinations.
Analyze vulnerabilities in LLMs with Nvidia's Jarak tool, focusing on hallucinations and prompt injection. Create vulnerability reports and test prompts, including snowball hallucination and graph connectivity scenarios.
Explore a practical hallucination detection workflow using the Garrick tool to provoke and compare original versus verification questions, measuring model resilience across snowball, primes, and graph connectivity prompts with OpenAI.
Welcome to the Hallucination Management for Generative AI course
Generative Artificial Intelligence and Large Language Models have taken over the world with a great hype! Many people are using these technologies where as others are trying to build products with them. Whether you are a developer, prompt engineer or a heavy user of generative ai, you will see hallucinations created by generative ai at one point.
Hallucinations will be there but it is up to us to manage them, limit them and minimize them. In this course we will provide best in class ways to manage hallucinations and create beautiful content with gen ai.
This course is brought to you by Atil Samancioglu, teaching more than 400.000 students worldwide on programming and cyber security! Atil also teaches mobile application development in Bogazici University and he is founder of his own training startup Academy Club.
Some of the topics that will be covered during the course:
Hallucination Root Causes
Detecting hallucinations
Vulnerability assessment for LLMs
Source grounding
Snowball theory
Take a step back prompting
Chain of verification
Hands on experiments with various models
RAG Implementation
Fine tuning
After you complete the course you will be able to understand the root causes of hallucinations, detect them and minimize them via various techniques.
If you are ready, let's get started!