
Explore what large language models are and how they use neural networks, machine learning, and natural language processing to understand and generate language, with examples like chatbots and text generation.
Explore the evolution and historical context of language models from early statistical and neural approaches to transformer giants like GPT and Bert, including open‑source milestones and ChatGPT's impact.
Explore why LLMs matter today and see applications like chatbots, code generation, text generation, translation, and content summarization, which boost automation and analyze market trends and customer feedback.
Learn to generate text using generation args, including max new tokens, return full text, temperature, and sampling, and see templates refine prompts for controlled output.
Explore open source models such as Lemma, with 8B and 70B parameter versions and an 8000-token context, and learn to load and test them for text or code outputs.
Explore prompt templates in LangChain, including string and chat templates, learn to create and invoke templates with topics like artificial intelligence, and reuse prompts in future implementations.
Learn how streaming improves user experience by displaying each token as it is generated, visualizing text step by step, and using the string function with topic and size per chunk.
Install and configure a full local environment for LangChain, including Python, Visual Studio Code, an .env file for keys, and essential libraries like Hugging Face, OpenAI, torch, and transformers.
Explore tests with RAG by wiring prompts, context, and questions in a chain, using a system prompt and template to feed retrieved data to the algorithm.
Master markdown for visualization to render engaging video info, titles, and topic lists with IPython's markdown class, bold and italic formatting, and lists, enabling English language outputs via LangChain.
Implement a chat input and store messages in the session chat history as human and ai messages. Use a prompt template and chain to produce model responses in Streamlit app.
Learn to run a Google Colab notebook by saving a drive copy, installing libraries, and launching a Streamlit interface to interact with the chatbot.
Recap of master LLMs with LangChain: large language models, Hugging Face, Rag and agents, plus video transcription, memory chatbot with a web interface, and document extraction.
In this course, you will dive deep into the world of Generative AI with LLMs (Large Language Models), exploring the potential of combining LangChain with Python. You will implement proprietary solutions (like ChatGPT) and modern open-source models like Llama and Phi. Through practical, real-world projects, you'll develop innovative applications, including a custom virtual assistant and a chatbot that interacts with documents and videos. We'll explore advanced techniques such as RAG and agents, and use tools like Streamlit to create intuitive interfaces. You'll learn how to use these technologies for free in Google Colab and also how to run projects locally.
In the introduction, you’ll be introduced to the theory of Large Language Models (LLMs) and their fundamental concepts. Additionally, we’ll explore the Hugging Face ecosystem, which offers modern solutions for Natural Language Processing (NLP). You'll learn to implement LLMs using both the Hugging Face pipeline and the LangChain library, understanding the advantages of each approach.
The second part is focused on mastering LangChain. You'll learn to access open-source models, like Meta's Llama and Microsoft’s Phi, as well as proprietary LLMs, like OpenAI's ChatGPT. We'll explain model quantization to enhance performance and scalability. Key LangChain components, such as chains, templates, and tools, will be presented, along with how to use them to develop robust NLP solutions. Prompt engineering techniques will be covered to help you achieve more accurate results. The concept of RAG (Retrieval-Augmented Generation) will be explored, including information storage and retrieval processes. You’ll learn to implement vector stores and understand the importance of embeddings and how to use them effectively. We’ll also demonstrate how to use RAG to interact with PDF documents and web pages. Additionally, you'll have the opportunity to explore integrating agents and tools, like using LLMs to perform web searches and retrieve recent information. Solutions will be implemented locally, enabling access to open-source models even without an internet connection.
In the project development phase, you’ll learn to create a custom chatbot with an interface and memory for Q&A. You’ll also learn to develop interactive applications using Streamlit, making it easy to build intuitive interfaces. One project involves developing an advanced application using RAG to interact with multiple documents and extract relevant information through a chat interface. Another project will focus on building an application that automatically summarizes videos and answers related questions, resulting in a powerful tool for instant, automated video comprehension.