
Prepare by meeting prerequisites in intermediate Python, Docker, SQL, and OpenAI access, and gain basics of terminals, vector databases, and translating natural language to SQL.
Clone the GitHub repository, create a virtual environment, install dependencies from requirements.txt, and configure env with your OpenAI key to run notebooks in VS Code.
Walk through the repository structure from the app folder to back ends and Postgres, learn to configure the OpenAI key, and review data, notebooks, and Rag pipelines.
Explore how LangChain implements a runnable interface to pipe a prompt, a model, and an output parser, building a chain with a topic and invoke method that yields a joke.
Build a small lang chain style expression language by overloading the pipe operator to chain runnables, using an abstract base class with invoke and process methods.
Explore real world examples of retrieval augmented generation using a chat prompt template, a vector store, embeddings, and a RAC workflow.
Introduce ragas, a framework for evaluating retrieval augmented generation with metrics like faithfulness and answer relevancy, then build a test set using LangChain with embeddings and a chat model.
Migrate from v1 to v2 by wrapping the Chadami and embeddings models with the length change wrapper and length chain embeddings wrapper, using the default query distribution.
HyDE uses hypothetical document embeddings to generate five hypothetical answers for a query, then retrieves the best documents, showing a prompt and parsing workflow and foreshadowing parentchild retrieval.
What to Expect from This Course
Welcome to our course on Advanced Retrieval-Augmented Generation (RAG) with the LangChain Framework!
In this course, we dive into advanced techniques for Retrieval-Augmented Generation, leveraging the powerful LangChain framework to enhance your AI-powered language tasks. LangChain is an open-source tool that connects large language models (LLMs) with other components, making it an essential resource for developers and data scientists working with AI.
Course Highlights
Focus on RAG Techniques: This course provides a deep understanding of Retrieval-Augmented Generation, guiding you through the intricacies of the LangChain framework. We cover a range of topics from basic concepts to advanced implementations, ensuring you gain comprehensive knowledge.
Comprehensive Content: The course is designed for developers, software engineers, and data scientists with some experience in the world of LLMs and LangChain. Throughout the course, you'll explore:
LCEL Deepdive and Runnables
Chat with History
Indexing API
RAG Evaluation Tools
Advanced Chunking Techniques
Other Embedding Models
Query Formulation and Retrieval
Cross-Encoder Reranking
Routing
Agents
Tool Calling
NeMo Guardrails
Langfuse Integration
Additional Resources
Helper Scripts: Scripts for data ingestion, inspection, and cleanup to streamline your workflow.
Full-Stack App and Docker: A comprehensive chatbot application with a React frontend and FastAPI backend, complete with Docker support for easy setup and deployment.
Additional resources are available to support your learning.
Happy Learning! :-)