
Explore building and deploying AI voice agents using vapi, elevenlabs, n8n and mcp, covering tech stack, platforms, prompts, integration with web apps, databases, and security, compliance, and business considerations.
Access all course links and resources in the important links lecture and accompanying PDF, including 11 Labs, Life Kit, GitHub, OpenAI playground, pinecone, and related docs.
Arnold Oberleitner, also known as Arnie, shares his ai expertise—building chatbots, ai agents, and ai automations for small businesses, with roots in transformers and diffusion since 2018.
Learn to build voice AI agents using Waapi, 11 labs, and Live Kit, choose models, craft system prompts, integrate via a web widget, and launch business-ready applications.
Understand basics and goals of voice agents, their strengths and weaknesses, where to apply them; compare routes, evaluate models by price, speed, and accuracy, and assess platforms for business value.
Voice agents let users talk to an AI that answers and can perform tasks, such as querying databases, writing data, and sending emails, on web pages or via phone.
Explore how voice agents work: from speech-to-text and an llm with function calling to external services, to an optional multimodal path that speaks back in real time.
Match models to processes: speech-to-text balances speed, accuracy, cost (Deepgram, 11 labs, Azure); ai models (OpenAI mini, Gemini flash) with minimal reasoning; text-to-speech via 11 labs; gpt real-time for latency.
Compare key voice agent platforms, highlighting strengths and weaknesses of 11 labs, vaapi, and open-source live kit, and learn how to trigger add-ons via webhooks or context protocol.
Evaluate the economics of voice agents vs. humans, highlighting per-minute costs and 24/7 availability. AI costs about 0.13 USD per minute, humans about 0.57, with a human-in-the-loop for complex calls.
Recap the basics of voice agents, compare text-based LM processing with real-time multimodal APIs, and review platforms like Vaapi, 11 Labs, and Live Kit for scalable, cost-efficient automation.
Create a free Waapi account and build a simple voice ai agent and appointment setter. Deploy to a page, configure dynamic variables and system prompts, then test and debug.
Explore Waapi, the first platform for generating voice ai agents, and learn sign up, pricing, models, voices, tools, integrations, and the documentation.
Build a simple voice AI agent in vapi using llms, stt, tts, and a rag database, with system prompts and templates for specific use cases.
Develops an AI voice agent to book appointments using ElevenLabs voice, prompt engineering, and Waapi templates, integrating Google Calendar to check and set bookings.
Explore advanced configurations for AI voice agents, including dynamic variables like name and date/time, time zone handling with the liquid date filter, and greeting personalization for outbound and inbound calls.
Learn to deploy and integrate an AI agent on a website using the widget, embed code, and HTML or WordPress, then customize themes, colors, layout, and chat or voice modes.
Learn to bridge waiting times and pauses in AI voice assistants by using filler words during calendar checks and bookings, with tips for timing, behavior prompts, and using smaller models.
Debug AI voice agents with dashboard testing and quick diagnosis, reviewing call, API, and webhook logs to address speech and technical issues, with manual testing prioritized.
Discover how to pick the right LLM on Open Router by checking rankings and context window sizes, copy a model name, and test free and paid options for voice agent.
Explore building AI voice agents with Waapi, ElevenLabs, and Google Calendar integration, covering setup, prompts, model selection, custom knowledge bases, and thorough testing for reliable customer support.
Integrate multiple tools using the model context protocol inside an addon, connect Mcpe server with Waapi, link Google Sheet as a database, enable email automations, and add MCP phone numbers.
Explore n8n automation from sign-up to workflows, with triggers and API keys, powered by OpenAI agents. Connect Gmail, Google Calendar, webhooks, and memory to build voice-enabled automations.
Discover how to update the cloud addon, create ai-driven workflows with n8n, and use templates, data tables, and a vector database to build a direct knowledge assistant.
Learn how to integrate the model context protocol into Waapi using the MCP tool to collect guest data, store it in Google Sheets, and book hotel reservations with Google Calendar.
Extend ai automation by building email workflows with Gmail, Google Sheets, and MCP server; auto send summaries and booking emails via Vaapi model context protocol and n8n.
Showcases using the model context protocol to fetch rows from Google Sheets or a SQL database via n8n MCP, enabling dynamic access to contact or product information.
Create a real vector database, upsert knowledge, and connect it to the model context protocol for Vapi voice agents. Use pinecone for embeddings, markdown data, and Google Drive triggers.
Connect a Pinecone vector database with n8n MCP and Vapi to empower a voice agent to index documents using an embeddings model and retrieve relevant chunks from the wander index.
Connect the MCP server with other AI models like Claude Desktop or Cursor. Demonstrate cloud desktop setup, Pinecone vector store, and automation with Gmail and Google Sheets.
Automatically send booking confirmation emails to clients by tweaking the system prompt, including name, phone, and booking details with the MCP warp tool, triggered by Vaapi and the MCP server.
Assign a phone number to your AI voice agent to handle inbound calls and optional outbound calls, compare latency and cost across web, Twilio, and Vonage, and explore setup options.
Learn to integrate Twilio numbers with Waapi for outbound and inbound calls, import a number, set geo permissions, and understand cost implications.
Build voice AI agents with Vapi, ElevenLabs, n8n, and MCP using the model context protocol. Create drag-and-drop workflows with SQL, Google Sheets, vector storage, and email automation.
Build a production-ready voice agent workflow by outlining scope, designing a restaurant layout, implementing Waapi, crafting a system prompt, integrating tools, and enabling transfer calls with human in the loop.
Identify simple, reliable voice agents that save time and create value. Prioritize inbound use cases like appointment scheduling, reservations, and FAQs, and price by delivered value.
Create a prototype of an inbound AI agent to automate restaurant bookings using a mind map, Google Sheets for bookings, and a dynamic database with system prompts and tools.
Build an AI voice agent for a steakhouse by crafting a system prompt, selecting models, and implementing a reservation workflow with availability checks and name capture.
Configure MCP tool integrations to book restaurant tables via Google Sheets. Use get rows to check availability and append row to log bookings with date, time, guests, seating, and status.
Automates storing reservations in Google Sheets with an AI agent that evaluates guest count and seating, then updates the sheet as new rows are added.
Test early with clients, review logs and transcripts, optimize speech and intent recognition, and iteratively refine system prompts using the GPT five optimizer before production.
Learn to manage transfers and escalations, transfer calls, and escalate to a human when issues can't be resolved, using system prompts and human-in-the-loop routing.
Learn how to embed sentiment analysis in your app using a system prompt and a summary prompt, test with transfer calls, and monitor user happiness in real time.
Explore advanced customization for AI voice agents, including model selection and monitoring, voice and transcription settings, end call tools, sending texts, squads, and custom tools for production reliability.
Plan, build, and test a voice AI agent for production by crafting a simple, effective layout, robust system prompts, and tool integrations such as Google Sheets and webhooks.
Explore building voice AI agents with 11 labs, using webhooks, prompt engineering, documentation, templates, and MCP to craft integrated automations.
Get an overview of 11 labs, covering the creative platform, agent platform, and documentation. Explore voices, text to speech, voice cloning, sound effects, and studio tools for building voice agents.
Master a six-building-block prompt framework for voice AI agents, covering personality, environment, tone, goal, guardrails, and tools, with practical examples and evaluation tips.
Build a simple ElevenLabs voice AI agent from scratch, configuring language, prompts, tools, and a web widget to embed on a page and test driving-license Q&A.
Master webhooks to connect tools like ElevenLabs and n8n, choose post or get, and test with test and production URLs. Map the data to Google Sheets for practical learning workflows.
Learn how to add tools via webhooks and connect n8n agents with ElevenLabs to perform web searches with a new addon, test data flow, and manage latency.
Choose templates to quickly create AI agents for personal or business use, customize with a goal and optional web page, and auto-generate an assistant prompt.
Design dynamic, branching agent workflows with start, qualification, subagent, and tool nodes in an alpha visual interface. Configure routes, transfers, system prompts, knowledge bases, and tools to guide conversations.
Test and debug your AI voice agent using 11 labs tools, create tests with evaluation criteria and dynamic variables, and iteratively fix the system prompt, LLM provider, and voices.
Extend your ai voice agents by integrating knowledge bases, tools, and testing across agents. Connect MCP servers, import numbers from Twilio or zip trunk, and perform outbound batch calls.
Recaps ElevenLabs' creative and agent platforms, covering voice cloning, text-to-speech, audio tools, and webhook-driven integrations. Learn to build agents, use prompts, and connect webhooks and templates to automate workflows.
Explore live Kit and cursor with Python to build a real-time ai voice agent, install tools, run a small coding exercise, and briefly discuss fine-tuning llms.
Install python, pip, and the UV package manager to accelerate Python development for MCP, with optional pyenv for version control; ensure python.exe is added to path.
Install cursor, explore its interface, and manage projects with a quick WIP coding demo using python. Learn how cursor builds on VS Code and integrates AI models.
Explore LiveKit’s interface, docs, and GitHub repos, with a look at sandbox, telephony, and AI agents, plus Python or NodeJS SDKs for quickstart builds.
Build a Python-based AI avatar with voice using live kit and the OpenAI realtime API, leveraging tables, tarvos or rhyme voices, and dotenv for secure keys.
Learn to end your app, restart, switch voices, and experiment with prompts in Python using agent_worker.py dev, saving changes and validating locally.
Publish your Python project on GitHub by creating a public repo, uploading files (excluding the dot env with API keys), and adding a readme.
Discover diverse live kit and Python options to build avatar agents with lip sync, using local ai models for transcription and text-to-speech, and integrate webhooks and function calling.
Assess the value of fine tuning by examining its drawbacks, including overfitting, cost, slower performance, and model drift. Prioritize strong system prompts and flexible model selection over fine tuning.
Install python and pip, set up cursor with the LiveKit real-time API, manage env files and API keys, and explore prompts; understand fine-tuning with JSON examples.
identify what to sell, how to market it, and how to price applications; learn to attract your first client, and why self-hosting improves privacy in Europe.
Identify viable ai voice agent offerings, including software, information, services, or physical products, that solve problems and achieve product market fit using warm outreach, cold outreach, content, and paid ads.
Choose a single niche, research its pain points, and build a small voice agent solution; test with 5–10 prospects for free to prove value, then monetize after one happy client.
Explore pricing strategies for voice agents, including hourly rates, retainer models, project pricing, and usage-based fees. Apply outcome-based pricing and value offers with concrete examples.
Learn how to self-host n8n for a voice AI automation business, compare cloud options with Hostinger hosting, and set up Docker Compose workflows to save costs.
Learn to turn ai automation skills into a viable business by focusing on one product, achieving product-market fit, applying the core four, and choosing flexible pricing.
Explore security and compliance risks in ai voice agents, focusing on MCP servers, prompt injections, data poisoning, data privacy, licensing and selling apps, and API key protection.
Demonstrates how a misbehaving MCP server can reveal data and inject malicious code through public GitHub configurations, highlighting the need for trusted, authenticated servers.
Examine tool poisoning and MCP rug pulls in MCP servers, including shadowing and hidden tool descriptions, and explore mitigations like clear UI and pinning.
Explore jailbreaks, prompt injections, and data poisoning as they can affect voice AI agents and MCP servers, especially with internet access or vision features.
Learn to securely manage api keys for mcp servers by never exposing keys, storing them in a dot env file, rotating regularly, and applying proper authentication with minimal access.
Understand copyrights, data privacy, censorship, licenses, and compliance for voice agents, emphasizing API use, local models, and GDPR compliance with Europe data residency.
Navigate the voice ai agent stack, where an LLM uses function calling to access tools like email and datasheets, and balance multimodal input with fast, cost-effective models.
AI Voice Agents: The Next Evolution of Conversational AI.
AI Voice Agents are transforming the way businesses and individuals interact.
They combine Large Language Models (LLMs) with speech input and output (STT & TTS) to create powerful real-time conversations – whether as AI phone assistants, booking tools, customer support bots, or sales agents.
But how do you actually build and deploy production-ready AI Voice Agents?
Which platforms and tools deliver the best results?
And how can you turn them into a profitable business opportunity?
This course gives you the complete roadmap – from fundamentals to advanced integrations and monetization.
What you’ll learn in this course:
Fundamentals & Technology
Voice Agents explained: goals, strengths, weaknesses & business potential
How Voice Agents work: LLMs, Text-to-Speech (TTS), Speech-to-Text (STT) & model selection
Platform overview: Vapi, ElevenLabs, Fonio, LiveKit & open-source alternatives
Cost-benefit analysis: is an AI Voice Agent business really worth it?
Vapi Basics – from zero to your first AI Phone Agent
Vapi step by step: registration, interface & creating your first agent
Build a booking assistant in German with ElevenLabs voices & prompt engineering
System prompts in practice: fine-tuning for natural, reliable conversations
Embed Voice Agents into websites & customize with CSS
Testing, debugging & continuous optimization
Advanced integration with n8n, MCP & RAG
n8n for automation: setup, API keys & workflows
Connect Vapi & n8n via MCP and add powerful tools
RAG (Retrieval-Augmented Generation): train Voice Agents with vector databases
Extend Voice Agents with email automation, Google Sheets, external APIs & databases
Connect MCP servers with Vapi & LLMs like DeepSeek, Llama & Mistral
Add & integrate phone numbers for inbound and outbound calls
Use JavaScript variables for dynamic names, dates & personalized conversations
Automate emails with Vapi & n8n (including JavaScript variables)
Production-ready Voice Agents & real business use cases
Step-by-step project: AI Voice Agent for restaurant reservations
Debugging, optimization & sentiment analysis for better call quality
Which types of Voice Agents deliver the most value – and how to sell them
ElevenLabs & Prompt Engineering Masterclass
ElevenLabs Creative Platform: overview, voices & documentation
Prompt Engineering Masterclass specifically for phone & conversational AI agents
Deploy ElevenLabs agents directly into websites
Extend capabilities with n8n & webhooks for multi-tool automation
Advanced options: MCP, outbound calls, multi-agent workflows
Special cases, Python Code & open-source solutions
Fine-tuning your own LLMs: when is it worth it?
LiveKit overview: building open-source voice agents with the Realtime API
AI avatars with voice & real-time interaction (OpenAI Realtime API + ElevenLabs + LiveKit)
Cursor: Use LLMs for Vibecoding to Build Agents
Python: Understand the LiveKit Python SDK
Security & Compliance
Security for AI Voice Agents: jailbreaks, prompt injections & data poisoning
Data protection & compliance: GDPR, EU AI Act, privacy & ethical use
After this course you will be able to:
Build and deploy AI Voice Agents from scratch
Work with the leading platforms: Vapi, ElevenLabs, Fonio & LiveKit
Extend them with n8n, RAG & MCP for advanced workflows
Make them production-ready and profitable for real-world clients
Ensure data privacy & GDPR compliance while scaling your automation
Whether you want to automate customer support, booking calls, sales outreach or lead qualification – this course gives you the practical knowledge to build AI Voice Agents that actually work in business.