
Understand the inspiration for this course and what we are building
Understand the 3 options for this course: (1) Build a standalone robot with just the android phone, (2) phone with esp32 body, or, (3) phone with micro:bit body
Hardware components needed.
How to solder wires to your dc motors
Assemble the robot chassis.
Assemble the robot chassis.
Upgrade to 18650 batteries.
Install Arduino IDE, ESP32 core library and CP2102 driver.
Understand how the ESP32 control works.
Test the ESP32 controls.
Set up MIT app inventor
Implement bluetooth communication on the Android phone
Enable speech recognition on Android phone to talk to robot
Implement face detection on Android phone for robot
Make the robot track the face and always move to face the user.
Make blinking animated eyes for the robot that follows the user's face.
Give the robot ability to talk to you and respond physically.
Build an apk app and also ideas for further improvements.
Add voice command to make Sam go to sleep and "Hey Sam" to wake him up.
Make your own extensions for MIT AppInventor
Add image recognition to Sam.
Make your own chatbot extension to use with local LLM.
Install LM studio and selecting models.
How to configure Sam to run on local LLM
Upgrade Sam robot to use Microbit base
Upgrade Microbit Sam to use 1 x 18650 battery.
Write micro:bit program to receive move commands from Android phone via bluetooth BLE
Program the android phone using MIT Appinventor for micro:bit
Demo of new button for IP entry.
Understand how the IP button works, and also other improvements to Sam.
How to solve bluetooth not connecting, Sam not responding, App not fullscreen and other common issues.
A demo on how Sam API works
Install Sam API and tips on troubleshooting installation errors
Understand how Sam API works
Bring your own personal artificial intelligence companion to life! In this hands-on course, you’ll learn how to build an interactive, expressive robot called SAM (Simulated Autonomous Multi-Intelligence) powered by an Android smartphone and an ESP32 development board, or, a Micro:bit (also commonly written as "microbit") kit. Using MIT App Inventor as the core development tool, you’ll discover just how easy it is to build complex AI applications through its intuitive block-based coding system—perfect for beginners and accessible to anyone without prior programming experience.
The Android phone will serve as the “brain” of your robot, enabling speech recognition, natural conversation, personality, text-to-speech, facial tracking, object recognition and facial expressions displayed right on the screen. The ESP32 (or micro:bit ) acts as the robot’s body, controlling motors and simple hardware that bring your creation to life. You’ll only need a handful of inexpensive, easily available components to assemble the physical robot, making this project both affordable and beginner-friendly.
Tools and Software (All Free)
MIT App Inventor and Microsoft MakeCode are web-based tools that run directly in your browser and do not require installation. The Arduino IDE is also free to download and use. For advanced AI features, you may optionally choose to use the OpenAI API, which requires creating an API key. This is optional, and usage costs are typically very low. Free or local alternatives can also be used depending on your setup.
Note that this course is designed to be flexible, and you are NOT required to buy any hardware unless you want to.
You can choose any ONE of the following three approaches:
Three Ways to Build Your AI Robot (Important!)
(1) Standalone SAM Robot (No Extra Hardware Required)
Build SAM using only an Android phone using MIT App Inventor block-base coding
Focus on AI, speech, vision, and Large Language Models (LLMs)
Ideal if you want to learn AI robot concepts without spending on electronics
(2) SAM + ESP32 Robot
Use an ESP32 to control motors - program using Arduino IDE
The Android phone remains the AI “brain” - built using MIT App Inventor block-based coding
Great for beginners who want hands-on robotics with minimal complexity
SAM (android phone) sends Bluetooth Classic commands to ESP32
(3) SAM + micro:bit Robot
Use a micro:bit for more advanced control and expansion - program using Microsoft Makecode block-based coding
Suitable for students who want greater flexibility and performance
Includes the potential to use built-in sensors already available on the micro:bit kit for richer interactivity
SAM (android phone), built using MIT App Inventor block-based coding, sends Bluetooth BLE commands to the micro:bit
Buying ESP32 or micro:bit hardware is NOT compulsory.
You can fully follow and benefit from this course by building the standalone SAM robot using just your Android phone.
Course Focus: Companionship Over Hardware Complexity
At its core, the main objective of this course is to explore companionship, personality, and interaction, rather than advanced or precision hardware engineering.
This course is not focused on building robots that autonomously navigate complex environments, perform high-accuracy movements, or react to the physical world with mechanical precision. Instead, the emphasis is on learning how to design a robot that feels present, engaging, and personable—one that listens, speaks, responds thoughtfully, and builds a sense of connection with the user.
You’ll focus on crafting personality, conversational behavior, expressions, and AI-driven interaction, using software and intelligence rather than complex hardware. The hardware, when used, serves as a simple extension of the robot’s presence—not the centerpiece of the experience.
This approach allows you to concentrate on what makes a robot feel alive: communication, expression, context awareness, and meaningful interaction.
Inspiration and Philosophy
This course was inspired by the LOOI robot. LOOI demonstrates the powerful idea of using a smartphone as the central intelligence of a personal robot—leveraging the phone’s screen, camera, microphone, speakers, and AI capabilities to create natural interaction, expressive visuals, and conversational behavior. Its approachable form factor and emphasis on personality, presence, and human-like engagement show how compelling robots can be built around devices many people already own. SAM follows this same core philosophy, translating it into a beginner-friendly, educational project that you can fully build, customize, and understand using accessible tools and hardware.
This course will guide you in designing a robot that listens to your voice, responds using speech, and holds meaningful conversations powered by modern AI and LLM technologies. Your robot can tell jokes, offer companionship, answer questions, and behave like a friendly personal assistant. Through the phone’s sensors and camera, you’ll add user-tracking and object-tracking abilities so the robot can automatically turn to face the user, giving it lifelike presence.
You’ll also build expressive digital eyes that blink, track the user, and show emotions—plus the option to create your own custom faces or animations. Along the way, you’ll gain foundational skills in Bluetooth communication, AI and LLM integration, speech recognition, text-to-speech, facial recognition, chatbot behaviour, object tracking, and more.
By the end of this course, you’ll have a fully functional, AI-driven robot that blends hardware, software, creativity, and conversational intelligence—all built by you from the ground up!
Enroll today and join me inside to bring your AI robot—and your creativity—to life!