Build Jarvus AI

Build a Rails app that integrates with OpenAI. This App is meant to teach

In episode 1, we will be using the browser to access the webcam and detect whether or not a user is in sight of the camera. Using this information we will decide whether or not to greet the user.

In episode 1a, we will be working on a simple cosmetic improvement to the app to give the app a simple fun interface.

In episode 2, we will access the microphone to implement volume detection to transcribe any sufficiently loud audio near the microphone and have back and forth conversations with our Jarvus app.

In episode 3, We will then give Jarvus memory to allow continued conversations. Memory will allow Jarvus to keep track of what was said within the context of a single conversation.

In episode 4, we will implement a background job queue to allow Jarvus to detect reminders and message users asynchronously.

This App is meant to be a simple but powerful starter kit to learning how to build a very basic Jarvus that works on local machines. In the new world of LLMs our app is just the beginning of what is possible when integrating with tools like openAI's chatgpt. This project should take less than a day to build given a junior level of programming experience and a handful of tools installed and set up.

This course shows how easy it is to build apps that work with LLMs and encourages the new generation of app building that moves us to an exciting future.