Google Assistant development with Actions on Google

Explore how DialogFlow connects to actions on Google, define an agent with intents and entities, and build a fulfillment app to respond to user queries via the assistant.

Explore how Actions on Google creates the default fallback and default welcome intents automatically, how these intents trigger when input isn’t matched, and how to customize responses and contexts.

This lecture guides you to build a FAQ action in Google Assistant using Actions on Google by creating intents, adding training phrases, and crafting responses, then testing in the simulator.

Explore how DialogFlow fulfillment triggers backend actions via webhooks for specific intents. Learn to send HTTP POST requests to a webhook-enabled web service, using Google function.

Enable webhook fulfillment in Google Assistant using the inline editor, and deploy with Firebase functions and DialogFlow-fulfillment to map intents like Welcome and Fallback and send rich media cards.

Deploy your code to Google Firebase Functions and understand serverless architecture. See how cloud native backend as a service enables elastic on-demand scaling, real-time features, and simplified authentication.

Deploy and test your fulfillment by clicking deploy, which creates the Firebase project, function, and Google project; test in the actions simulator by uploading the action package via integrations (DialogFlow).

Learn to read user parameters and log intents in Google Assistant actions, using system entities like music artist and accessing logs in the Firebase console.

Install Firebase CLI on your local machine, then log in to authenticate and deploy code; list projects, run a local web server, and manage database with import and export users.

Deploy Firebase functions from a local environment for Actions on Google, configure the Firebase project and DialogFlow fulfillment, install modules, and test in the simulator.

Upgrade your Firebase account to unlock scalable storage and more cloud function invocations. Choose pay as you go (Blaze) for starting projects and access external web services with scalable storage.

Learn how the Firebase Realtime Database, a cloud-hosted NoSQL database, stores and syncs JSON data across Android, iOS, and Web in real time, with offline support, security rules, and authentication.

Set up the Firebase Realtime Database, generate and use a private key, enable locked mode security, and configure the firebase-admin SDK in Node.js to securely store musicians' votes.

Save votes to a realtime database in Firebase by creating a custom singer entity. Update artist vote counts with a one-time read and deploy the function to handle user input.

Learn to use a webhook for slot feeling, store session data with the Actions on Google library, and redirect users after multiple fallbacks during a DialogFlow conversation.

Read artist vote data from Firebase, order by votes, and present each artist's name with its vote count, using async/await to return the results to Dialogflow.

Learn how to read from a database, order artists by votes, and assemble a results array using async/await to ensure responses are sent via the agent in dialogflow.

Integrate your web services with Google Action by exposing internal or third-party APIs to Google Action, illustrated with a public meetups API to show upcoming events.

Learn how web services enable machine-to-machine communication through APIs, comparing SOAP and RESTful approaches, with HTTP, XML/JSON data, and key security methods like API keys and OAuth.

Learn to obtain a meetup.com API key, call the events endpoint, and display upcoming meetups by configuring parameters, location coordinates, and a config-driven Node.js app.

Create a Dialogflow intent for show meetups, add user sayings like show meetups and get meetups, set action name input.showwmeetups, and enable webhook fulfillment for the API call.

Learn to call an API with request-promise, handle responses, and save meetup data into the Actions on Google conv data for stateful conversation in Google Assistant.

Learn to display a meetup in a basic card on Google Assistant devices, fetch meetups asynchronously, and enable next, previous, and list all meetups in a single flow.

Build a follow-up intent for the next meetup in DialogFlow, using show meetups context and webhook fulfillment to increment meetupCount and display the next item.

Design conversations across devices by defining surface capabilities in Actions on Google, enabling or restricting audio and screen output, and crafting multi-surface conversations or response-branching experiences.

Test our app on devices and add test users to enable testing for Google Assistant development with Actions on Google, bringing you closer to completion.

Test on Google Home by using voice commands like 'talk to Jane from Udemy' and 'show all meetups,' then add test users to uncover problems that real users may reveal.

Add test users to your Google Assistant action and test in the simulator by granting viewer access via IAM permissions, sharing the simulator link, and guiding testers to accept terms.