
Discover how to integrate machine learning into Android apps with TensorFlow Lite and Firebase ML Kit, covering image classification, object detection, text recognition, and more.
Create an Android Studio project and design a GUI with an image view and two buttons to pick from gallery or capture with camera, then display the selected image.
Register an activity result launcher to launch a gallery image picker, obtain the selected image URI, and display it in an image view in an android app.
Add an if block to ensure the user selects an image from the gallery in onActivityResult, checking the result code equals RESULT_OK before displaying the image in an image view.
Learn how to capture images from the camera in Android by handling manifest and dynamic permissions, launching the camera intent, and displaying the captured image in an image view.
Convert selected or captured images from gallery or camera to bitmap form for Android machine learning workflows, correcting orientation for facial recognition models.
Implement an Android image picker that lets users choose from the gallery or capture with the camera using intents, then display the bitmap in an image view.
Display live camera footage using camera 2 API, convert frames to bitmaps, and feed them to machine learning models for real-time image classification, object detection, and face detection.
Demonstrates testing a live feed app by displaying live camera footage inside the application on mobile devices.
Convert live camera frames to bitmaps and feed them to a machine learning model, by integrating the frame-to-bitmap conversion code and ensuring only one frame processes at a time.
Create a new Android Studio project in Kotlin, build a graphical user interface with an image view and gallery and camera buttons, and initialize views to display chosen images.
Learn to pick images from gallery in an Android app using the activity result launcher, create the gallery intent, and display the chosen image in an image view.
Declare camera and external storage permissions in the manifest and request them dynamically on Android M and above, handling user responses with onRequestPermissionsResult.
Launch the camera after handling permissions, capture an image with the open camera method, and display it in an image view using a camera activity result launcher and a URI.
Learn how to convert images from gallery or camera into bitmap format. Rotate bitmaps to portrait orientation and prepare them as inputs for machine learning models in Android.
Shows how to build an android image picker app with an image view and two buttons, handling gallery and camera intents, requesting permissions, and displaying bitmaps.
Learn to display camera footage in an Android app using the Camera2 API, render frames on a TextureView, convert frames to bitmaps, and feed to a machine learning model.
Showcase a built live feed Android app that displays live camera footage inside the application on mobile devices.
Capture live camera frames in an Android app and convert each frame into a bitmap. Feed these bitmaps into a machine learning model to obtain predictions.
Leverage the Google ML Kit in Android and iOS apps to perform image labeling, object detection with bounding boxes, pose estimation, selfie segmentation, smart reply, and text recognition.
Explore Firebase ML Kit, a mobile sdk that brings Google machine learning to Android with on-device and cloud ml, offering apis for text, faces, barcodes, image labeling, and language detection.
Develop an Android image labeling app by selecting or capturing images, labeling them with a model, and displaying results, starting from a GitHub starter project.
Explore building an Android app that lets users pick or capture images, display them responsively, and prepare for image labeling by wiring up gallery and camera workflows in MainActivity.
Learn to integrate ML Kit image labeling in Android, using the base model or a custom TensorFlow Lite model, and compare bundled versus unbundled approaches.
Add the google maven repository to Gradle settings and build scripts, add the bundled image labeling dependency, then convert bitmaps to input image format and run the image labeler.
Initialize an image labeler via the image labeling get client method, process images, and display label names with confidence scores in a text view.
Test the image labeling app by selecting gallery images, observing predictions with high confidence scores, and confirming the model detects objects like dog and beach accurately.
Improve Android machine learning app performance by formatting confidence scores to two decimal places and applying a 0.7 confidence threshold via image labeler options.
Explore building an Android image labeling app using the ML Kit library, from image selection or capture to labeling with an image labeler and displaying the results.
Build an image labeling app with the ML Kit image labeling model, letting users pick from gallery or capture with camera, then display labeling results using a starter GitHub project.
Review the GUI for an Android image labeling app, including camera and storage permissions, image selection or capture flows, and bitmap handling. Prepare for image labeling with a placeholder method.
Integrate the ML Kit vision image labeling library into an Android Studio project to use the base classifier for more than 400 items and compare bundled versus unbundled approaches.
Add the library dependency in your app level build.gradle, using the bundled approach. Sync Gradle, then convert bitmaps to the input image format for the image labeling model.
Initialize an image labeler, pass an input image to the labeling model, and display labeled results with confidence scores in the Android app.
Test an image labeling app by selecting images, observe predictions such as dog (99% confidence) and beach (97%), then note related labels like sky, sand, and rock, and plan improvements.
Format the confidence value to two fractional digits using string.format, and set a confidence threshold in image labeler options to display only predictions with high accuracy in Android.
Leverage a starter Android app to perform image labeling with a Git image labeling dependency. Initialize image labeler, convert chosen images to input format, and display labels on screen.
Learn how to convert models into the standard flight format for Android on mobile devices. Explore image classification, object detection, segmentation, and regression with quantized models and delegates.
Explore TensorFlow Lite for on-device machine learning, converting models with the Lite Converter and executing them via the Lite interpreter on Android and iOS for latency, privacy, and no internet.
Build Android apps that perform image classification using a low powered mobile model. Capture or select images, run them through the mobile model, and display real-time predictions.
Import the starter android app code from github and learn to run image classification with a mobile ad model using the standard flow light library, with gallery or camera input.
Review the starter android app code in the main activity, where two image views and a text view display captured or gallery images, with rotation and model prediction.
learn to integrate a mobile net v1 image classification model into an android app, including assets setup, TensorFlow Lite dependency, and recognizing images with a classifier.
Learn to build and test an Android image classification app using MobileNet, verify predictions with confidence scores, and integrate your own model and label file in a classifier workflow.
Load the model and label files from assets, initialize the standard flow light interpreter, scale the input image to 224x224, and map outputs to labels with confidence scores.
Import a starter live feed image classification app from GitHub, clone into Android Studio, and run on device to preview live camera footage before integrating the classification model.
Observe Shin installed inside the device, displaying live camera footage in the application during testing, while the caption notes text views and upcoming predictions.
Explore building an Android app that streams live camera footage and converts frames. Include texture view, camera connection fragment, and image available listener for classifier processing.
Load a model and label file, initialize a classifier with an interpreter, rotate live camera frame bitmaps by the sensor orientation, recognize images, and display the predictions in a TextView.
Test a live feed image classification app on a real device, predicting laptop, desk, mouth, keyboard, and space bar with confidence scores around 79–80 percent, confirming correct functionality.
Explore image classification on Android using MobileNet models to recognize animals with 224 by 224 inputs, and build two apps for gallery or camera inference and real-time live camera inference.
Build an image classification app that lets users choose from the gallery or capture with the camera, then run the image through a mobile model and display the results.
Create an Android image classification app by loading a MobileNet model with TensorFlow Lite, then capture or pick an image, preprocess to bitmap, and display predicted labels with confidence scores.
Test an image classification app by selecting images from the gallery in the emulator, view the model's banana prediction with 99% confidence, and test on a real device.
Learn how the classifier class loads model via an interpreter, scales a bitmap to 224 by 224, converts it to a byte buffer, runs inference, and returns predictions with confidence.
Learn how to build a custom image classification app by loading a machine learning model and label file, resizing input images, and displaying prediction titles with confidence scores.
Import a starter Android project from GitHub to build a live camera image labeling app, convert frames to bitmaps, and process them for real-time classification.
Demonstrate a starter Android application by displaying live camera footage and text views, then prepare and show model predictions in a separate view while testing the app.
Learn to pass frames of live camera footage to a mobile tflite model, load the model and labels, rotate bitmaps, run recognition, and display results.
Test a live feed image classification application on a real device, showing predictions for hand with 96% confidence, nails 85%, and room 80%.
Explore quantization in Android apps by comparing floating point and quantized models, showing how quantization reduces model size and latency with a small accuracy trade-off.
Explore using a quantized mobile net model in an Android image classification app, from gallery or camera input to result display, and compare it with a floating point model.
Welcome to Machine Learning use in Android the Complete Guide.
In this course, you will learn the use of Machine learning and computer vision in Android along with training your own image recognition models for Android applications without knowing any background knowledge of machine learning. The course is designed in such a manner that you don't need any prior knowledge of machine learning to take this course.
In modern world app development, the use of ML in mobile app development is compulsory. We hardly see an application in which ML is not being used. So it’s important to learn how we can integrate ML models inside Android (Java & Kotlin) applications. And this course will teach you that. And the main feature of this is you don’t need to know any background knowledge of ML to integrate it inside your Android applications.
What we will cover in this course?
Dealing with Images in Android
Dealing with frames of live camera footage in Android
Use of quantized and floating point tensorflow lite models in Android
Use of tensor flow lite delegates to improve the performance of ML models in Android
Image classification with images and live camera footage in Android
Object Detection with Images and Live Camera footage
Image Segmentation to make images transparent in Android
Use of regression models in Android
Image Labeling Android to recognize different things
Barcode Scanning Android to scan barcodes and QR codes
Pose Estimation Android to detect human body joints
Selfie Segmentation Android to separate the background from the foreground
Digital Ink Recognition Android to recognize handwritten text
Object Detection Android to detect and track objects
Text Recognition Android to recognize text in images
Smart Reply Android to add auto reply suggestion
Text Translation Android to translate between different languages
Face Detection Android to detect faces, facial landmarks, and facial expressions
Training image classification models for Android
Retraining existing machine learning and computer vision models with transfer learning for Android applications
Sections:
The course is divided into four main parts.
Image and live camera footage in Android (Java & Kotlin)
Pre-Trained Tensorflow Lite models use in Android (Java & Kotlin)
Firebase ML Kit use in Android (Java & Kotlin)
Training Image Classification models for Android (Java & Kotlin)
1: Images and live camera footage in Android (Java & Kotlin)
So in the first section, you will learn to handle both images and live camera footage in Android so that later we can use them with machine learning models. So, in that section, we will learn to
Choose images from the gallery in Android (Java & Kotlin)
Capture images using the camera in Android (Java & Kotlin)
Displaying live camera footage in Android (Java & Kotlin) applications using camera2 API
Accessing frames of live camera footage in Android (Java & Kotlin)
2: Pre-Trained Tensorflow Lite
So, after learning the use of images and live camera footage in Android in this section we will learn the use of popular pre-trained machine learning and computer vision models in Android and build
Image classification Android app (Both with images and live camera footage)
Object detection Android app(Both with images and live camera footage)
Image segmentation Android
applications
3: Quantization and Delegates
Apart from that, we will cover all the important concepts related to Tensorflow lite like
Using floating-point and quantized model in Android (Java & Kotlin)
Use the use of Tensorflow lite Delegates to improve model performance
4: Regression In Android
After that, we will learn to use regression models in Android (Java & Kotlin) and build a couple of applications including a
Fuel Efficiency Predictor for Vehicles.
5: Firebase ML Kit
Then the next section is related to the Firebase ML Kit. In this section, we will explore
Firebase ML Kit
Features of Firebase ML Kit
Then we are going to explore those features and build a number of applications including
Image Labeling Android (Java & Kotlin) to recognize different things
Barcode Scanning Android (Java & Kotlin) to scan barcodes and QR codes
Pose Estimation Android (Java & Kotlin) to detect human body joints
Selfie Segmentation Android (Java & Kotlin) to separate the background from the foreground
Digital Ink Recognition Android (Java & Kotlin) to recognize handwritten text
Object Detection Android (Java & Kotlin) to detect and track objects
Text Recognition Android (Java & Kotlin) to recognize text in images
Smart Reply Android (Java & Kotlin)to add auto reply suggestion
Text Translation Android (Java & Kotlin) to translate between different languages
Face Detection Android (Java & Kotlin) to detect faces, facial landmarks, and facial expressions
CamScanner Android Clone
Apart from all these applications, we will be developing a clone of the famous document-scanning android application CamScanner. So in that application, we will auto-crop the document images using text recognition and improve the visibility of document Images.
6: Training Image Classification Models
After mastering the use of ML Models in the Android (Java & Kotlin) app development in the Third section we will learn to train our own Image Classification models without knowing any background knowledge of Machine learning and computer vision.
So in that section, we will learn to train ML models using two different approaches.
Dog breed Recognition using Teachable Machine
Firstly we will train a dog breed recognition model using a teachable machine.
Build a Real-Time Dog Breed Recognition Android (Java & Kotlin) Application.
Fruit Recognition using Transfer Learning
Using transfer learning we will retrain the MobileNet model to recognize different fruits.
Build a Real-Time fruit recognition Android (Java & Kotlin) application using that trained model
Images and Live Camera Footage
The course will teach you to use Machine learning and computer vision models with images and live camera footage, So that, you can build both simple and Real-Time Android applications.
Android Version
The course is completely up to date and we have used the latest Android version throughout the course.
Language
The course is developed using both Java and Kotlin programming languages. So all the material is available in both languages.
Tools:
These are tools we will be using throughout the course
Android Studio for Android App development
Google collab to train Image Recognition models.
Netron to analyze mobile machine learning models
By the end of this course, you will be able
Use Firebase ML kit in Android App development using both Java and Kotlin
Use pre-trained Tensorflow lite models in Android App development using Java and Kotlin
Train your own Image classification models and build Android applications.
You'll also have a portfolio of over 20+ machine learning and computer vision-based Android R applications that you can show to any potential employer.
course requirements:
This is the course for you if
You want to make smart Android (Java & Kotlin) apps
You are interested in becoming a modern-day Android (Java & Kotlin) developer, a freelancer, launching your own projects, or just want to try your hand at making real smart mobile apps
You have no prior programming experience, or some but from a different language/platform
You want a course that teaches you the use of machine learning and computer vision in Android (Java & Kotlin) app development, in an integrated curriculum that will give you a deep understanding of all the key concepts an Android (Java & Kotlin) developer needs to know to have a successful career
Who can take this course:
Beginner Android ( Java or Kotlin ) developer with very little knowledge of Android app development.
Intermediate Android ( Java or Kotlin ) developer wanted to build a powerful Machine Learning-based application in Android
Experienced Android ( Java or Kotlin ) developers wanted to use Machine Learning and computer vision models inside their Android applications.
Anyone who took a basic Android ( Java or Kotlin ) mobile app development course before (like Android ( Java or Kotlin ) app development course by angela yu or other such courses).
Unlike any other Android app development course, The course will teach you what matters the most.
So what are you waiting for? Click on the Join button and start learning.