
Take ML models from idea to production by building a basic ML Ops workflow. Deploy a simple prediction service with REST and gRPC APIs, containerized and on AWS and GCP.
Set up the ml ops environment with Anaconda, VS code, and a virtual env; download TensorFlow and PyTorch models, then build and test a cnn for dogs versus cats.
Install and verify Anaconda on your system by downloading the appropriate installer for Windows, Mac, or Linux, then use the Anaconda prompt to check Python.
Install verse code on Windows by downloading the installer, running through setup, adding to path, and using open with code to start a project.
Set up a ml ops beginner project by creating a virtual environment, organizing test images, and installing PyTorch with torchvision and pillow to run PyTorch predictions alongside a TensorFlow model.
This lecture shows building a PyTorch and a TensorFlow image classifier for cats and dogs with a transfer-learned model, organized in intro scripts, loading a checkpoint, and running CPU-based inference.
Use a PyTorch inference workflow with a transfer learning model to transform images, run the model, and print the top predictions with confidence. Validate with dog and cat examples.
Learn to load and pre-process images for TensorFlow: load image, convert to array, reshape to a sample with three channels, center pixel data, and normalize features for subsequent model predictions.
Load a TensorFlow model, run image predictions, and interpret a two-dimensional output using a 0.5 threshold to distinguish cat versus dog, with sanity checks.
Explore what an API is, using the waiter analogy, and build a FastAPI-based image classifier API that detects dogs or cats, with logging, health checks, and endpoints.
Build a FastAPI ML API with a health endpoint, logging, and auto OpenAPI standard docs. Add TensorFlow and PyTorch image classification endpoints using base64 payloads and uvicorn deployment.
Explore how gRPC enables faster service communication by using protocol buffers over HTTP/2, with streaming, bidirectional support, and direct bytes without base64, contrasting with REST APIs.
Define a gRPC API with a protocol file, compile protobuf code, and organize a modular project around a cats versus dogs example.
Configure a Python gRPC server by setting up a logger, creating a models object, registering services, selecting an insecure port, and starting the server to await requests.
Discover how to implement a gRPC TensorFlow inference API, handling image input as bytes, converting base64 when needed, and adding robust logging and server error responses.
Build and run a Python gRPC test client to send an image to a TensorFlow endpoint, validate cat or dog prediction, and align the return type with the gRPC contract.
Develop a full-fledged gRPC API that interfaces with PyTorch and TensorFlow, includes logging and testing, and prepares for containerized deployment.
Learn how to use Docker to containerize two APIs, build Docker files and images, run containers locally, and deploy the application to the cloud.
Containerize your FastAPI app by building a Docker image that includes TensorFlow and PyTorch, copies the models, and installs requirements; expose port 8000 and run for portable production.
Containerize the gRPC API with docker by building a docker file and copying project files. Install requirements, expose port 50,000, and test TensorFlow and PyTorch inferences.
Deploy and test containerized APIs on AWS using ECR and EC2, pushing fast api and gypsy service images, installing docker, and verifying health status in production.
Learn to deploy on Google Cloud by configuring gcloud, using artifact registry, tagging and pushing images, and running a fast API and gRPC services on a Compute Engine VM.
Wrap up the ml ops beginner course by deploying a TensorFlow/PyTorch model in Docker with FastAPI and gRPC on GCP, and discuss scalability and multi-model serving.
ML Ops topped LinkedIn’s Emerging Jobs ranking, with a recorded growth of 9.8 times in five years.
Most individuals looking to enter the data industry possess machine learning skills. However, most data scientists are unable to put the models they build into production. As a result, companies are now starting to see a gap between models and production. Most machine learning models built in these companies are not usable, as they do not reach the end-user’s hands. ML Ops engineering is a new role that bridges this gap and allows companies to productionize their data science models to get value out of them.
This is a rapidly growing field, as more companies are starting to realize that data scientists alone aren’t sufficient to get value out of machine learning models. It doesn’t matter how highly accurate a machine learning model is if it is unusable in a production setting.
Most people looking to break into the data industry tend to focus on data science. It is a good idea to shift your focus to ML Ops since it is an equally high-paying field that isn’t highly saturated yet.
Learn ML Ops from the ground up! ML Ops can be described as the techniques for implementing and automating continuous integration, continuous delivery, and continuous training for machine learning systems. As most of you know, the majority of ML models never see life outside of the whiteboard or Jupyter notebook. This course is the first step in changing that!
Take your ML ideas from the whiteboard to production by learning how to deploy ML models to the cloud! This includes learning how to interact with ML models locally, then creating an API (FastAPI & gRPC), containerize (Docker), and then deploy (AWS & GCP). At the end of this course you will have the foundational knowledge to productionize your ML workflows and models.
Course outline:
1. Introduction
2. Environment set up
3. PyTorch model inference
4. Tensorflow model inference
5. API introduction
6. FastAPI
7. gRPC
8. Containerize our APIs using Docker
9. Deploy containers to AWS
10. Deploy containers to GCP
11. Conclusion