Udemy
    •  
    •  
    •  
    •  
    •  
    •  
    •  
    •  
Turn what you know into an opportunity and reach millions around the world.
Learn More
Your cart is empty.
Keep shopping
Automated Machine Learning Pipeline with Mesos
Rating: 3.3 out of 5(6 ratings)
51 students

Automated Machine Learning Pipeline with Mesos

Build an automated machine learning pipeline with Mesos
Last updated 12/2017
English
English [Auto],

What you'll learn

  • Set up Mesos with Vagrant in CentOS 7
  • Understand job scheduling and reconciliation
  • Learn about multi-tenancy
  • Build real-time dashboards with Node,js and React js using Webpack
  • Understand concurrent data pruning
  • Extract components using React js

Course content

9 sections42 lectures3h 50m total length
  • The Course Overview2:33

    This video provides an overview of the entire course.

  • Workflow orchestration - A brief introduction to Airflow1:40
  • Challenges8:02

    This video covers the main guideline principles of Mesos and Machine Learning.

    • Learn the importance of Machine Learning
    • Discover how Mesos can facilitate hyper parameter ensemble using trees

  • Workflow Orchestration: Artifacts and First-Class Citizens3:30
  • Mesos with Vagrant Setup with Centos-710:05

    In this video, we will look at the concerns that need to be addressed when it comes to resources and portability.

    • Provision the Vagrant file with Centos-7.1
    • Deploy the Mesos cluster by executing the VagrantFile
    • Open the Mesos GUI to visually, track the performance of the cluster we just deployed

  • Learning from Trees

Requirements

  • Should have knowledge of Data Science

Description

Mesos, with its semi-centralized infrastructure, sustains the skeleton of Silicon Valley’s Netflix (Fezo), Airbnb (Airflow), Heroku, and Apple to name a few, and has established itself as a staple in any automated machine learning pipeline and distributed heterogeneous data pruning.

In this course, we will learn the foundation of Mesos within the automated pipeline on fault-tolerant cluster semaphores. We will set up a virtual cluster running Marathon and Zookeeper and a concurrent Docker application. We will establish a master-slave infrastructure, experience real-time debugging, and learn how to automate cluster arbitration via Soliton automata. We will then see an iterative queue manager for indexed tasks dispatched concurrently inside a poset topology.

About The Author

Karl Whitford has been involved in the tech industry for 10 years as a software engineer. He has a background in statistical machine learning, deep learning, and A.I. from Columbia University. He also has knowledge of computational physics/mathematics from DePaul University and UT Austin. He is a professional in the fields of game A.I, compression, machine learning, and distributed cluster computing. Karl is an open source contributor to SMACK, Pancake Stack (PipelineI/O), and Pregel-Mesos, among others. He has previous work experience with Microsoft, Coca Cola, and Unilever to name a few; he is also an indie game developer and founder of Esquirel (Black-Squirrel) Studios in San Francisco, California. He was also handpicked by UploadVR as "one to watch" and featured at Mountain View’s 2016 VR Showcase.

Who this course is for:

  • This course is targeted at data science professionals looking to get started with Mesos to integrated it in their machine learning pipeline.