Udemy
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
Development
Web Development Data Science Mobile Development Programming Languages Game Development Database Design & Development Software Testing Software Engineering Development Tools No-Code Development
Business
Entrepreneurship Communications Management Sales Business Strategy Operations Project Management Business Law Business Analytics & Intelligence Human Resources Industry E-Commerce Media Real Estate Other Business
Finance & Accounting
Accounting & Bookkeeping Compliance Cryptocurrency & Blockchain Economics Finance Finance Cert & Exam Prep Financial Modeling & Analysis Investing & Trading Money Management Tools Taxes Other Finance & Accounting
IT & Software
IT Certification Network & Security Hardware Operating Systems Other IT & Software
Office Productivity
Microsoft Apple Google SAP Oracle Other Office Productivity
Personal Development
Personal Transformation Personal Productivity Leadership Career Development Parenting & Relationships Happiness Esoteric Practices Religion & Spirituality Personal Brand Building Creativity Influence Self Esteem & Confidence Stress Management Memory & Study Skills Motivation Other Personal Development
Design
Web Design Graphic Design & Illustration Design Tools User Experience Design Game Design Design Thinking 3D & Animation Fashion Design Architectural Design Interior Design Other Design
Marketing
Digital Marketing Search Engine Optimization Social Media Marketing Branding Marketing Fundamentals Marketing Analytics & Automation Public Relations Advertising Video & Mobile Marketing Content Marketing Growth Hacking Affiliate Marketing Product Marketing Other Marketing
Lifestyle
Arts & Crafts Beauty & Makeup Esoteric Practices Food & Beverage Gaming Home Improvement Pet Care & Training Travel Other Lifestyle
Photography & Video
Digital Photography Photography Portrait Photography Photography Tools Commercial Photography Video Design Other Photography & Video
Health & Fitness
Fitness General Health Sports Nutrition Yoga Mental Health Dieting Self Defense Safety & First Aid Dance Meditation Other Health & Fitness
Music
Instruments Music Production Music Fundamentals Vocal Music Techniques Music Software Other Music
Teaching & Academics
Engineering Humanities Math Science Online Education Social Science Language Teacher Training Test Prep Other Teaching & Academics
AWS Certification Microsoft Certification AWS Certified Solutions Architect - Associate AWS Certified Cloud Practitioner CompTIA A+ Cisco CCNA Amazon AWS CompTIA Security+ AWS Certified Developer - Associate
Graphic Design Photoshop Adobe Illustrator Drawing Digital Painting InDesign Character Design Canva Figure Drawing
Life Coach Training Neuro-Linguistic Programming Personal Development Mindfulness Meditation Personal Transformation Life Purpose Emotional Intelligence Neuroscience
Web Development JavaScript React CSS Angular PHP WordPress Node.Js Python
Google Flutter Android Development iOS Development Swift React Native Dart Programming Language Mobile Development Kotlin SwiftUI
Digital Marketing Google Ads (Adwords) Social Media Marketing Google Ads (AdWords) Certification Marketing Strategy Internet Marketing YouTube Marketing Email Marketing Google Analytics
SQL Microsoft Power BI Tableau Business Analysis Business Intelligence MySQL Data Modeling Data Analysis Big Data
Business Fundamentals Entrepreneurship Fundamentals Business Strategy Online Business Business Plan Startup Blogging Freelancing Home Business
Unity Game Development Fundamentals Unreal Engine C# 3D Game Development C++ 2D Game Development Unreal Engine Blueprints Blender
30-Day Money-Back Guarantee
Development Development Tools Apache Spark

Apache Spark with Databricks

Course to implement Big Data's Apache Spark on Databricks using a Microsoft's cloud service - Azure
Rating: 3.6 out of 53.6 (274 ratings)
1,083 students
Created by Big Data Trunk
Last updated 9/2019
English
English [Auto]
30-Day Money-Back Guarantee

What you'll learn

  • This course will provide you an in depth knowledge of apache Spark and how to work with spark using Azure Databricks.
  • You will learn to Provision your own Databricks workspace using Azure cloud.
  • You will be able to create application on Azure Databricks after completing the course
  • You will be able to process continual streams of data with Spark streaming using azure event Hub
  • Transform structured data using SparkSQL and Dataframes
  • Build a binary classification application using the Mlib pipelines API.

Course content

7 sections • 34 lectures • 3h 0m total length

  • Preview02:30
  • Big Data trunk Introduction !!
    02:34

  • Preview11:42
  • Big Data After Spark
    07:30
  • Introduction to Apache Spark
    04:11
  • Spark - RDD
    06:01
  • Lab - Ways for creating RDD
    06:32
  • Quiz: Spark Introduction
    4 questions
  • Spark Application Architecture
    04:52
  • Spark Operations - Transformation & Action
    07:18
  • Lab - Transformation & Action
    07:42
  • DAG (Direct Acyclic Graph)
    09:20
  • Quiz-2
    1 question

  • Spark Databricks Analytics in Azure
    06:36
  • Why Databricks ?
    05:24
  • Provisioning Databricks workspace in Azure portal
    03:15
  • Using Databricks community Edition
    04:34
  • Quiz-3
    2 questions

  • Use notebook in Databricks
    03:18

  • Spark SQL
    08:01
  • Quiz-4
    2 questions
  • Developing Spark application
    10:28
  • Removing Stopwords
    02:00
  • Developing Spark ML application
    14:06
  • Developing Spark Streaming applications (real time Twitter Data)
    07:47
  • Optimizing Spark Performance
    10:06
  • Quiz-5
    1 question

  • Preview03:50
  • Spark Core
    01:59
  • Something more about RDD
    05:43
  • Type Safety in Dataset
    03:16
  • Justify Lazy Evaluation in Spark
    02:15
  • Explain Fault Tolerance in Spark
    05:44
  • Coalesce and Repartition
    02:57
  • Spark Executor Memory
    01:06
  • Garbage Collection Optimization in Spark
    06:33
  • Learn More on Spark Interview
    00:06

  • Thanks You looking way forward !!
    00:40
  • Bonus Lecture
    00:21

Requirements

  • Some Prior scripting knowledge, anyways we will be explainig all the codes line by line whichever we will be using in our labs
  • Free or paid subscription for Microsoft Azure portal.

Description

In this course you will learn the basics of creating Spark jobs, loading data, and working with data. You’ll also get an introduction to running machine learning algorithms and working with streaming data. Databricks lets you start writing Spark queries instantly so you can focus on your data problems.

Azure Databricks accelerate big data analytics and artificial intelligence (AI) solutions, a fast, easy and collaborative Apache Spark–based analytics service.

Why Azure Databricks?

Productive : Launch your new Apache Spark environment in minutes.

Scalable : Globally scale your analytics and machine learning projects.

Trusted : Help protect your data and business with Azure AD integration, role-based controls and enterprise-grade SLAs.

Flexible : Build machine learning and AI solutions with your choice of language and deep learning frameworks.


We believe that when you learn something, you should be able to apply it somewhere. So, in this course, we are also providing you with some of the important spark interview questions , which will help you to crack the interview with flying colors.

Who this course is for:

  • Anyone who wants to learn Spark using Azure Databricks

Instructor

Big Data Trunk
All about Big Data and Hadoop
Big Data Trunk
  • 3.9 Instructor Rating
  • 2,130 Reviews
  • 45,612 Students
  • 8 Courses

Big Data Trunk is the leading Big Data focus consulting and training firm founded by industry veterans in data domain. It helps is customer gain competitive advantage from open source, big data, cloud and advanced analytics. It provides services like Strategy Consulting, Advisory Consulting and high quality classroom individual and corporate training.

  • Udemy for Business
  • Teach on Udemy
  • Get the app
  • About us
  • Contact us
  • Careers
  • Blog
  • Help and Support
  • Affiliate
  • Impressum Kontakt
  • Terms
  • Privacy policy
  • Cookie settings
  • Sitemap
  • Featured courses
Udemy
© 2021 Udemy, Inc.