Udemy
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
Development
Web Development Data Science Mobile Development Programming Languages Game Development Database Design & Development Software Testing Software Engineering Development Tools No-Code Development
Business
Entrepreneurship Communications Management Sales Business Strategy Operations Project Management Business Law Business Analytics & Intelligence Human Resources Industry E-Commerce Media Real Estate Other Business
Finance & Accounting
Accounting & Bookkeeping Compliance Cryptocurrency & Blockchain Economics Finance Finance Cert & Exam Prep Financial Modeling & Analysis Investing & Trading Money Management Tools Taxes Other Finance & Accounting
IT & Software
IT Certification Network & Security Hardware Operating Systems Other IT & Software
Office Productivity
Microsoft Apple Google SAP Oracle Other Office Productivity
Personal Development
Personal Transformation Personal Productivity Leadership Career Development Parenting & Relationships Happiness Esoteric Practices Religion & Spirituality Personal Brand Building Creativity Influence Self Esteem & Confidence Stress Management Memory & Study Skills Motivation Other Personal Development
Design
Web Design Graphic Design & Illustration Design Tools User Experience Design Game Design Design Thinking 3D & Animation Fashion Design Architectural Design Interior Design Other Design
Marketing
Digital Marketing Search Engine Optimization Social Media Marketing Branding Marketing Fundamentals Marketing Analytics & Automation Public Relations Advertising Video & Mobile Marketing Content Marketing Growth Hacking Affiliate Marketing Product Marketing Other Marketing
Lifestyle
Arts & Crafts Beauty & Makeup Esoteric Practices Food & Beverage Gaming Home Improvement Pet Care & Training Travel Other Lifestyle
Photography & Video
Digital Photography Photography Portrait Photography Photography Tools Commercial Photography Video Design Other Photography & Video
Health & Fitness
Fitness General Health Sports Nutrition Yoga Mental Health Dieting Self Defense Safety & First Aid Dance Meditation Other Health & Fitness
Music
Instruments Music Production Music Fundamentals Vocal Music Techniques Music Software Other Music
Teaching & Academics
Engineering Humanities Math Science Online Education Social Science Language Teacher Training Test Prep Other Teaching & Academics
AWS Certification Microsoft Certification AWS Certified Solutions Architect - Associate AWS Certified Cloud Practitioner CompTIA A+ Cisco CCNA Amazon AWS CompTIA Security+ Microsoft AZ-900
Graphic Design Photoshop Adobe Illustrator Drawing Digital Painting InDesign Character Design Canva Figure Drawing
Life Coach Training Neuro-Linguistic Programming Personal Development Mindfulness Personal Transformation Life Purpose Meditation CBT Emotional Intelligence
Web Development JavaScript React CSS Angular PHP Node.Js WordPress Vue JS
Google Flutter Android Development iOS Development React Native Swift Dart Programming Language Mobile Development Kotlin SwiftUI
Digital Marketing Google Ads (Adwords) Social Media Marketing Google Ads (AdWords) Certification Marketing Strategy Internet Marketing YouTube Marketing Email Marketing Retargeting
Microsoft Power BI SQL Tableau Business Analysis Data Modeling Business Intelligence MySQL Data Analysis Blockchain
Business Fundamentals Entrepreneurship Fundamentals Business Strategy Business Plan Startup Online Business Freelancing Blogging Home Business
Unity Game Development Fundamentals Unreal Engine C# 3D Game Development C++ 2D Game Development Unreal Engine Blueprints Blender
30-Day Money-Back Guarantee
Development Software Engineering Apache Spark

Apache Spark With Examples for Big Data Analytics

In-depth course to master Spark SQL & Spark Streaming using Scala for Big Data (with lots real-world examples)
Rating: 2.5 out of 52.5 (114 ratings)
2,215 students
Created by Code Peekers
Last updated 3/2018
English
30-Day Money-Back Guarantee

What you'll learn

  • Get clear understanding of the limitations of MapReduce and role of Spark in overcoming these limitations
  • Understand fundamentals of Scala Programming Language and it’s features
  • Expertise in using RDD for creating applications in Spark
  • Mastering SQL queries using SparkSQL
  • Gain thorough understanding of Spark Streaming features

Course content

8 sections • 42 lectures • 3h 52m total length

  • Preview04:13
  • Environment Setup
    02:18
  • Preview12:08
  • Flow Controls
    07:50
  • Functions and operators
    11:08
  • OOPS concepts
    16:20
  • Preview04:04
  • Arrays
    03:41
  • Collections
    16:22

  • BigData and Need for Apache Spark
    09:02
  • What is Spark,Spark Features and Spark Eco System
    03:19
  • Spark Architecture
    05:27
  • Spark Usecases
    01:23

  • Setup Environment
    01:16
  • Word Count Program in Spark
    04:17

  • What is RDD & How to Create
    05:00
  • Transformations - filter & map
    04:14
  • Solving Cars By Mileage problem using map and filter transformations
    04:19
  • Solving Cars In America problem using map and filter transformations
    03:00
  • Transformations - flatmap,union & intersection
    03:53
  • Analysis on 2014 football world cup player information
    04:40
  • RDD Actions
    10:10
  • Nasa Access Logs Analysis
    01:38

  • Pair RDD - How to Create,reduceByKey
    13:30
  • groupByKey and reduceBykey vs groupByKey
    07:15
  • Transformations - mapvalues sortbykey countbykey
    03:48
  • Analysis on 2015 Indian Startup funding information
    05:37
  • Analysis on real estate data using pair rdd operations
    03:50
  • Join Operations
    03:30

  • Broadcast Variables
    05:16
  • Accumulators
    02:50
  • Persistence and Caching
    02:19
  • Partitioning
    03:36

  • What is Spark SQL
    02:50
  • DataFrames
    07:40
  • DataSets
    07:32
  • Ebay Auction Data Analysis
    02:53
  • Adhaar Data Analysis
    03:23

  • What is Spark Streaming?
    04:57
  • DStreams
    06:16
  • Spark Streaming Example
    03:49
  • Twitter Sentiment Analysis
    02:26

Requirements

  • Basic programming skills
  • A computer running Windows, OSX or Linux
  • The software needed for this course is freely available and detailed steps to install and configure software is include in the course

Description

This course covers all the fundamentals you need to write complex Spark applications. By the end of this course you will get in-depth knowledge on Spark core,Spark SQL,Spark Streaming.

This course is divided into 9 modules

  1. Dive Into Scala - Understand the basics of Scala that are required for programming Spark applications.Learn about the basic constructs of Scala such as variable types, control structures, collections,and more.
  2. OOPS and Functional Programming in Scala - Learn about object oriented programming and functional programming techniques in Scala
  3. Introduction to Apache Spark - Learn Spark Architecture,Spark Components and spark use-cases
  4. Spark Basics - Learn how to configure/run spark in eclipse/intellij
  5. Working with RDDs in Spark - Learn what is Resilient Distributed Dataset,Different types of actions and transformations which can be applied on RDDs
  6. Aggregating Data with Pair RDDs - Learn how Pair RDD is different from RDD,Different types of actions and transformations which can be applied on Pair RDDs
  7. Advanced Spark Concepts - Learn how Spark uses Broadcast variables and Accumulators to perform calculations,how persistence and partitioning helps to achieve performance
  8. Spark SQL and Data Frames - Understand the difference between Dataframe and Dataset
  9. Spark Streaming - Learn how to analyse massive amount of dataset on the fly

All the concepts are explained using hands-on examples.This course covers 10+ hands-on big data examples such as

  • Explore player data from 2014 world cup
  • Agregate data from ebay online auction data
  • Understand different data points from Adhaar data
  • Develop application to analyse funds received by Indian startup
  • Explore the price trend by looking at the real estate data in California
  • Help retailer to find out valid and invalid purchase transactions of chain of stores in Bangalore
  • Write Spark program find out count of stores in each US region from USA states & Store locations data
  • Develop Spark Streaming application to perform Twitter Sentiment Analysis

30-day Money-back Guarantee! You will get 30-day money-back guarantee from Udemy for this course. 

If not satisfied simply ask for a refund within 30 days. You will get a full refund. No questions whatsoever asked.



Who this course is for:

  • Professionals aspiring for a career in field of real time Big data analytics
  • Analytics professionals
  • Senior IT Professionals
  • Developers and Architects
  • Students who wish to gain a thorough understanding of Apache Spark
  • Freshers
  • Software Architects, Engineers and Developers

Instructor

Code Peekers
Peek Into Success Through Code
Code Peekers
  • 2.5 Instructor Rating
  • 114 Reviews
  • 2,215 Students
  • 1 Course

We are group of engineers working in MNCs working big data applications involving peta bytes of data. We started this learning portal to help learners to dive into big data world easily.

Our aim is to provide good learning experience content with affordable pricing.

We have teaching experience of 1000+ hours offline. We are trying expand our presence in online world.

We are hoping that our lectures will help you to perform well in your career.

  • Udemy for Business
  • Teach on Udemy
  • Get the app
  • About us
  • Contact us
  • Careers
  • Blog
  • Help and Support
  • Affiliate
  • Impressum Kontakt
  • Terms
  • Privacy policy
  • Cookie settings
  • Sitemap
  • Featured courses
Udemy
© 2021 Udemy, Inc.