Udemy
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
Development
Web Development Data Science Mobile Development Programming Languages Game Development Database Design & Development Software Testing Software Engineering Development Tools No-Code Development
Business
Entrepreneurship Communications Management Sales Business Strategy Operations Project Management Business Law Business Analytics & Intelligence Human Resources Industry E-Commerce Media Real Estate Other Business
Finance & Accounting
Accounting & Bookkeeping Compliance Cryptocurrency & Blockchain Economics Finance Finance Cert & Exam Prep Financial Modeling & Analysis Investing & Trading Money Management Tools Taxes Other Finance & Accounting
IT & Software
IT Certification Network & Security Hardware Operating Systems Other IT & Software
Office Productivity
Microsoft Apple Google SAP Oracle Other Office Productivity
Personal Development
Personal Transformation Personal Productivity Leadership Career Development Parenting & Relationships Happiness Esoteric Practices Religion & Spirituality Personal Brand Building Creativity Influence Self Esteem & Confidence Stress Management Memory & Study Skills Motivation Other Personal Development
Design
Web Design Graphic Design & Illustration Design Tools User Experience Design Game Design Design Thinking 3D & Animation Fashion Design Architectural Design Interior Design Other Design
Marketing
Digital Marketing Search Engine Optimization Social Media Marketing Branding Marketing Fundamentals Marketing Analytics & Automation Public Relations Advertising Video & Mobile Marketing Content Marketing Growth Hacking Affiliate Marketing Product Marketing Other Marketing
Lifestyle
Arts & Crafts Beauty & Makeup Esoteric Practices Food & Beverage Gaming Home Improvement Pet Care & Training Travel Other Lifestyle
Photography & Video
Digital Photography Photography Portrait Photography Photography Tools Commercial Photography Video Design Other Photography & Video
Health & Fitness
Fitness General Health Sports Nutrition Yoga Mental Health Dieting Self Defense Safety & First Aid Dance Meditation Other Health & Fitness
Music
Instruments Music Production Music Fundamentals Vocal Music Techniques Music Software Other Music
Teaching & Academics
Engineering Humanities Math Science Online Education Social Science Language Teacher Training Test Prep Other Teaching & Academics
AWS Certification Microsoft Certification AWS Certified Solutions Architect - Associate AWS Certified Cloud Practitioner CompTIA A+ Cisco CCNA Amazon AWS CompTIA Security+ Microsoft AZ-900
Graphic Design Photoshop Adobe Illustrator Drawing Digital Painting InDesign Character Design Canva Figure Drawing
Life Coach Training Neuro-Linguistic Programming Personal Development Mindfulness Personal Transformation Life Purpose Meditation CBT Emotional Intelligence
Web Development JavaScript React CSS Angular PHP Node.Js WordPress Vue JS
Google Flutter Android Development iOS Development React Native Swift Dart Programming Language Mobile Development Kotlin SwiftUI
Digital Marketing Google Ads (Adwords) Social Media Marketing Google Ads (AdWords) Certification Marketing Strategy Internet Marketing YouTube Marketing Email Marketing Retargeting
Microsoft Power BI SQL Tableau Business Analysis Data Modeling Business Intelligence MySQL Data Analysis Blockchain
Business Fundamentals Entrepreneurship Fundamentals Business Strategy Business Plan Startup Online Business Freelancing Blogging Home Business
Unity Game Development Fundamentals Unreal Engine C# 3D Game Development C++ 2D Game Development Unreal Engine Blueprints Blender
30-Day Money-Back Guarantee
Development Development Tools Apache Spark

Apache Spark and Scala

A complete Guide for Processing Big Data with Spark
Rating: 3.7 out of 53.7 (142 ratings)
633 students
Created by Insculpt Technologies
Last updated 4/2017
English
English [Auto]
30-Day Money-Back Guarantee

What you'll learn

  • Understand the limitations of Hadoop mapreduce and how Spark overcomes these limitations
  • Gain expertise in Scala programming language and its characteristics
  • Able to work with RDDs' and create applications in Spark
  • A thorough understanding about Spark SQL by using SQL queries in Spark

Course content

12 sections • 67 lectures • 7h 39m total length

  • Preview03:27
  • Preview02:29
  • Preview05:00
  • Preview03:33
  • Preview05:12
  • Preview02:44
  • 1.7 Users and Use Cases of Apache Spark
    07:45
  • 1.8 Job Execution Flow and Spark Execution
    01:12
  • 1.9 Spark Unified Stack
    01:08
  • 1.10 Complete Picture of Apache Spark
    06:37
  • 1.11 Why Spark with Scala
    02:12
  • 1.12 Apache spark Architecture
    02:16

  • 2.1 Introduction to Scala
    10:15
  • 2.2 Scala Basic Syntax
    05:11
  • 2.3 Scala Class and Objects
    04:03
  • 2.4 If else Statements in Scala
    08:31
  • 2.5 Loops in Scala
    09:32

  • 3.1 Functions and Procedures in Scala
    08:19
  • 3.2 Access Modifiers
    06:25
  • 3.3 Strings and Arrays
    10:45
  • 3.4 Scala Collections
    14:29
  • 3.5 Scala Traits
    03:58
  • 3.6 Pattern Matching
    07:25
  • 3.7 Scala Extractors
    05:41
  • 3.8 Scala Exception Handling
    03:29
  • 3.9 Scala Files IO
    09:26

  • 4.1 Programming with RDDs
    02:33
  • 4.2 Starting with Spark
    02:16
  • 4.3 Creating RDDs
    02:10
  • 4.4 RDD Operations
    03:36
  • 4.5 Lifecycle of Spark
    01:41

  • 5.1 Spark Caching
    03:12
  • 5.2 Common Transformations and Actions
    06:03
  • 5.3 Spark Functions
    13:56
  • 5.4 Some more Spark functions
    10:15

  • 6.1 Key Value Pairs
    05:24
  • 6.2 Aggregate Functions
    10:55
  • 6.3 Working with Aggregate Functions
    20:01
  • 6.4 Joins in Spark
    18:44
  • 6.5 Practical on Word count example
    07:38

  • 7.1 Spark Shared Variables
    13:47
  • 7.2 Spark and Fault Tolerance
    01:53
  • 7.3 Broadcast variables
    11:16
  • 7.4 Numeric RDD Operations
    03:18
  • 7.5 Per-Partition Operations
    11:23

  • 8.1 Spark Runtime Architecture
    02:45
  • 8.2 Spark Driver
    03:41
  • 8.3 Executors
    01:07
  • 8.4 Cluster Managers
    06:11
  • 8.5 Cluster Managers II
    03:14

  • 9.1 Introduction to Spark SQL
    04:59
  • 9.2 Starting Point-SQL Context
    07:42
  • 9.3 Hive with Spark SQL
    10:20
  • 9.4 Spark SQL Caching
    10:28

  • People.json, Employee.json
    00:01

Requirements

  • Prior knowledge of Apache Hadoop will be an added advantage, but not compulsory
  • Fundamental understanding of any programming language

Description

This course on Apache Spark and Scala aims at providing an advanced expertise in big data Hadoop ecosystem. This course will provide a standard skillset which helps one become a specialist on the top of Big data Hadoop developer. 

The course starts with a detailed description on limitations of mapreduce and how Spark can help overcome them. Further it covers a deeper dive into the Scala programming language.

Moving on it covers Spark as a standalone cluster and an understanding of Resiliient Distributed Datasets.

The course also covers concepts of Spark SQL using SQL queries through SQL context and Hive Queries through Hive context.

This course certainly provides material required for building a career path from Big data Hadoop developer to BIg data Hadoop architect.


Who this course is for:

  • Students who aspire to gain a deep understanding of Apache Spark
  • Professionals looking for a career in real time big data analytics
  • Big Data and Hadoop Developers who want to analyze data faster

Instructor

Insculpt Technologies
Engraving Intelligence
Insculpt Technologies
  • 3.6 Instructor Rating
  • 3,192 Reviews
  • 39,709 Students
  • 10 Courses

Insculpt technologies is a leading publisher of development courses which provide in-depth knowledge and high quality training.  Insculpt technologies is serving with a mission of providing right direction to  people who are looking for a career in IT/software industry. Insculpt is the best place for learning  new technologies and making things easy to understand virtually.

  • Udemy for Business
  • Teach on Udemy
  • Get the app
  • About us
  • Contact us
  • Careers
  • Blog
  • Help and Support
  • Affiliate
  • Impressum Kontakt
  • Terms
  • Privacy policy
  • Cookie settings
  • Sitemap
  • Featured courses
Udemy
© 2021 Udemy, Inc.