IT & Software Other Apache Spark

Spark Starter Kit

NOT another "What is Spark?" course ! Explore Spark in depth and get a strong foundation in Spark.
Free tutorial
Rating: 4.6 out of 5 (3,119 ratings)
43,175 students
Created by Hadoop In Real World
Enroll now
Spark Starter Kit
Free tutorial
Rating: 4.6 out of 5 (3,119 ratings)
43,175 students
Buy now
Learn about the similarities and differences between Spark and Hadoop.
Explore the challenges Spark tries to address, you will give you a good idea about the need for spark.
Learn “How Spark is faster than Hadoop?”, you will understand the reasons behind Spark’s performance and efficiency.
Before we talk about what is RDD, we explain in detail what is the need for something like RDD.
You will get a strong foundantion in understanding RDDs in depth and then we take a step further to point out and clarify some of the common misconceptions about RDD among new Spark learners.
You will understand the types of dependencies between RDD and more importantly we will see why dependencies are important.
We will walk you through step by step how the program we write gets translated in to actual execution behind the scenes in a Spark cluster.
You will get a very good understanding of some of the key concepts behind Spark’s execution engine and the reasons why it is efficient.
Master fault tolerance by simulating a fault situation and examine how Spark recover from it.
You will learn how memory and the contents in memory are managed by spark.
Understand the need for a new programming language like Scala.
Examine object oriented programming vs. functional programming.
Explore Scala's features and functions.

Requirements

  • Basic Hadoop concepts. Don't know Hadoop ? Don't worry, sign up for our free Hadoop Starter Kit course.
Description

When our students asked us to create a course on Spark, we looked at other Spark related courses in the market and also what are some of the common questions students are asking in websites like stackoverflow and other forums when they try to learn Spark and we saw a recurring theme.

Most courses and other online help including Spark's documentation is not good in helping students understand the foundational concepts. They explain what is Spark, what is RDD, what is "this" and what is "that" but students were most interested in understanding core fundamentals and more importantly answer questions like - 

  1. Why do we need Spark when we have Hadoop ? 
  2. What is the need for RDD ?
  3. How Spark is faster than Hadoop?
  4. How Spark achieves the speed and efficiency it claims ?
  5. How does memory gets managed in Spark?
  6. How fault tolerance work in Spark ?

and that is exactly what you will learn in this free Spark Starter Kit course. The aim of this course is to give you a strong foundation in Spark.

Who this course is for:
  • Anyone who is interested in distributed systems and computing and big data related technologies.
Course content
6 sections • 17 lectures • 3h 17m total length
  • Let's get started
    05:43
  • Running Spark on your computer
    06:33
  • Spark vs. Hadoop - who wins ?
    15:30
  • Challenges Spark tries to address
    12:24
  • How Spark is faster than Hadoop ?
    08:39
  • The need for RDD
    11:29
  • What is RDD ?
    12:30
  • What an RDD is not
    07:31
  • First program in Spark
    16:04
  • What are dependencies & why they are important ?
    11:11
  • Program to Execution (Part 1)
    13:01
  • Program to Execution (Part 2)
    19:10
  • Memory management
    15:04
  • Fault tolerance
    07:34
  • Introduction to Scala
    12:05
  • First program in Scala (not Hello World)
    11:45
  • Scala functions
    11:43

Featured review

Shifali
Shifali
2 courses
1 review
Rating: 5.0 out of 52 months ago
The details are told in detail are very clear. I would like to download this course and keep for future reference. The way everything is being explained is awesome. It will great if other spark topics are also explained the way RDDs, dependencies are explained.

Instructor
Hadoop In Real World
Expert Big Data Consultants
Hadoop In Real World
  • 4.5 Instructor Rating
  • 19,014 Reviews
  • 181,279 Students
  • 3 Courses

We are a group of Senior Hadoop Consultants who are passionate about Hadoop and Big Data technologies. We have experience across several key domains from finance and retail to social media and gaming. We have worked with Hadoop clusters ranging from 50 all the way to 800 nodes.

We have been teaching Hadoop for several years now. Check out our FREE and successful Hadoop Starter Kit course at Udemy.