Udemy
    •  
    •  
    •  
    •  
    •  
    •  
    •  
    •  
Turn what you know into an opportunity and reach millions around the world.
Learn More
Your cart is empty.
Keep shopping
Apache Spark In-Depth (Spark with Scala)
Rating: 4.6 out of 5(529 ratings)
31,282 students

Apache Spark In-Depth (Spark with Scala)

Apache Spark In-Depth (Spark with Scala)
Created byHarish Masand
Last updated 11/2023
English

What you'll learn

  • Apache Spark from scratch to in-depth, starting from simple word count program to Batch Processing to Spark Structure Streaming, Performance Tuning, Optimization, Application Development and Deployment.
  • Completing this course will also make you ready for most interview questions
  • Includes Optional Project and path to success

Course content

1 section27 lectures40h 41m total length
  • Introduction to Data Engineering Career Path1:46
  • Day 1 - Introduction to Spark2:00:41
  • Day 2 - Introduction to Spark1:43:46
  • Day 3 - Spark Installation on Linux VM1:54:14
  • Day 4 - RDD Day 11:51:13
  • Day 5 - RDD Day 22:06:03
  • Day 6 - RDD Day 32:01:10
  • Day 7 - RDD Day 41:38:26
  • Day 8 - RDD Day 51:34:49
  • Day 9 - Dataframe Day 11:30:38
  • Day 10 - Dataframe Day 22:21:41
  • Day 11 - Dataframe Day 31:32:24
  • Day 12 - Dataframe Day 42:00:26
  • Day 13 - Dataframe Day 51:40:25
  • Day 14 - Dataframes Day 61:41:14
  • Day 15 - Dataframes - Spark SQL2:04:43
  • Day 16 - Datasets51:48
  • Day 17 - Spark Application Development and Deployment2:04:46
  • Day 18 - Spark Application Development and Deployment1:55:15
  • Day 19 - Performance Tuning and Optimization1:17:15
  • Day 20 - Common Errors and Debugging1:13:23
  • Day 21 - Spark Streaming D 149:34
  • Day 22 - Spark Streaming D 21:52:49
  • Day 23 - Spark Streaming D 31:35:24
  • Day 24 - Project47:46
  • Day 25 - What Next, Job Assistance and How to Prepare for Interview27:13
  • Career Guidance2:50

Requirements

  • No Pre-requisite required. Curiosity to learn new technology.
  • Good to know: Hadoop Basics and Scala Basics.
  • Excellent if you have completed my below 2 data engineering courses: "Big Data Hadoop and Spark with Scala" and "Scala Programming In-Depth"

Description

Learn Apache Spark From Scratch To In-Depth


From the instructor of successful Data Engineering courses on "Big Data Hadoop and Spark with Scala" and "Scala Programming In-Depth"


  • From Simple program on word count to Batch Processing to Spark Structure Streaming.

  • From Developing and Deploying Spark application to debugging.

  • From Performance tuning, Optimization to Troubleshooting


Contents all you need for in-depth study of Apache Spark and to clear Spark interviews.


Taught in very simple English language so any one can follow the course very easily.


No Prerequisites, Good to know basics about Hadoop and Scala


Perfect place to start learning Apache Spark


Apache Spark is a unified analytics engine for big data processing, with built-in modules for streaming, SQL, machine learning and graph processing.


Speed

Run workloads 100x faster.

Apache Spark achieves high performance for both batch and streaming data, using a state-of-the-art DAG scheduler, a query optimizer, and a physical execution engine.


Ease of Use

Write applications quickly in Java, Scala, Python, R, and SQL.

Spark offers over 80 high-level operators that make it easy to build parallel apps. And you can use it interactively from the Scala, Python, R, and SQL shells.


Generality

Combine SQL, streaming, and complex analytics.

Spark powers a stack of libraries including SQL and DataFrames, MLlib for machine learning, GraphX, and Spark Streaming. You can combine these libraries seamlessly in the same application.


Runs Everywhere

Spark runs on Hadoop, Apache Mesos, Kubernetes, standalone, or in the cloud. It can access diverse data sources.


Who this course is for:

  • People looking to advance their career in Data Engineering, Big Data, Hadoop, Spark
  • Already working on Big Data Hadoop/ Spark and want to clear the concepts