Apache Spark Project for Beginners: A Complete Project Guide
4.1 (36 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
4,899 students enrolled

Apache Spark Project for Beginners: A Complete Project Guide

Real-Time Message Processing Application
4.1 (36 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
4,899 students enrolled
Created by PARI MARGU
Last updated 2/2020
English
Current price: $13.99 Original price: $19.99 Discount: 30% off
5 hours left at this price!
30-Day Money-Back Guarantee
This course includes
  • 2.5 hours on-demand video
  • 4 downloadable resources
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion
Training 5 or more people?

Get your team access to 4,000+ top Udemy courses anytime, anywhere.

Try Udemy for Business
What you'll learn
  • End to End Apache Spark Project Development
  • How Real-Time Streaming Application Works
  • Features of Spark Structured Streaming using Scala
  • How Apache Kafka works well with Apache Spark
  • How to make use of NoSQL like MongoDB and RDBMS like MySQL in Real-Time Streaming Application
  • How to build nice Visualisation Dashboard using Python
Requirements
  • Any basic programming language
  • Basic understanding of Apache Spark
Description

End to End Project Development of Real-Time Message Processing Application: In this Apache Spark Project, we are going to build Meetup RSVP Stream Processing Application using Apache Spark with Scala API, Spark Structured Streaming, Apache Kafka, Python, Python Dash, MongoDB and MySQL. And we are going to build a data pipeline which takes data from stream data source(Meetup Dot Com RSVP Stream API Data) to Data Visualisation using Apache Spark and other big data frameworks.

Who this course is for:
  • Beginners who want to get End to End Apache Spark/Big Data Project Development Process and Architecture
Course content
Expand 7 lectures 02:32:54
+ Apache Spark Project | Real-Time Message Processing Application
7 lectures 02:32:54

Hi Friends, Please find below link for Apache Hadoop, Spark and Hive setup.

Step 1: Install Apache Hadoop - https://youtu.be/FzH7K4N0kT8

Step 2: Install Apache Hive - https://youtu.be/Mi0m78a5W4U

Apache Spark 2.4.4 Installation | Part 1 - https://youtu.be/hXLr1dMWVVE

Apache Spark 2.4.4 Installation | Part 2 - https://youtu.be/690DO_lXkns

Environment Setup | Part 2
18:54
Kafka Producer using Python | Part 3
17:45
Spark Structured Streaming | MongoDB | Part 4
35:07
Spark Structured Streaming | MySQL | Part 5
30:03
Visualisation using Python Dash | Part 6
30:05
Demo | Part 7
10:30