Apache Spark 3 - Spark Programming in Python for Beginners

Name: Apache Spark 3 - Spark Programming in Python for Beginners
Rating: 4.5 (4825 reviews)

Data Engineering using Spark Structured API

(4,825 ratings)

27,524 students

Created by Prashant Kumar Pandey, Learning Journal

Last updated 1/2023

English

English, French [Auto],

What you'll learn

Apache Spark Foundation and Spark Architecture
Data Engineering and Data Processing in Spark
Working with Data Sources and Sinks
Working with Data Frames and Spark SQL
Using PyCharm IDE for Spark Development and Debugging
Unit Testing, Managing Application Logs and Cluster Deployment

Requirements

Programming Knowledge Using Python Programming Language
A Recent 64-bit Windows/Mac/Linux Machine with 8 GB RAM

Description

This course does not require any prior knowledge of Apache Spark or Hadoop. We have taken enough care to explain Spark Architecture and fundamental concepts to help you come up to speed and grasp the content of this course.

About the Course

I am creating Apache Spark 3 - Spark Programming in Python for Beginners course to help you understand the Spark programming and apply that knowledge to build data engineering solutions. This course is example-driven and follows a working session like approach. We will be taking a live coding approach and explain all the needed concepts along the way.

Who should take this Course?

I designed this course for software engineers willing to develop a Data Engineering pipeline and application using the Apache Spark. I am also creating this course for data architects and data engineers who are responsible for designing and building the organization’s data-centric infrastructure. Another group of people is the managers and architects who do not directly work with Spark implementation. Still, they work with the people who implement Apache Spark at the ground level.

Spark Version used in the Course

This Course is using the Apache Spark 3.x. I have tested all the source code and examples used in this Course on Apache Spark 3.0.0 open-source distribution.

Who this course is for:

Software Engineers and Architects who are willing to design and develop a Bigdata Engineering Projects using Apache Spark
Programmers and developers who are aspiring to grow and learn Data Engineering using Apache Spark

Featured review

PyDoo ?.

526 courses

100 reviews

2 years ago

Amazing course on PySpark (5/5). Highly recommended. My personal request to the instructor to add lectures on "PySpark streaming" (or) to provide it as a separate course. In most of the companies, they use pyspark as opposed to spark-scala, because python is easy to learn. Hence requesting the instructor to come up with spark streaming using python Really thankful to the instructor for this course.

Prashant Kumar Pandey

Architect, Author, Consultant, Trainer @ Learning Journal

4.6 Instructor Rating
15,026 Reviews
85,447 Students
12 Courses

Prashant Kumar Pandey is passionate about helping people to learn and grow in their career by bridging the gap between their existing and required skills. In his quest to fulfill this mission, he is authoring books, publishing technical articles, and creating training videos to help IT professionals and students succeed in the industry.

With over 18 years of experience in IT as a developer, architect, consultant, trainer, and mentor, he has worked with international software services organizations on various data-centric and Bigdata projects.

Prashant is a firm believer in lifelong continuous learning and skill development. To popularize the importance of lifelong continuous learning, he started publishing free training videos on his YouTube channel and conceptualized the idea of creating a Journal of his learning under the banner of Learning Journal.

He is the founder, lead author, and chief editor of the Learning Journal portal that offers various skill development courses, training, and technical articles since the beginning of the year 2018.

Learning Journal

Online Training Company

4.6 Instructor Rating
15,026 Reviews
85,469 Students
12 Courses

Learning Journal is a small team of people passionate about helping others learn and grow in their careers by bridging the gap between their existing and required skills. In our quest to fulfill this mission, we are authoring books, publishing technical articles, and creating training videos to help IT professionals and students succeed in the industry.

Together we have over 40+ years of experience in IT as a developer, architect, consultant, trainer, and mentor. We have worked with international software services organizations on various data-centric and Bigdata projects.

Learning Journal is a team of firm believers in lifelong continuous learning and skill development. To popularize the importance of lifelong continuous learning, we started publishing free training videos on our YouTube channel. We conceptualized the notion of continuous learning, creating a journal of our learning under the Learning Journal banner.

We authored various skill development courses, training, and technical articles since the beginning of the year 2018.