Apache Spark Core 3.0 In-Depth
What you'll learn
- Apache spark in detail with focus on hands-on and the underlying concepts. Learners will get to know the ways to get the best performance from Spark in production and avoid the common pitfalls.
Requirements
- We'll be using Python API in Spark Programming. However, we'll explain all the programs in details but fundamental knowledge of Python will be beneficial.
Description
Apache Spark has turned out to be the most sought-after skill for any big data engineer. An evolution of MapReduce programming paradigm, Spark provides unified data processing from writing SQL to performing graph processing to implementing Machine Learning algorithms. It effectively uses cluster nodes and better memory management to spread the load across cluster of nodes to get faster results. Apache Spark drives the mission of data-driven-decision-making in thousands of organizations.
In order to fairly appreciate the benefits of the libraries of Apache Spark, it is essential to know the foundations right. This course aims exactly at that part. It starts from the beginner level and gradually explains all the complex concepts in an easy to reflect manner. It gives a profound description of the features and working of the framework through 5 different use cases with detailed hands on implementations. In fact, some hands-on sessions and solutions to the use-cases are explained in a full classroom mode with videos extending over 40 mins. After taking this course, you will gain the expertise on Spark Core and usage of further libraries like Spark SQL, Structured Streaming, Spark ML and GraphX will be much easier to visualize, implement and optimize.
Who this course is for:
- Data engineers and developers who wish to leverage the fast analytics using Apache Spark in production environments.
Course content
- Preview11:41
- Preview22:09
Instructor
![Amit Ranjan](data:image/svg+xml,%3Csvg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 64 64"%3E%3C/svg%3E){kind=avatar}
- 4.4 Instructor Rating
- 42 Reviews
- 290 Students
- 2 Courses
With over 8 years of industry experience in distributed computation, Amit is involved in a variety of big data engineering projects across different domains. He is a certified Hadoop Developer with skills in designing, developing, programming, administering and teaching.
Currently working as a Member of Technical Staff, he deals with data, its processing challenges and optimizations on a daily basis. He has been a mentor to hundreds of professionals and his videos have helped hundreds of thousands of learners.