Introduction to Apache Spark for Developers and Engineers
What you'll learn
- Identify and understand the concepts of Big Data
- Clearly describe Apache Spark
- Understand and explain the various components of the Spark framework
- Differentiate between Spark and Hadoop MapReduce
- Download, install and use Spark on a local machine
- Identify and understand the main Scala programming language concepts
- Develop basic Spark applications
- Explain and use Spark Resilient Distributed Datasets
Course content
- Preview02:24
- Preview06:40
- 05:401.3 Big Data Features and Traditional Datawarehousing Charactaristics
- 02:011.4 Use Case: Adastra's Big Data Reference Architecture
- 00:461.5 Section Conclusion
- 3 questions1.6 Big Data Concepts Quiz
Requirements
- Basic understanding of Big Data concepts
- Some understanding of a programming language such as Python, Java or Scala
- Administrator privileges on a computer to download and install software
Description
What is Apache Spark?
Apache Spark is the next generation open source Big Data processing engine. Spark is designed to provide fast processing of large datasets and high performance for a wide range of applications. Spark enables in-memory cluster computing which greatly improves the speed of iterative algorithms and interactive data mining tasks.
Course Outcomes
'Introduction to Apache Spark' includes illuminating video lectures, practical hands-on Scala and Spark exercises, a guide to local installation of Spark, and quizzes. In this course, we guide students through:
- An explanation of the Spark framework
- The basics of programming in Scala, Spark's native language
- An outline of how to work with Spark's primary abstraction, resilient distributed datasets (RDDs).
Upon completion of the course, students will be able to explain core concepts relating to Spark, understand the fundamentals of coding in Scala, and execute basic programming and data manipulation in Spark. This course will take approximately 8 hours to complete.
Recommended Experience
Programming Languages recommended for this course:
- Scala (course exercises are in Scala)
- Java
- Python
Recommended for:
- Data scientists and engineers
- Developers
- Individuals with a basic understanding of: Apache Hadoop, Big Data, programming languages (Scala, Java, or Python)
For students unfamiliar with Big Data and Hadoop, the course will provide a brief overview of each topic.
Why Adastra Academy?
Adastra Academy is a leading source of training and development for Information Management professionals and individuals interested in Data Management and Analytics technology. Our dedication to identifying and mastering emerging technologies guarantees our students are the first to have access to these quality courses. For an exceptional learning experience, our programs include hands-on labs and real world examples allowing students to easily apply their new knowledge.
Who this course is for:
- Big Data Developers
- Data Engineers
- Big Data Consultants
- Data Scientists
Instructor
![Adastra Academy](data:image/svg+xml,%3Csvg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 64 64"%3E%3C/svg%3E){kind=avatar}
- 4.2 Instructor Rating
- 4,618 Reviews
- 41,690 Students
- 6 Courses
We're focused on the tools and technologies that matter most for today and tomorrow.
Adastra Academy is a leading source of training and development for Information Management professionals and individuals interested in Data Management and Analytics technology. Our dedication to identifying and mastering emerging technologies guarantees our students are the first to gain access to critical skills. Our programs consist of hands-on labs and real world examples allowing students to easily apply their new knowledge.
As a division of Adastra Corporation, we leverage twenty years of world-class Information Management knowledge, experience, services and solutions to fuel the Academy and to advance Information Management professionals everywhere.