Other Apache Spark

Scala and Spark 2 - Getting Started

Get ready to develop applications using Scala and Spark
Rating: 4.1 out of 5 (668 ratings)
22,546 students
Created by Durga Viswanatha Raju Gadiraju, Itversity Support
Enroll now
Scala and Spark 2 - Getting Started
Rating: 4.1 out of 5 (668 ratings)
22,546 students
Buy now
Setup Development environment for building Scala and Spark applications
Install Java and JDK
Setup IntelliJ and add Scala plugin
Develop simple Scala program
Integrating IntelliJ with Spark
Setup sbt to build scala applications
Setup winutils to read files on windows using Spark
Build jar file using sbt
Setup Spark and run Spark job

Requirements

  • Computer with 4 GB RAM and 64 bit operating system
  • Basic programming skills
Description

This course is primarily to set up development environment to build Scala based Spark applications. As part of this we will see

  • Setup Development environment to build highly scalable applications using Scala and Spark
  • Demonstration of developing Spark applications using IntelliJ as IDE and Scala as programming language

This course is primarily to set up development environment and get ready to explore Scala and Spark in more detail.

Who this course is for:
  • Any one who want to setup development environment for Scala and Spark
Curriculum
2 sections • 38 lectures • 6h 45m total length
  • Introduction
  • Setup Java and JDK
  • Install Scala with IntelliJ IDE
  • Develop Hello World Program using Scala
  • Setup sbt and run application HelloWorld
  • Add spark dependencies to the application
  • Setting up winutils.exe on Windows (64 bit)
  • Setup Data Sets - retail_db
  • Develop first spark application - Get revenue for each order from order_items
  • Build Jar file using sbt
  • Download and install Spark using 7z on Windows
  • Configure environment variables for Spark on Windows
  • Running spark job using spark-shell
  • Validating spark job from jar file using spark-submit
  • Introduction to Scala
  • REPL Overview
  • Declaring Variables
  • Programming Constructs
  • Code Blocks
  • Scala Functions - Getting Started
  • Scala Functions - Higher Order and Anonymous Functions
  • Scala Functions - Operators
  • Object Oriented Constructs - Getting Started
  • Object Oriented Constructs - Objects
  • Object Oriented Constructs - Classes
  • Object Oriented Constructs - Companion Objects and Case Classes
  • Operators and Functions on Classes
  • External Dependencies and Import
  • Scala Collections - Getting Started
  • Mutable and Immutable Collections
  • Sequence (Seq) - Getting Started
  • Linear Seq vs. Indexed Seq
  • Scala Collections - Primitive Operations
  • Scala Collections - Sorting Data
  • Scala Collections - Grouping Data
  • Scala Collections - Set
  • Scala Collections - Map
  • Tuples in Scala

Instructors
Durga Viswanatha Raju Gadiraju
Technology Adviser and Evangelist
Durga Viswanatha Raju Gadiraju
  • 4.1 Instructor Rating
  • 8,037 Reviews
  • 140,955 Students
  • 19 Courses

13+ years of experience in executing complex projects using vast array of technologies including Big Data and Cloud.

I found itversity, llc - a US based startup to provide quality training for IT professionals and staffing as well as consulting solutions for enterprise clients. I have trained thousands of IT professionals in vast array of technologies including Big Data and Cloud.

Building IT career for people and provide quality services to the clients will be paramount to our organization.

As an entry strategy itversity will be providing quality training in the areas of ABCD

* Application Development
* Big Data and Business Intelligence
* Cloud
* Datawarehousing, Databases

Itversity Support
Support Account for ITVersity Courses.
Itversity Support
  • 4.1 Instructor Rating
  • 7,783 Reviews
  • 138,872 Students
  • 18 Courses

We have built a team to support going forward. If you send messages to this account for our courses, they will be sent to our Helpdesk from where we will be rewriting to our team.