Scala and Spark 2 - Getting Started

Get ready to develop applications using Scala and Spark
Setup Development environment for building Scala and Spark applications
Install Java and JDK
Setup IntelliJ and add Scala plugin
Develop simple Scala program
Integrating IntelliJ with Spark
Setup sbt to build scala applications
Setup winutils to read files on windows using Spark
Build jar file using sbt
Setup Spark and run Spark job


  • Computer with 4 GB RAM and 64 bit operating system
  • Basic programming skills


This course is primarily to set up development environment to build Scala based Spark applications. As part of this we will see

  • Setup Development environment to build highly scalable applications using Scala and Spark
  • Demonstration of developing Spark applications using IntelliJ as IDE and Scala as programming language

This course is primarily to set up development environment and get ready to explore Scala and Spark in more detail.

Who this course is for:

  • Any one who want to setup development environment for Scala and Spark

Course content

2 sections38 lectures6h 45m total length
  • Introduction
  • Setup Java and JDK
  • Install Scala with IntelliJ IDE
  • Develop Hello World Program using Scala
  • Setup sbt and run application HelloWorld
  • Add spark dependencies to the application
  • Setting up winutils.exe on Windows (64 bit)
  • Setup Data Sets - retail_db
  • Develop first spark application - Get revenue for each order from order_items
  • Build Jar file using sbt
  • Download and install Spark using 7z on Windows
  • Configure environment variables for Spark on Windows
  • Running spark job using spark-shell
  • Validating spark job from jar file using spark-submit


Technology Adviser and Evangelist
Durga Viswanatha Raju Gadiraju
  • 4.4 Instructor Rating
  • 9,930 Reviews
  • 211,851 Students
  • 16 Courses

13+ years of experience in executing complex projects using vast array of technologies including Big Data and Cloud.

ITVersity, Inc. - a US based organization to provide quality training for IT professionals and we have the track record of training hundreds of thousands of professionals globally.

Building IT career for people with required tools such as high quality material, labs, live support etc to upskill and cross skill is paramount for our organization.

At this time our training offerings are focused on following areas:

* Application Development using Python and SQL

* Big Data and Business Intelligence

* Cloud

* Datawarehousing, Databases

Support Account for ITVersity Courses.
Itversity Support
  • 4.3 Instructor Rating
  • 6,008 Reviews
  • 169,100 Students
  • 8 Courses

We have built a team to support going forward. If you send messages to this account for our courses, they will be sent to our Helpdesk from where we will be rewriting to our team.