IT & Software Other IT & Software Apache Spark

Scala and Spark 2 - Getting Started

Get ready to develop applications using Scala and Spark
Rating: 3.9 out of 5 (782 ratings)
27,575 students
Created by Durga Viswanatha Raju Gadiraju, Itversity Support
English
Setup Development environment for building Scala and Spark applications
Install Java and JDK
Setup IntelliJ and add Scala plugin
Develop simple Scala program
Integrating IntelliJ with Spark
Setup sbt to build scala applications
Setup winutils to read files on windows using Spark
Build jar file using sbt
Setup Spark and run Spark job

Requirements

  • Computer with 4 GB RAM and 64 bit operating system
  • Basic programming skills

Description

This course is primarily to set up development environment to build Scala based Spark applications. As part of this we will see

  • Setup Development environment to build highly scalable applications using Scala and Spark
  • Demonstration of developing Spark applications using IntelliJ as IDE and Scala as programming language

This course is primarily to set up development environment and get ready to explore Scala and Spark in more detail.

Who this course is for:

  • Any one who want to setup development environment for Scala and Spark

Course content

2 sections • 38 lectures • 6h 45m total length

  • Introduction
    03:06
  • Setup Java and JDK
    05:16
  • Install Scala with IntelliJ IDE
    06:53
  • Develop Hello World Program using Scala
    09:07
  • Setup sbt and run application HelloWorld
    04:18
  • Add spark dependencies to the application
    04:31
  • Setting up winutils.exe on Windows (64 bit)
    04:37
  • Setup Data Sets - retail_db
    03:16
  • Develop first spark application - Get revenue for each order from order_items
    07:46
  • Build Jar file using sbt
    02:07
  • Download and install Spark using 7z on Windows
    04:07
  • Configure environment variables for Spark on Windows
    02:12
  • Running spark job using spark-shell
    03:03
  • Validating spark job from jar file using spark-submit
    06:15

Instructors

Durga Viswanatha Raju Gadiraju
Technology Adviser and Evangelist
Durga Viswanatha Raju Gadiraju
  • 4.2 Instructor Rating
  • 9,875 Reviews
  • 195,945 Students
  • 19 Courses

13+ years of experience in executing complex projects using vast array of technologies including Big Data and Cloud.

ITVersity, Inc. - a US based organization to provide quality training for IT professionals and we have the track record of training hundreds of thousands of professionals globally.

Building IT career for people with required tools such as high quality material, labs, live support etc to upskill and cross skill is paramount for our organization.

At this time our training offerings are focused on following areas:

* Application Development using Python and SQL

* Big Data and Business Intelligence

* Cloud

* Datawarehousing, Databases

Itversity Support
Support Account for ITVersity Courses.
Itversity Support
  • 4.1 Instructor Rating
  • 8,973 Reviews
  • 158,876 Students
  • 15 Courses

We have built a team to support going forward. If you send messages to this account for our courses, they will be sent to our Helpdesk from where we will be rewriting to our team.