Scala and Spark 2 - Getting Started

Get ready to develop applications using Scala and Spark
Rating: 4.2 out of 5 (701 ratings)
23,641 students
Scala and Spark 2 - Getting Started
Rating: 4.2 out of 5 (701 ratings)
23,635 students
Setup Development environment for building Scala and Spark applications
Install Java and JDK
Setup IntelliJ and add Scala plugin
Develop simple Scala program
Integrating IntelliJ with Spark
Setup sbt to build scala applications
Setup winutils to read files on windows using Spark
Build jar file using sbt
Setup Spark and run Spark job

Requirements

  • Computer with 4 GB RAM and 64 bit operating system
  • Basic programming skills
Description

This course is primarily to set up development environment to build Scala based Spark applications. As part of this we will see

  • Setup Development environment to build highly scalable applications using Scala and Spark
  • Demonstration of developing Spark applications using IntelliJ as IDE and Scala as programming language

This course is primarily to set up development environment and get ready to explore Scala and Spark in more detail.

Who this course is for:
  • Any one who want to setup development environment for Scala and Spark
Course content
2 sections • 38 lectures • 6h 45m total length
  • Introduction
    03:06
  • Setup Java and JDK
    05:16
  • Install Scala with IntelliJ IDE
    06:53
  • Develop Hello World Program using Scala
    09:07
  • Setup sbt and run application HelloWorld
    04:18
  • Add spark dependencies to the application
    04:31
  • Setting up winutils.exe on Windows (64 bit)
    04:37
  • Setup Data Sets - retail_db
    03:16
  • Develop first spark application - Get revenue for each order from order_items
    07:46
  • Build Jar file using sbt
    02:07
  • Download and install Spark using 7z on Windows
    04:07
  • Configure environment variables for Spark on Windows
    02:12
  • Running spark job using spark-shell
    03:03
  • Validating spark job from jar file using spark-submit
    06:15
  • Introduction to Scala
    05:14
  • REPL Overview
    08:38
  • Declaring Variables
    17:38
  • Programming Constructs
    14:22
  • Code Blocks
    08:25
  • Scala Functions - Getting Started
    18:52
  • Scala Functions - Higher Order and Anonymous Functions
    15:11
  • Scala Functions - Operators
    09:13
  • Object Oriented Constructs - Getting Started
    02:22
  • Object Oriented Constructs - Objects
    20:28
  • Object Oriented Constructs - Classes
    28:49
  • Object Oriented Constructs - Companion Objects and Case Classes
    24:23
  • Operators and Functions on Classes
    14:59
  • External Dependencies and Import
    12:27
  • Scala Collections - Getting Started
    10:50
  • Mutable and Immutable Collections
    11:55
  • Sequence (Seq) - Getting Started
    17:53
  • Linear Seq vs. Indexed Seq
    06:58
  • Scala Collections - Primitive Operations
    17:23
  • Scala Collections - Sorting Data
    14:32
  • Scala Collections - Grouping Data
    14:58
  • Scala Collections - Set
    13:08
  • Scala Collections - Map
    17:54
  • Tuples in Scala
    12:33

Instructors
Technology Adviser and Evangelist
Durga Viswanatha Raju Gadiraju
  • 4.2 Instructor Rating
  • 8,695 Reviews
  • 148,907 Students
  • 19 Courses

13+ years of experience in executing complex projects using vast array of technologies including Big Data and Cloud.

I found itversity, llc - a US based startup to provide quality training for IT professionals and staffing as well as consulting solutions for enterprise clients. I have trained thousands of IT professionals in vast array of technologies including Big Data and Cloud.

Building IT career for people and provide quality services to the clients will be paramount to our organization.

As an entry strategy itversity will be providing quality training in the areas of ABCD

* Application Development
* Big Data and Business Intelligence
* Cloud
* Datawarehousing, Databases

Support Account for ITVersity Courses.
Itversity Support
  • 4.2 Instructor Rating
  • 8,695 Reviews
  • 147,780 Students
  • 19 Courses

We have built a team to support going forward. If you send messages to this account for our courses, they will be sent to our Helpdesk from where we will be rewriting to our team.