Scala and Spark 2 – Getting Started

Course Curriculum

Chapter 1: Introduction

Lecture 1: Introduction

Lecture 2: Setup Java and JDK

Lecture 3: Install Scala with IntelliJ IDE

Lecture 4: Develop Hello World Program using Scala

Lecture 5: Setup sbt and run application HelloWorld

Lecture 6: Add spark dependencies to the application

Lecture 7: Setting up winutils.exe on Windows (64 bit)

Lecture 8: Setup Data Sets – retail_db

Lecture 9: Develop first spark application – Get revenue for each order from order_items

Lecture 10: Build Jar file using sbt

Lecture 11: Download and install Spark using 7z on Windows

Lecture 12: Configure environment variables for Spark on Windows

Lecture 13: Running spark job using spark-shell

Lecture 14: Validating spark job from jar file using spark-submit

Chapter 2: Learn Scala for Spark

Lecture 1: Introduction to Scala

Lecture 2: REPL Overview

Lecture 3: Declaring Variables

Lecture 4: Programming Constructs

Lecture 5: Code Blocks

Lecture 6: Scala Functions – Getting Started

Lecture 7: Scala Functions – Higher Order and Anonymous Functions

Lecture 8: Scala Functions – Operators

Lecture 9: Object Oriented Constructs – Getting Started

Lecture 10: Object Oriented Constructs – Objects

Lecture 11: Object Oriented Constructs – Classes

Lecture 12: Object Oriented Constructs – Companion Objects and Case Classes

Lecture 13: Operators and Functions on Classes

Lecture 14: External Dependencies and Import

Lecture 15: Scala Collections – Getting Started

Lecture 16: Mutable and Immutable Collections

Lecture 17: Sequence (Seq) – Getting Started

Lecture 18: Linear Seq vs. Indexed Seq

Lecture 19: Scala Collections – Primitive Operations

Lecture 20: Scala Collections – Sorting Data

Lecture 21: Scala Collections – Grouping Data

Lecture 22: Scala Collections – Set

Lecture 23: Scala Collections – Map

Lecture 24: Tuples in Scala