Databricks Fundamentals & Apache Spark Core

Course Curriculum

Chapter 1: Setup

Lecture 1: Introduction

Lecture 2: Create a Databricks community account

Lecture 3: Install the Dataset

Lecture 4: Overview of the dataset

Lecture 5: Install the notebooks

Chapter 2: Introduction to Databricks and Apache Spark

Lecture 1: Introduction to databricks

Lecture 2: Write your first Apache Spark Code

Lecture 3: Apache Spark Architecture: How Apache Spark runs on a cluster

Lecture 4: Practice: Find customer with the same birthday as you

Chapter 3: The DataFrame API: Basics

Lecture 1: Create a DataFrame from a CSV file

Lecture 2: Configure options to read a CSV file

Lecture 3: How to select columns from a DataFrame

Lecture 4: How to reference columns of a DataFrame

Lecture 5: Understand the DataFrame Schema: Part 1

Lecture 6: Understand the DataFrame Schema: Part 2

Lecture 7: Specify a DataFrame Schema using a DDL-formatted string : Part 1

Lecture 8: Specify a DataFrame Schema using a DDL-formatted string : Part 2

Lecture 9: Spark Architecture: The Organization of a DataFrame

Chapter 4: The DataFrame API: Transforming Data

Lecture 1: Adding columns to a DataFrame

Lecture 2: Renaming columns of a DataFrame

Lecture 3: Removing columns from a DataFrame

Lecture 4: Filtering rows from a DataFrame

Lecture 5: Joining multiple DataFrames: Part 1

Lecture 6: Joining multiple DataFrames: Part 2

Lecture 7: Aggregation: Count

Lecture 8: Aggregation: Count Distinct

Lecture 9: Aggregation: Get the Min value

Lecture 10: Aggregation: Get the Max value

Lecture 11: Aggregation: Get the Sum and SumDistinct

Lecture 12: Aggregation: Average and Mean

Lecture 13: Aggregation: Grouping data – Part 1

Lecture 14: Aggregation: Grouping data – Part 2

Lecture 15: Practice: Business Query 1

Lecture 16: Practice: Business Query 2

Lecture 17: Apache Spark Architecture: How Apache Spark Transforms data Internally

Lecture 18: User Defined Function

Chapter 5: Spark SQL & SQL Fundamentals

Lecture 1: Run SQL on a DataFrame: TempView

Lecture 2: Run SQL on a DataFrame: GlobalView

Lecture 3: Databases: List, Create, Delete, Select

Lecture 4: Tables: Unmanaged

Lecture 5: Tables: Managed

Lecture 6: SQL Fundamentals: Select Clause & Select Expression

Lecture 7: SQL Fundamentals: Where Clause, Equality Checks

Lecture 8: SQL Fundamentals: Handling NULLs in Where Clause

Lecture 9: SQL Fundamentals: Aggregations – Sum, Count, AVG, Mean

Lecture 10: SQL Fundamentals: Group By Clause

Lecture 11: SQL Fundamentals: Having Clause

Lecture 12: SQL Fundamentals: Order By Clause

Lecture 13: SQL Fundamentals: Inner Joins

Lecture 14: SQL Fundamentals: Left Outer Joins

Lecture 15: SQL Fundamentals: Right Outer Joins

Lecture 16: SQL Fundamentals: Predicates and Operators, like predicate

Lecture 17: SQL Fundamentals: Case Expressions

Lecture 18: Practice : Business Query 3

Lecture 19: Practice: Business Query 4

Lecture 20: Practice: Business Query 5

Chapter 6: Working with different type of data

Lecture 1: Specify the Schema of a DataFrame with StructType

Lecture 2: Converting literals to Spark Types: The lit function

Lecture 3: Working with booleans

Lecture 4: Working with numbers

Lecture 5: Working with strings

Lecture 6: Working with dates and timestamps

Lecture 7: Complex Types: Structs

Lecture 8: Complex Types: Arrays

Lecture 9: Complex Types: Maps

Lecture 10: Handling NULL Values: Drop NULL Values

Lecture 11: Handling NULL Values: Replace NULL Values

Chapter 7: Data Sources

Lecture 1: DataFrameReader: Read CSV Files

Lecture 2: DataFrameReader: Read JSON Files

Lecture 3: DataFrameWriter: Write Data

Lecture 4: Create DataFrame manually

Chapter 8: Become Apache Spark Certified

Lecture 1: Bonus Lecture