Azure Cloud Azure Databricks Apache Spark Machine learning

Course Curriculum

Chapter 1: Introduction

Lecture 1: Introduction

Lecture 2: What is databricks?

Chapter 2: Databricks Quickstart

Lecture 1: Hands-on: How to navigate to the databricks service?

Lecture 2: Hands-on: How to create a workspace?

Lecture 3: Hands-on: How to create a spark cluster?

Lecture 4: Hands-on: How to create a notebook?

Lecture 5: Hands-on: How to create a table?

Lecture 6: Hands-on: How to delete a spark cluster?

Lecture 7: Hands-on: How to delete all resources in Azure Cloud?

Lecture 8: What is workspace?

Lecture 9: What is Resource Group?

Lecture 10: What is Databricks Runtime?

Lecture 11: What is Cluster?

Chapter 3: Apache Spark

Lecture 1: History of Hadoop

Lecture 2: What is Apache Spark?

Lecture 3: Hands-on: Download and install virtualbox

Lecture 4: Hands-on: Download and Install putty

Lecture 5: Hands-on: Download and Install winscp

Lecture 6: Hands-on: How to download HDP?

Lecture 7: Hands-on: How to set up HDP

Lecture 8: Hands-on: How to SSH into HDP with PuTTY?

Lecture 9: Hands-on: How to connect to HDP with WinSCP?

Lecture 10: Hands-on: How to connect to HDP with Web Shell?

Lecture 11: How to use ambari to manage Hadoop?

Lecture 12: Hands-on: Apache Spark Quick Start

Lecture 13: Apache Spark Architecture

Lecture 14: What is the ecosystem of Apache Spark?

Chapter 4: Databricks Developer Tools

Lecture 1: What is Databricks Developer tools?

Lecture 2: Hands-on: Download and install python

Lecture 3: Hands-on: How to set up databricks cli?

Lecture 4: Hands-on: How to use databricks cli?

Lecture 5: Hands-on: How to use Databricks Utilities?

Lecture 6: Hands-on: Download and install JDK

Lecture 7: Hands-on: Download and install IntelliJ IDEA

Lecture 8: Hands-on: Using Databricks Utilities API Library in IDE

Lecture 9: Hands-on: How to use databricks in Azure Data Factory

Lecture 10: Hands-on: How to debug the notebook in pipeline?

Lecture 11: Hands-on: ETL with Azure Databricks

Lecture 12: Hands-on: How to debug ETL notebook in ETL pipeline?

Chapter 5: Databricks Notebook

Lecture 1: What is notebook?

Lecture 2: Hands-on: Using notebook to visualize data

Chapter 6: Databricks Delta Lake

Lecture 1: Hands-on: Set up Apache Spark with Delta Lake

Lecture 2: Hands-on: Using python to operate delta lake

Chapter 7: Databricks REST API

Lecture 1: Hands-on: Download and install postman

Lecture 2: Hands-on: Generate a token

Lecture 3: Hands-on: Create a spark cluster using REST API

Lecture 4: Hands-on: Delete a spark cluster using REST API

Lecture 5: Hands-on: Permanently delete a spark cluster using REST API

Chapter 8: Databricks Machine Learning

Lecture 1: History of Artificial Intelligence

Lecture 2: What is Machine Learning?

Lecture 3: Workflow of Machine Learning

Lecture 4: Hands-on: Using scikit-learn with Spark on Databricks

Lecture 5: Hands-on: Using Spark to distribute parameter tuning

Lecture 6: Hands-on: Using tensorflow with Spark on Databricks

Lecture 7: Introduction to Distributed Deep Learning

Lecture 8: Distributed methods for using TensorFlow

Lecture 9: Hands-on: Distributed deep learning training using TensorFlow with HorovodRunner

Lecture 10: Hands-on: Using MLflow to track parameters and metrics

Lecture 11: History of Transfer Learning

Lecture 12: Hands-on: How to perform Transfer Learning on Databricks?

Chapter 9: Structured Streaming

Lecture 1: Hands-on: Create a virtual network

Lecture 2: Hands-on: Create an Kafka cluster on HDInsight

Lecture 3: Hands-on: How to connect to kafka using an SSH client

Lecture 4: Hands-on: Configure Kafka for IP advertising

Lecture 5: Hands-on: Peer the Kafka cluster to the Azure Databricks cluster

Lecture 6: Hands-on: Create an Apache Kafka topic

Lecture 7: Hands-on: Production Structured Streaming with Kafka

Lecture 8: Hands-on: Consumption Structured Streaming with Kafka

Chapter 10: Databricks Graph Analysis

Lecture 1: History of Graph Analytics

Lecture 2: Hands-on: How to install dataframes library?

Lecture 3: Hands-on: How to create a graph?

Chapter 11: Bonus: An Open Source Alternative Solution for Databricks

Lecture 1: Why use open source alternative solutions?

Lecture 2: How to deploy Cloudbreak on Azure Cloud?

Lecture 3: Using Cloudbreak to create a cluster