DP-203 – Data Engineering on Microsoft Azure

Course Curriculum

Chapter 1: UPDATED – Introduction

Lecture 1: IMPORTANT – How we are going to approach the exam objectives

Lecture 2: Cloud Computing

Lecture 3: Introduction to Cloud Computing

Lecture 4: Introduction to Azure

Lecture 5: The Azure Free Account

Lecture 6: Creating an Azure Free Account

Lecture 7: Tour around the Azure Portal

Lecture 8: Disabling security defaults

Lecture 9: PDF Resources Download

Chapter 2: UPDATED – Design and implement data storage – Basics

Lecture 1: Understanding Data

Lecture 2: The different data formats

Lecture 3: We need different types of storage services

Lecture 4: Lab – Creating an Azure Storage Account

Lecture 5: Lab – Working with the Azure Storage account

Lecture 6: Example of an application accessing data

Lecture 7: Example of an application accessing data – Resources

Lecture 8: Thoughts on Udemy storing data

Lecture 9: The Azure Data Lake Gen2 storage account

Lecture 10: Lab – Azure Data Lake Gen-2 storage accounts

Lecture 11: Lab – Uploading data to Azure Data Lake Gen2

Lecture 12: Getting PowerBI

Lecture 13: Using PowerBI to view your data

Chapter 3: UPDATED – Design and implement data storage – Overview on Transact-SQL

Lecture 1: Code for this section

Lecture 2: Section Introduction

Lecture 3: The Azure SQL database service

Lecture 4: Lab – Setting up a new Azure SQL database

Lecture 5: Lab – Installing Azure Data Studio

Lecture 6: Lab – Using Azure Data Studio on macOS

Lecture 7: Lab – T-SQL – SELECT clause

Lecture 8: Lab – T-SQL – WHERE clause

Lecture 9: Lab – T-SQL – ORDER BY clause

Lecture 10: Lab – T-SQL – Aggregate Functions

Lecture 11: Lab – T-SQL – GROUP BY clause

Lecture 12: Lab – Using PARTITION BY

Lecture 13: Lab – LEAD and LAG functions

Lecture 14: Lab – WITH Clause

Lecture 15: Lab – T-SQL – Create Table command

Lecture 16: Lab – T-SQL – Foreign Key constraints

Chapter 4: UPDATED – Design and implement data storage – Azure Synapse Analytics

Lecture 1: Code for this section

Lecture 2: Section Introduction

Lecture 3: A quick view on the costing aspect when using Azure Synapse

Lecture 4: What have we seen so far

Lecture 5: A data warehouse

Lecture 6: Welcome to Azure Synapse Analytics

Lecture 7: Lab – Let's create a Azure Synapse workspace

Lecture 8: About the serverless SQL pool

Lecture 9: Let's open up some data

Lecture 10: Quick note on Microsoft Entra ID and permissions

Lecture 11: Lab – Using External tables – CSV – Part 1

Lecture 12: Lab – Using External tables – CSV – Part 2

Lecture 13: Lab – External Tables – Parquet file

Lecture 14: Lab – External Tables – Multiple Parquet files

Lecture 15: Lab – OPENROWSET – JSON files

Lecture 16: Using the dedicated SQL pool

Lecture 17: The dedicated SQL pool

Lecture 18: Lab – Creating a SQL pool

Lecture 19: Lab – SQL Pool – External Tables – CSV

Lecture 20: Lab – SQL Pool – External Tables – Parquet

Lecture 21: Lab – External table – Hidden files and folders

Lecture 22: Pausing the SQL Pool

Lecture 23: Lab – Loading data into a SQL pool using Polybase

Lecture 24: Lab – Loading data into a table – COPY Command – CSV

Lecture 25: Lab – Loading data into a table – COPY Command – Parquet

Lecture 26: Lab – Loading data – Pipelines – Storage accounts

Lecture 27: Lab – Loading data – Pipelines – Azure SQL database

Lecture 28: Designing a data warehouse

Lecture 29: Fact and Dimension Tables

Lecture 30: Lab – Building a Fact Table

Lecture 31: Lab – Building a dimension table

Lecture 32: Lab – Transfer data to our SQL Pool

Lecture 33: Lab – Using Power BI for Star Schema

Lecture 34: Understanding Azure Synapse Architecture

Lecture 35: Understanding table types

Lecture 36: Lab – Creating Hash-distributed Tables

Lecture 37: Lab – Creating Replicated Tables

Lecture 38: Fact as Hash and Dimensions as Replicate

Lecture 39: More on designing tables

Lecture 40: Lab – Surrogate keys for dimension tables

Lecture 41: Slowly Changing dimensions

Lecture 42: Indexes in Azure Synapse

Lecture 43: Which Load Method to use

Lecture 44: Partitions in Azure Synapse

Lecture 45: Lab – Creating a table with partitions

Lecture 46: Lab – Switching partitions

Lecture 47: Lab – CASE statement

Lecture 48: What about the Spark Pool

Chapter 5: UPDATED – Design and Develop Data Processing – Azure Data Factory

Lecture 1: Section Introduction

Lecture 2: Code for this section

Lecture 3: Costing aspect when it comes to Azure Data Factory

Lecture 4: Extract, Transform and Load

Lecture 5: What is Azure Data Factory

Lecture 6: Starting with Azure Data Factory

Lecture 7: Lab – Azure Data Lake to Azure Synapse

Lecture 8: Lab – Generating a Parquet file