Azure Data Factory Training–Continuous Integration/Delivery

Course Curriculum

Chapter 1: Introduction

Lecture 1: What We Will Learn From This Course ?

Lecture 2: Download Full Resources And Code Used In This Course

Chapter 2: Azure Basics

Lecture 1: Create Azure Account With Credit Card

Lecture 2: How To Use Azure Account — After Free Trial ,Without Spending Money

Lecture 3: ETL Vs ELT

Lecture 4: Key components Of ADF & SSIS

Chapter 3: Demo Lab 1: Introductions To Azure Data Factory

Lecture 1: Introduction To Lab 1

Lecture 2: Create Azure SQL Database

Lecture 3: Access Azure SQL Databases Using Azure Query Editor & SSMS

Lecture 4: Connect To Azure SQL Data Base From On-Premise Using SSMS & Create New Tables

Lecture 5: Create A Storage Account

Lecture 6: Connect To Storage Account Using Azure Storage Explore

Lecture 7: Create Azure Data Factory Instance In Azure

Lecture 8: Azure Data Factory For The First Time

Lecture 9: Create Linked Service (Connection To Source & Destinations)

Lecture 10: Create Data Set For Source Tables And Destinations Files

Lecture 11: Create Pipeline And Configure Copy Activity (Azure SQL DB To Storage Account)

Lecture 12: Execute Our Pipeline And Monitor Our Pipeline Executions

Lecture 13: Clean Your Azure Resources

Chapter 4: Practice Azure (Task 1 & Solution: New Version)

Lecture 1: Task 1: Check Your Understanding

Lecture 2: Create New Resource Group Called ADF

Lecture 3: How to Create a New Storage Account in Azure.

Lecture 4: What is Azure Data Lake V2

Lecture 5: How to Create a New Data Lake Storage in Azure.

Lecture 6: How to Create an Azure SQL Database.

Lecture 7: How to Create Tables and Insert Data into Azure SQL Database

Lecture 8: How to Create Azure Data Factory Instances and Configure Linked Services

Lecture 9: How to Create Multiple Datasets in Azure Data Factory?

Lecture 10: How to Create a Pipeline with Multiple Copy Activities in Azure Data Factory

Lecture 11: How to Clean Up Resources by Deleting an Azure Resource Group

Chapter 5: How To Use Parameters And Variables In Azure Data Factory

Lecture 1: Use Parameter In your Data Set To Create A Dynamic Pipelines-Part 1

Lecture 2: Use Parameter In your Data Set To Create A Dynamic Pipelines-Part 2

Lecture 3: Use Of Variables In Azure Data Factory

Lecture 4: Use Of System Variables In Azure Data Factory

Lecture 5: Use Set Variable Activity In Azure Data Factory

Chapter 6: Azure Data Factory Administrations

Lecture 1: Annotations in Azure Data Factory

Lecture 2: User Properties In Azure Data Factory

Chapter 7: Learn Different Control Flow Activities In ADF Part 1

Lecture 1: Understanding Our Requirements

Lecture 2: Use Of Get Metadata Activity

Lecture 3: Use Get Metadata Activity With Azure SQL Server

Lecture 4: Use Wait Activity To Delay Our Process

Lecture 5: Use Of ForEach Activity

Lecture 6: Use Of If Condition Activity

Lecture 7: Use Of Delete Activity

Lecture 8: Assignment

Lecture 9: Demo: Delete Specific Size Files Form Your Storage Account

Chapter 8: Exploring Various Control Flow Activities in Azure Data Factory, Part 1

Lecture 1: Introduction

Lecture 2: How Does the Lookup Activity Work in Azure Data Factory?

Lecture 3: What Is the Purpose of the For-Each Activity in Azure Data Factory?

Chapter 9: Real World Project & Use Cases

Lecture 1: Incrementally copy new and changed files based on Last Modified Date

Lecture 2: Difference Between Incremental Load and Full Load (Animation)

Lecture 3: How We Could Implement Incremental Load In ADF (Single Table – Insert Only)

Lecture 4: Create Infrastructure For Incremental Load Demo

Lecture 5: Create Source Tables and Destination Tables

Lecture 6: Create Dataset And Linked services

Lecture 7: Create A Full Load Azure Data Factory

Lecture 8: Implement A Incremental Load In Azure Data Factory

Lecture 9: What is SCD / Slowly changing dimension?

Lecture 10: How To Implement SCD Type 1 In Azure Data Factory?

Lecture 11: Demo: SCD Type 1

Chapter 10: Azure Data Factory Custom Email Notifications

Lecture 1: Introduction To Azure Logic Apps

Lecture 2: Lets Create A Logic Apps To Send A Email

Lecture 3: Create Resources & Data Set

Lecture 4: Invoke Azure Logic Apps Using Azure Data Factory Web Activity

Lecture 5: Pass Custom Message From ADF To Azure Logic App

Lecture 6: Pass System Parameter Values From ADF To Azure Logic Apps

Lecture 7: Configure Azure Data Factory To Send A Failed email notification -Last Activity

Lecture 8: Configure Azure Data Factory To Send A Failed email notification -Any Activity

Chapter 11: Self Hosted Integration Runtime & Data Set Parameters (Lab 3 New Version )

Lecture 1: Introduction To Lab 3

Lecture 2: Create Azure Resources For This Demo

Lecture 3: Create Self Hosted Integration Run Time To Access On-Premise Devices

Lecture 4: Perform Copy Activity Without Parameter

Lecture 5: Create Pipelines With Lookup Activity

Lecture 6: Create Pipelines With Lookup & For Each Activity

Chapter 12: Mapping Data Flow Demo Part 1 (New Module Added On Dec 2022)

Lecture 1: Introductions to Mapping Data Flow

Lecture 2: How To Use Data Flow UI Part 1

Lecture 3: How To Use Data Flow UI Part 2

Lecture 4: How To Use Data Flow UI Part 3

Lecture 5: Introduction's To Required Transformations

Lecture 6: Source Transformations: Customer

Lecture 7: Schema drift in Source Transformations

Lecture 8: Source Transformations In Mapping Data Flow: Payments

Lecture 9: Source Transformations: Orders

Lecture 10: Filter Transformations: Restrict Payments Data

Lecture 11: Assignment: Filter Transformations To Restrict Customer Data

Lecture 12: Solutions: Filter Transformations To Restrict Customer Data

Lecture 13: Select Transformations: Select Relevant Columns From Customer Table

Lecture 14: Assignment: Select Relevant Columns From Payments Table