Pentaho for ETL & Data Integration Masterclass 2024 – PDI 9

Course Curriculum

Chapter 1: Introduction

Lecture 1: Welcome to the course

Lecture 2: Course Resources

Chapter 2: Pentaho Data Integration (PDI) Installation and Setup

Lecture 1: Setting up environment and installing PDI

Lecture 2: This is a milestone!

Lecture 3: Opening Spoon – The Graphical UI

Chapter 3: A Simple ETL Demonstration

Lecture 1: The example problem statement

Lecture 2: Demonstration of a PDI transformation

Lecture 3: Demonstration of a PDI Job

Chapter 4: Basic concepts – Theory for foundational understanding

Lecture 1: What is ETL?

Lecture 2: Data Warehouse, Ops Database and Data mart

Lecture 3: Inmon vs Kimball Architecture

Lecture 4: ETL vs ELT

Chapter 5: The ETL process: The practical part begins here

Lecture 1: Data and the ETL process

Chapter 6: DATA EXTRACTION: Extracting tabular data

Lecture 1: Manually entering data into PDI

Lecture 2: Inputting Data from a TXT (text) file

Lecture 3: Input from multiple CSV files at the same time

Lecture 4: Inputting Data from an Excel file

Lecture 5: Extracting Data from Zipped files

Chapter 7: DATA EXTRACTION: Extracting non-tabular data

Lecture 1: Extracting from XML

Lecture 2: Extracting from JSON

Chapter 8: Extracting from an SQL table

Lecture 1: Plan for importing sales data

Lecture 2: Installing PostgreSQL and pgAdmin in your PC

Lecture 3: Creating Sales table in SQL

Lecture 4: Extracting from an SQL table

Chapter 9: Storing and Retrieving Data from Cloud storage

Lecture 1: Storing Data on AWS S3

Lecture 2: Reading data from AWS S3

Chapter 10: Merging Data Streams

Lecture 1: Concepts: Merging Data Streams

Lecture 2: Sorted Merge Step – Merging customer data

Lecture 3: Merging product data

Lecture 4: Append data stream – merging sales data

Chapter 11: Data Cleansing

Lecture 1: Introduction to Data Cleansing

Lecture 2: Value Mapper Step

Lecture 3: Replace in String Step

Lecture 4: Fuzzy Match concepts

Lecture 5: Fuzzy Match Step in PDI

Lecture 6: Fuzzy Match Algorithms

Lecture 7: Formula Step and changing data format

Lecture 8: Common Data Cleaning Steps

Chapter 12: Data Validation

Lecture 1: Introduction to Data validation

Lecture 2: Data_validation 1 – String-to-Int and integer range validations

Lecture 3: Data validation 2 – Checking Reference Values using stream look-up

Lecture 4: Data validation 3 – Order date < shipping date using calculator step

Lecture 5: Common Data Validation steps

Chapter 13: Error Handling

Lecture 1: Correcting the errors and merging with main stream

Lecture 2: Writing the errors to the log

Lecture 3: Writing the errors to a separate file

Chapter 14: Transformation and Analytics steps

Lecture 1: Concatenating Address Fields

Lecture 2: Data Aggregation using Group-by

Lecture 3: Normalization and Denormalization

Lecture 4: Number Range Step

Chapter 15: PDI SQL Connection

Lecture 1: Introduction to PDI – SQL connection

Lecture 2: Reading and filtering data from DB into PDI

Lecture 3: Updating and Inserting data into DB from PDI

Lecture 4: Deleting data from SQL DB using PDI

Chapter 16: Conceptual understanding for Loading Data

Lecture 1: Facts and Dimensions tables

Lecture 2: Surrogate Keys in Dimension tables

Lecture 3: Type 1 & 2 Slowly Changing Dimensions

Lecture 4: Schemas

Chapter 17: Loading the data into a Data Mart

Lecture 1: Creating tables in DB

Lecture 2: Loading Customer Data using combination lookup/ update step

Lecture 3: Loading product data using dimension lookup step

Lecture 4: Loading sales data after database lookup steps

Chapter 18: Running Java and Javascript

Lecture 1: Scripting Steps

Chapter 19: PDI Jobs

Lecture 1: PDI Jobs vs Transformation

Lecture 2: Controlling the flow of execution