
Learn the fundamentals of ETL and ETL testing, including data extraction, transformation, loading, data quality, and the tester's role with test cases, mappings, and SQL queries.
Master ETL test tools to validate data loading with scripts that compare source and target tables. Verify transformations and per-column test cases using pink sheets and change logs.
Learn how to craft comprehensive ETL test cases from a mapping document, including table and column mapping, expected versus actual results, validation checks, and testing transformation logic across multiple scenarios.
Perform eyeballing validation by focusing on the data model design, ensuring table and column types and lengths match the spec, and verifying metadata naming standards and mappings in mapping documents.
Validate transformation logic by comparing source and target date format results using a mapping document, SQL checks, and quick visual cross-checks for compliance.
Validate records by count to detect skew between source and target tables using key acuity. Compare primary source and target records, note discrepancies, and download the attached queries for auditing.
Analyze six-table data warehouse ETL tests by composing and amending a SQL query to count records, compare source and transformed results, and document actual results for reference.
Master null value validation by ensuring mandatory fields, such as first name, last name, middle name, and date of birth, are present for ETL testing in the data warehouse.
Learn SQL queries for null value validation in a data warehouse ETL testing context, creating reusable checks across test cases.
Explore SQL null value validation in an ETL test context by building test cases, copying column schemas, applying formulas, and interpreting results when fields are optional.
Enforce a rule that ensures uniqueness of a column combination, such as first name, last name, middle name, and birth date, guaranteeing a single record per person with a query.
Perform SQL duplicate validation in an ETL test, ensuring the empty table yields no data and test results align with expected outcomes for a passing status.
Validate data integrity in large ETL workflows by comparing source and target data through targeted column checks, and analyze data profiles with unique values, counts, mean, max, min, and frequency.
Learn how to create test cases, understand queries, build faster formulas, handle null values and sku queries, and assess data completeness in large data sets.
ETL (Extract, Transform, Load) testing is an essential part of data warehousing to ensure the accuracy, completeness, and consistency of data in the data warehouse. In this course you will learn Source-to-target mapping validation where you can compare the source data after applying the transformation rules with the target data after ETL processing and Data reconciliation to validate the completeness and accuracy of data after ETL processing.
By comparing the source data after applying the transformation rules with the target data, we can ensure that the transformation logic is applied correctly and there are no data loss or data truncation issues.
• In the end of the this section I am glad to inform you that you are aware now about:
•What is ETL
•What is ETL test
•What is ETL test tools
•How to create a test case
•When to test by eyeballing
•When to test by SQL query
•How to test transformation logic
•How to make a formula that can help you test faster
•How to test records counts by SQL query
•How to test null values by SQL query
•How to test duplicate values by SQL query
•How to test completeness for huge amount of data
Who should follow this course?
Students that want to learn the basics of Source-to-target mapping validation.
Business Analysts and Data Analysts that would like to learn more about Data reconciliation.
Software test Engineers and Managers considering to apply data quality standards within their organization
Requirements
Basic knowledge of SQL ( This course use DBeaver as s a free and open-source SQL client and database management tool).
Database setup (PostgreSQL, Oracle, SQL Server etc.) is recommended.
The course consists of the following modules:
Introduction
What is ETL/ELT Testing and Data Quality Management?
Understand the Mapping document
frame the source and target queries
Perform the data validation.