
This chapters looks into the course structure
This chapters looks into a quick tour of the Azure Portal
This chapters looks into understanding data
This chapters looks into a lab on Azure storage accounts
This chapters looks into Azure Data Lake Gen-2 storage accounts
This chapters looks into a Lab on creating Azure Data Lake Gen2 storage accounts
This chapters looks into using Power BI to view your data
This chapters looks has all the code for this section
This chapters looks into the section introduction
This chapters looks into the internals of a database
This chapters looks into setting up a new Azure SQL database
This chapters looks into the T-SQL Select clause
This chapters looks into the T-SQL Where clause
This chapters looks into the T-SQL Order by clause
This chapters looks into the T-SQL Aggregate functions
This chapters looks into the T-SQL Group by clause
This chapters looks has all the code for this section
This chapters looks into the Section introduction
This chapters looks into Azure Synapse Analytics
This chapters looks into creating an Azure Synapse workspace
This chapters looks into the different compute options
This chapters looks into a lab on external tables - Part 1
This chapters looks into a lab on external tables - Part 2
This chapters looks into creating a SQL Pool
This chapters looks into loading data into a Dedicated SQL Pool
This chapters looks into copying data using the COPY command
This chapters looks into copying data using the COPY command with Parquet data
This chapters looks into designing a data warehouse
This chapters looks into dimension tables
This chapters looks into building a fact table
This chapters looks into building a dimension table
This chapters looks into transferring data into the SQL Pool
This chapters looks into Power BI for the star schema
This chapters looks into understanding Azure Synapse Architecture
This chapters looks into understanding table types
This chapters looks into hash-distributed tables
This chapters looks into creating replicated tables
This chapters looks into designing your tables
This chapters looks into surrogate keys for dimension tables
This chapters looks into slowly changing dimensions
This chapters looks into the case statement
This chapters looks into the Spark pool
This chapters looks into a section introduction
This chapters looks into the Extract, Transform and load process
This chapters looks into Azure Data Factory
This chapters looks into starting with Azure Data Factory
This chapters looks into loading a csv file into Azure Synapse via Azure Data Factory
This chapters looks into generating a parquet file
This chapters looks into a review on what has been done so far
This chapters looks into using a query for data transfer
This chapters looks into Mapping Data Flow
This chapters looks into mapping data flow for a fact table
This chapters looks into mapping data flow for the Dimension Customer table
This chapters looks into mapping data flow for the Dimension Product table
This chapters looks into Surrogate keys
This chapters looks into converting parquet files to JSON files
This chapters looks into loading JSON data into the SQL Pool
This chapters looks into the self-hosted integration runtime
This chapters looks into setting up nginx for the self-hosted runtime environment
This chapters looks into setting up the runtime
This chapters looks into the copy activity
This chapters looks into the mapping data flow for the copy activity
This chapters looks into Batch and Real-time processing
This chapters looks into Azure Event Hubs
This chapters looks into creating an Event Hub instance
This chapters looks into Azure Stream Analytics
This chapters looks into a Stream Analytics job
This chapters looks into a review on what we have seen so far
This chapters looks into timing windows
This chapters looks into adding multiple outputs
This chapters looks into reference data
This chapters looks into Power BI Output
This chapters looks has all the code for this section
This chapters looks into creating a Spark Pool
This chapters looks into working with Notebooks
This chapters looks into writing data into the Spark Pool
This chapters looks into sharing tables
This chapters looks into column-level security
This chapters looks into row-level security
This chapters looks into Data Masking
This chapters looks into Azure AD Authentication
This chapters looks into creating an admin
This chapters looks into creating a user
This chapters looks into best practices for your data lake
This chapters looks into workload management
Release v3.0 - May 2024
The entire course has been updated and refreshed. All chapters have been re-recorded. This has been done to ensure that all contents now reflect the most recent changes to the services on the Azure platform.
All course contents have also been aligned as per any changes to the course objectives.
Release v2.0 - May 2023
The entire course has been updated and refreshed. All chapters have been re-recorded. This has been done to ensure that all contents now reflect the most recent changes to the services on the Azure platform.
All course contents have also been aligned as per any changes to the course objectives.
Additional questions have been also added to the Practice Tests.
Release v1.0 Initial Release
This course is designed for students who want to attain the "Microsoft Certified: Azure Data Engineer Associate" certification
This course has contents for the Exam DP-203
The objectives covered in this course are
Design and implement data storage (40-45%)
Design and develop data processing (25-30%)
Design and implement data security (10-15%)
Monitor and optimize data storage and data processing (10-15%)
In this course students will learn about the various Azure services that pertain to Data Engineering. Few of the important aspects that students will learn along the way includes the following
What is the purpose of an Azure Data Lake Gen 2 storage account
Basics on Transact-SQL commands
How to work with Azure Synapse. This will include building a data warehouse into a dedicated SQL Pool.
How to build an ETL pipeline with the help of Azure Data Factory. There will be various scenarios on how to create mapping data flows.
How to stream data with the use of Azure Stream Analytics. You can see how SQL commands can be used for your streaming data.
Basics on the Scala programming language, and SPARK
How to work with SPARK, Scala in Azure Databricks. We will see how to work with Notebooks. We will also see how to stream data into Azure Databricks.
The different security measures and monitoring aspects to consider when working with Azure services