
Explore why cloud computing lowers upfront costs, enables pay-as-you-go scalability, and automatic updates, contrasting cloud with on-premise data centers through a startup scenario.
Understand cloud computing fundamentals, including public, private, and hybrid clouds, and core services: IaaS, PaaS, and SaaS, with key data privacy notes.
Discover how Microsoft Azure delivers cloud computing via a single web portal to create and manage servers, databases, storage, and resources with free accounts and pay-as-you-go options.
Discover Azure SQL Database as a platform as a service, delivering high availability, auditing, dynamic data masking, Power BI integration, elastic pools, and flexible pricing.
Learn to create an Azure SQL Database in the portal by provisioning a server within a resource group, configuring compute and storage, networking, backups, and deployment progress.
Compare dtu-based and vcore-based pricing tiers for azure sql database, selecting basic, standard, premium, general purpose, hyperscale, or business critical configurations, with provisioned or serverless compute and hybrid benefit.
Configure active geo replication to create a secondary readable database in a different region for disaster recovery and business continuity, including manual failover and region selection.
Discover how failover groups enable automatic failover for disaster recovery and business continuity, with primary and secondary servers, read-write and read-only endpoints, and seamless data replication.
Enable auditing to track database activities and store audit logs in a storage account or log analytics. Configure retention days and review events like create table and select.
Learn how Azure Data Factory enables extract, transform, and load workflows. It provides cloud-based data integration through pipelines, provisioning, publishing, and monitoring.
Explore the building blocks of data factory—pipelines, activities, linked services, datasets, data flows, and triggers—and learn how to create and connect them in the portal.
Configure a copy data activity in Azure Data Factory for scenario 1, linking source to destination and mapping schemas; publish and monitor the pipeline.
Learn to use the get metadata activity in a data factory pipeline, creating a dataset and link service to scan a local folder and return file metadata.
Use the filter activity in a data factory workflow to filter file names from the get metadata output, selecting only those starting with E in a folder input.
Learn how to use the if condition activity in data factory to branch between true and false activities. Use an expression and the empty function to evaluate the previous output.
Define pipeline-level variables and use append variable to add values in an if condition, then access them across the pipeline and set defaults.
Iterate over the filter output using a for each loop to copy each file into a data lake, configuring inputs, sequential processing, and per-file copy activity.
Explore the dataflow source transformation in Azure Data Factory, configuring datasets from blob storage or data lake, and handling schema drift for scalable visual data integration.
Configure and apply the sink transformation to load data into a destination dataset, creating and mapping a school database table, then publish, run the pipeline, and verify records.
Configure a data flow conditional split to route records into multiple streams based on expressions. Choose first matching or all matching behavior and define a default stream for nonmatching records.
Explore adding a derived column in a dataflow to create a new field, such as a hardcoded customer name, and see auto mapping populate the sink.
Enrich sales data with a lookup transformation in a data factory data flow by joining on customer id to fetch names from a reference table; publish the pipeline.
Configure a filter transformation in the data flow to select records with quantity greater than four, publish changes, and validate results across the destination tables.
Explore the exist transformation in a data flow to filter records by existence in a second source, configure exist or doesn't exist, and validate results by running the pipeline.
Learn to parameterize linked services, datasets, and pipelines in data factory, using a single linked service with a server name parameter to switch between dev and production environments.
Define parameters inside the dataflow and use them in transformations and expressions, with values passed from the calling pipeline and a default if none provided.
Explore monitoring data factory performance using a zone monitor, diagnostic settings, and log analytics to view logs, metrics, health, and troubleshoot unexpected behavior.
Implement an Azure Data Factory v2 lab that builds a pipeline to load source SQL data (customer and lead) into staging with incremental and full loads using lookup and filters.
Explore slowly changing dimension type 1, where updates replace existing records to avoid history in the dimension, using staging, incremental loads, and a surrogate key.
Implement slowly changing dimension type 1 in Azure Data Factory v2 using data flow, staging and dimension tables, exist checks, and insert/update logic.
Learn to implement slowly changing dimension type 2 in ADFv2 with a data flow, using staging and dimension, lookups, and conditional splits to insert new records and update current flags.
Explore Azure Data Lake Storage Gen2, a cost-effective, scalable solution built on blob storage for unstructured data, supporting ELT workflows and Hadoop-compatible analytics.
Create an Azure data lake storage Gen2 in the portal, selecting subscription, resource group, location, and storage tier, with hierarchical namespace and replication options, plus hot or cool access tiers.
Grant access via storage account and granular file or folder permissions, assigning roles like owner or contributor. Review data transfer options, including offline data box, rest api, and easy copy.
Learn how shared access signatures (SAS) grant restricted, time-bound access to storage resources via a generated connection string. Configure permissions, time windows, and IP restrictions for external application access.
Explore how to monitor Azure Data Lake Storage using classic and monitoring views, configure alert rules for latency, capacity, and ingress/egress, and review diagnostic and usage graphs for admin insights.
Configure firewall rules and virtual networks to control data lake storage access, restricting to selected networks or specific IP addresses, with trusted Microsoft services exceptions.
Discover how to load data into ADLS Gen2 using Azure Data Factory, by building a copy pipeline from local files, configuring sources, destinations, and file formats.
Explore the Synapse analytics architecture, from the control node to isolated compute and storage nodes, and learn how hash, round-robin, and replicated data distributions power parallel queries.
Explore PolyBase in Azure Synapse to query data stored in blob storage or Hadoop by creating external data sources, file formats, and external tables mapping to your data lake.
Master loading data from an external table into a physical table using CTAS in Polybius, copying data from a data lake storage account.
Learn how to load data into a data warehouse table using the copy into statement, including source specification, sas token authentication, and skipping header rows from Azure blob storage.
Load data from a local file system into Synapse Analytics tables using Azure Data Factory, staging the file in blob storage and loading with Polybius or bulk insert.
Create and manage restore points to back up a Synapse SQL pool, then restore or create a new pool from the restore point, including timestamps and scheduling options.
Explore dual backup across regions for disaster recovery and business continuity, automatically enabling daily backups and simple restore by creating a new skill pool.
Explore how to monitor a Synapse SQL pool using diagnostic settings, log all metrics, and view performance history, queries, and alerts to identify bottlenecks.
Explore Cosmos DB, a globally distributed database you can deploy worldwide with a few clicks, offering multi API support including SQL and Cassandra, across regional Azure data centers.
Explore Cosmos DB pricing by storage and requests, compare provisioned throughput options—standard, auto scale, and serverless—and learn how manual vs automatic scaling affects cost and performance.
Create a Cosmos DB account in the Azure portal by selecting a subscription, resource group, location, and API, then configure provisioned throughput, redundancy, and consistency level.
Explore how Cosmos DB supports multiple APIs—document, key-value, columnar, and graph models—through Cassandra API, Gremlin API, MongoDB API, and Table API, enabling flexible data modeling and seamless migration.
Learn the database container items hierarchy in cosmos db, from a database account to databases, containers, and items, and how stored procedures, user defined functions, and triggers live inside containers.
Explore consistency concepts in cosmos, from eventual and strong to prefix consistency, across primary and replicated databases, and how reads may show stale values during ongoing sink operations.
Scale a globally distributed cosmos db by creating secondary copies across regions. Enable multi-region replication, start small, and expand gradually as demand grows.
Explore how to monitor a Cosmos DB database using metrics, per-database and per-container views, region filters, throughput, requests, storage, latency, and cost.
Build a C# app to connect to Cosmos DB and read items from a container. Configure the endpoint and primary key, then read and write data from the database.
Note: While creating a ASA job, please ensure that you do not have any underscore in the job name.
To download the source app present in the link provided in the resources section,
- Click on the link provided in the resources section of this lecture
- it will open a microsoft page, scroll down and you will find a section as Pre requisites, where you will find a link "TelcoGenerator.zip" to download this zip file. Click on this link and the download should start.
Explore built in window functions for streaming data: tumbling, hopping, sliding, session, and snapshot windows. Learn to apply aggregates over groups, using count and sum on streams like Twitter.
Create an Azure Databricks workspace in the portal by selecting your subscription, resource group, and workspace name in south central us, then access notebooks and tables inside the workspace.
Explore an Azure data warehouse scenario: ingest data, stage in blob storage, transform with Databricks, model as facts and dimensions, and deliver a Power BI dashboard via Azure Data Factory.
Explore end-to-end data flow from source files in a blob storage account to a destination SQL database, guiding manual data upload, container setup, and basic transformation steps.
Extract data from a data lake by mounting containers, transform into global tables, and load only new customers by joining with dim customer to avoid duplicates.
Schedule a notebook as a job by selecting the notebook, configuring a job cluster, and setting schedules with time zones to automate runs and reduce startup time with pools.
Download and install Power BI Desktop from Microsoft Store on Windows or Mac, then connect to sources, build a data model, and create bar, line, and pie charts with filters.
Learn to connect to cloud and on-premise data sources by configuring Azure SQL database and Excel files, choosing between import and direct query, and loading data for Power BI analysis.
Learn to create and manage table relationships, set cardinality, and configure cross filter directions in your Power BI data model.
Create calculated columns in Power BI with DAX, such as concatenating first and last names to form full customer names and deriving columns like tax amount divided by a value.
Create calculated measures in Barbiere by adding measures to a fact table and defining DAX expressions for month-to-date totals and the previous quarter.
Use the power query editor to perform data cleansing and detailed transformations. Replace nulls with meaningful values via the replace values tool to improve data quality.
Choose the columns you need for reporting, hide the rest in Power BI Desktop, and remove columns from the data model, while using Applied Steps and undo to manage changes.
Apply the group by feature in the transform section to aggregate by city, state, and country using count, sum, average, max, and min, with an optional duplicate of the table.
Explore the extract property in the Power Query editor to derive text insights using length, first, last, and text before, after, or between delimiters, while duplicating and renaming a column.
Set the background color and add a company logo to a Power BI desktop report, while adjusting page background properties and inserting the logo image.
Add slicers for product category and order date to filter the report and explore performance by category and year and month across regions.
Explore building a city-level sales report by a selected product using a pie chart to display total sales by city, with formatting and legend placement to highlight city contributions.
Build detailed, table-based reports by adding customer and sales order data—quantity, unit price, discounts, and ship method—and use conditional formatting to reveal city-level sales and product-level insights.
Add and customize card visuals to show current and previous month sales using a previous month measure with order date filters for quick snapshots.
Explore page-level and all-pages filters, set a default city filter like London, and use slicers to synchronize visuals across a multi-page report before publishing to the cloud for sharing.
Install and configure the personal gateway for the Power BI service on your local laptop to access the Excel file and the Aja Sequel Database, enabling dataset refresh.
Publish a Power BI service report and share it with colleagues via email or links, configure access and collaboration options, and note row-level security as an advanced topic.
Create a Power BI service dashboard by pinning visuals from existing reports. Share the dashboard with others and understand its read-only snapshot nature.
Advance your Power BI journey by practicing DAX skills, exploring data flows and Power BI apps, and mastering report publishing and sharing.
Why Take This AMAZING Course?
Highest Rated Instructor Here On Udemy For Azure Data Engineer Courses
Most Popular Course on Azure Data Engineer Certification. 100% Syllabus of DP-203 Covered
Learn From A Professional Who Works as Azure Data Architect and Has Taught More Than 39,000 Students.
THE MOST UPDATED AND MODERN TUTORIAL. Don't Settle For Outdated Content!
Focus of this course is not just to clear the Azure Data Engineer Certification but also learn how to implement Real World Use Cases like Slowly Changing Dimensions, Incremental Data Load etc.
Plus, this course is BUNDLED with following Azure Services like
1. Basics of Cloud Computing
2. Azure SQL Database
3. Azure Data Lake Storage
4. Azure Data Factory V2
5. Implementing Real World Use Cases
6. Power BI
7. Azure Synapse Analytics
8. Azure Cosmos DB
9. Azure Stream Analytics
10. Azure Databricks
If you are planning for Azure Data Engineer certification (DP-203) then this course covers 100% syllabus required to clear the exam
Unlike Other Courses, I Cover Everything in Detail from Scratch.
Don't be left in the dark with other courses that just scratches the surface of Azure Data Engineer Services. I help my students by teaching them in depth for all topics and make sure they are 100% informed on all topics.
This course is very detailed and will make you fully understand how you can clear the certification exam and also implement the project from scratch as a beginner.
Also, you will get a PRACTICE TEST in this course through which you can check your exam readiness.
I hope you will like the course and it will be helpful in your Azure journey.
All the best and Happy Learning !!