
In this video, we are going to learn what is Azure Data Factory(ADF) and what are the various real-world use cases in data engineering using ADF. We are also going to see the various concepts in data engineering using ADF.
In this video, we are going to learn various patterns for data loading in the design of data pipelines using Azure data factory.
We are going to learn the concepts of ETL, ELT, Data Integration, Data movement, and Orchestration
In this Demo, we will learn how to create Azure Data lake storage Gen2 account(ADLS Gen2)
In this Demo, we will learn how to create Cosmos DB account, new database and container
In this Demo we will see how to create a Dataset in Azure Data factory for building Data pipeline
In this Demo, we will learn how to create a Linked Service to create Data pipeline using ADF
In this video, we are going to learn how to create a Data pipeline to copy data from ADLS Gen2 (Azure data lake) to Cosmos DB using COPY activity
In this course, you are going to learn how to build data pipelines with hands-on labs using azure data factory
This course covers demos for all concepts used in real-world projects from an industry expert with hands-on Labs.
Anyone can spend 1.5 hours time and become an Azure Data engineer!
This course will provide what is data factory, what are the various core components in azure data factory.
This course is useful for those aspiring to become azure data engineers.
Those who want to switch their career from soft engineering to data engineer
To expand their skills from AWS, GCP data engineer to AZURE data engineer
to gain an in-depth understanding of the latest trends in azure data engineering
This course covers the following topics.
Basic concepts of various components in ADF
What are ETL and ELT
What is Linked service,
Demo for creating Linked service
What is a data set,
Demo for creating Data set
What is Integration run time
What is an Azure Data lake
Demo for creating Azure data lake storage account
What is Cosmos DB
Demo for creating Cosmos DB
What is COPY activity
Demo for creating a data pipeline to move data from ADLS 2 to Cosmos DB using COPY Activity
What are control flow activities-
Get Metadata activity
Demo for getting Metadata activity
Filter activity
Demo for Filter activity
ForEach activity
Demo for ForEach activity
Demo for other Control flow activities
What is DATA FLOW Activity
Demo for removing Duplicate data using DATA FLOW Activity
The course is useful not only for freshers but also for experienced data engineers to gain more skills in azure data engineering