
Create and configure linked services in Azure Data Factory to supply connection information for external resources like on-premise SQL and blob storage, enabling datasets and pipelines to connect.
Copy all files from the landing container to the sink container in a data lake storage gen two using Azure Data Factory pipelines, leveraging get metadata to enumerate files.
Copy all Azure SQL tables to Azure Data Lake as csv using a lookup and for each loop, with dynamic file naming for daily backups.
Demystify Azure Data Factory real time scenarios by loading q1 and q2 to one sink directory and q3, q4, and q5 to another using get metadata, filter, and copy.
Load data from Azure blob storage into Snowflake using Azure Data Factory, with SAS token link services and sequential for each to populate multiple CSV files into Snowflake tables.
demonstrates azure data factory migration from azure sql to adls, selecting only required columns via a config table, lookup, and copy activity with per-table queries.
Load a nested JSON into a CSV file using Azure Data Factory by mapping employee arrays to CSV columns, configuring source and sink in ADLS Gen2, and validating the pipeline.
Implement slowly changing dimension type 1 with Azure Data Factory data flows to compare source and destination via a four-column hash, inserting new records and updating changed ones.
Learn Azure Data Factory with real time scenarios, some of the sample scenarios mentioned below.
I had covered the basics and Intermediate level , real time scenario based questions asked in interviews.
It has covered the below scenarios and many more.
1 Copy All the available files from the landing container to the sink container in the same Azure Datalake storage Gen2 accounts
2 Copy all the tables available from Azure SQL database to Azure data lake storage container environment in csv format with data
3 Copy only selected files from the container to another container - use of filter activity.
4 Multiple Filter Activity scenarios.
5 Copy data from the ADLS container into the snowflake table
6 Onpremise SQL Server to ADLS data migration
7 Onpremise SQL Server to Azure SQL Data Migration
8 Azure SQL to ADLS Container --- tables migration with required columns only
9 Migrate required tables and required columns from on premise sql server to azure sql tables
10 Migrate data from the ADLS containers all the files into a single table on azure sql side.
11 Migrate data from the ADLS containers all the files into a multiple tables as per the file on azure sql side.
12 BLOB CONTAINER SERVERAL FILES COPY ONE FILE FROM THAT CONTAINER TO THE ADLS GEN2 CONTAINER
13 MOVE ALL THE CSV FILES FROM THE BLOB CONTAINER TO THE ADLS GEN2 CONTAINER
14 BEFORE .JSON , IT SHOULD BE HAVING A FIVE CHARACTERS AS FILENAME , I WANT TO COPY THAT FILES ONLY
15 All files starting with Em (Any format) copy all the files from the input container to the output container
16 COPY ONLY REQUIRED FILES - PATTERN MATCHING SCENARIO
17 COPY BEHAVIOR - FLATTEN - MERGE AND PRESERVE Hierarchy SCENARIO
18 Fault tolerance_LOG_ERROR_INFO_COPY_DATA_ACTIVITY
19 How to perform merge operation in ADF
20 Load_Nested_JSON_AS_CSV_File
21 How Precedent constraints works
22 Parameterization in ADF
23 Implementation of Slowly Changing Dimension TYPE-1---MUCH NEEDED
24 Implementation of Slowly Changing Dimension TYPE-2_VERY_IMPORTANT_SCENARIO
and many more.
Preparing for these questions and scenarios will help you demonstrate your knowledge and practical skills in Azure Data Factory. I suggest to create Azure account which is free for one month and do practice along with me and let me know if you have any doubt while performing this tasks.