Udemy
    •  
    •  
    •  
    •  
    •  
    •  
    •  
    •  
Subscribe
Turn what you know into an opportunity and reach millions around the world.
Learn More
Your cart is empty.
Keep shopping
Azure Data Engineering with Hands-on Labs
Rating: 4.5 out of 5(1 rating)
7 students

Azure Data Engineering with Hands-on Labs

on cloud ETL using Azure Data engineer
Created byi need techology
Last updated 6/2024
English

What you'll learn

  • You will learn how to build a major uese case real-world data pipeline in Azure Data Factory (ADF).
  • You will learn how to load transformation data from Azure Data Storage to Azure SQL Database using Azure Data Factory (ADF)
  • You will learn how to ingest data from sources such as HTTP and Azure Blob Storage using Azure Data Factory (ADF)
  • You will acquire good Data Engineering skills in Azure using ADF and Data flows transformations

Course content

2 sections • 45 lectures • 4h 5m total length

  • What is Azure and overview of Azure Data services8:44

    In this video we are discussion about what is azure

  • What is Resource and how to create it4:50

    In this video we will discuss about how to create a resource and wht it is.

  • Azure data factory walkthrough2:48

    Data engineers play a critical role in the Azure ecosystem by acting as the bridge between data and business intelligence. Here's a breakdown of their key responsibilities in the video.

  • What is Pipeline in Data factory2:32

    in this video we will discuss about pipeline.

  • How to create a pipeline3:37
  • What is linked services2:13

    • In this video we will discuss about what is Linked services.

  • What is Activity2:58

    In this video we will discuss about what is Activity.

  • What is blob storage and its use case4:12

    In this video we will disscuss about what is blob storage and its use case

  • Creation of Azure Sql Server and DB5:40

    In this video we will see about Creation of Azure Sql Server and DB

  • Connecting Azure SQLDatabse to Azure studio in your system4:00

    In this video we see about Connecting Azure SQLDatabse to Azure studio in your system

  • What is copy activity1:56
  • Copy activity use case for From Blob storage to Azure db table8:05
  • What is Getmetadata and Creation of Metadata6:07

    In this video we will discuss about What is Getmetadata and Creation of Metadata

  • What is Odata and how to load to csv10:12
  • What is Filter activity and how to use it with other activity4:26

    In this video we will disscuss about What is Filter activity and how to use it with other activity

  • Load Data from Restapi URl to CSV7:22

    In this video we will load data form  RestapiURl to CSV.

  • What is Set variable activity.0:41

    In this video we will see about What is Set variable activity.

  • Web activity with Set variable activity6:04

    Use case of web activity with set variable

  • Append Variable with Getmetadata For each activity scenario4:27

    In this video we will see about use case of Append Variable Getmetdata For each activity scenario

  • Paramteter, getmetadata with IF activity use case8:48

    Paramteter, getmetadata with IF activity use case

Requirements

  • An Azure Account is required, it is easy to create.
  • Experience in Azure is not required, I will take you through everything necessary to learn this course and build the project
  • Basic understanding about cloud computing will be useful, but not mandatory.

Description

Unleash the Power of Azure Data Engineering: Pipelines & Dataflows for Real-World Solutions

Become a highly sought-after Azure Data Engineer by mastering data pipelines and dataflows to build scalable and efficient data solutions in the cloud.

This comprehensive course equips you with the skills and knowledge to design, develop, and deploy robust data pipelines on Microsoft Azure. We'll delve into both Azure Data Factory (ADF) pipelines and Azure Data Flows to empower you to handle various data transformations and integrations seamlessly.

Here's what you'll gain:

  • Solid Foundation: Grasp core concepts of data engineering, cloud data platforms, and the Azure ecosystem.

  • Master Azure Data Factory (ADF): Explore ADF's functionalities for constructing data pipelines, orchestrating data movement, and triggering workflows.

  • Hands-on Dataflow Expertise: Learn to leverage dataflows, a powerful visual tool within ADF, for intuitive data transformations.

  • Data Transformation Powerhouse: Discover a wide range of data transformation techniques using data flows to cleanse, manipulate, and prepare your data.

  • Real-World Use Cases: Apply your newfound skills to build practical data pipelines for common scenarios.

This course is ideal for:

  • Aspiring and Junior Data Engineers seeking to specialize in Azure Data Engineering.

  • Data Analysts wanting to upskill in building data pipelines for their analysis tasks.

  • IT Professionals looking to transition into a cloud-based data engineering role.

  • Anyone interested in leveraging Azure data services for efficient data management.

By the end of this course, you'll be confident in building and deploying robust data pipelines using Azure Data Factory and Dataflows, propelling your career as a data engineer in the thriving cloud computing landscape.

Enroll now and unlock the potential of Azure Data Engineering!


Who this course is for:

  • IT developers working on other disciplines trying to move to Data Engineering
  • University students looking for a career in Data Engineering
  • ETL developer , Data science, Datawarehouse developers needs to up-skill in Azure data engineer

Report abuse