Azure Data Engineer Technologies for Beginners [Bundle]
What you'll learn
- You will be able to identify right Azure SQL Server deployment option, purchasing model and service tier according to requirements and will be able to deploy it in cloud.
- You will able to deploy Azure Synapse Analytics (formerly known as Azure SQL Data warehouse) in Azure Cloud environment.
- You will have good internal MPP architecture understanding, and so you will be able to analyse your on-premises data warehouse, and migrate data to Azure Data Warehouse.
- You will be able to create Azure Data Lake Gen1 storage account, populate it will data and analyze it using U-SQL Language.
- You will understand Azure Data Factory key components and advantages. You will be able to create, schedule and monitor simple pipelines.
- We will understand how HDInsight makes Hadoop easy, and we will go through simple demo where we’ll fetch data from Data Lake, process it through Hive and later will store data in SQL Server.
- Basic Database concepts
Why Microsoft Azure Data Engineer?
Microsoft Azure Date Engineering is one of the fastest-growing and in-demand occupations among Data Science practitioners.
According to a 2019 Dice report, there was an 88% year-over-year growth in job postings for data engineers, which was the highest growth rate among all technology jobs.
If you are interested in this domain, there cannot be a better time to start learning these Microsoft Azure Data Solution technologies.
After this course:
Microsoft Azure SQL Server - You will be able to identify the right Azure SQL Server deployment option, purchasing model and service tier according to requirements and will be able to deploy it in the cloud. You will be able to set up a security configuration to secure your database.
Microsoft Azure SQL Data Warehouse - You will able to deploy Azure Synapse Analytics (formerly known as Azure SQL Data warehouse) in Azure Cloud environment. You will have good internal MPP architecture understanding, and so you will be able to analyze your on-premises data warehouse and migrate data to Azure Data Warehouse.
Microsoft Azure Data Lake - You will be able to create Azure Data Lake storage account, populate it will data using different tools and analyze it using Databricks and HDInsight
Microsoft Azure Data Factory - You will understand Azure Data Factory's key components and advantages. You will be able to create, schedule and monitor simple pipelines.
Hadoop Basics - You will learn the fundamental understanding of the Hadoop Ecosystem and 3 main building blocks. This module will prepare you to start learning Big Data in Azure Cloud using HDInsight.
Microsoft Azure HDInsight - We will understand how HDInsight makes Hadoop easy, and we will go through simple demo where we’ll fetch data from Data Lake, process it through Hive and later will store data in SQL Server.
Cosmos DB - You will understand all basic concepts of Cosmos DB, and will be able to create a new database, container, documents, and choose right partition key, configure the global distribution and use other important features
Streaming Service - I will add details soon
Databricks - Video lessons added, I will add details here soon
Storage Service - Video lessons added, I will add details soon
Beginners in Microsoft Azure Platform
Microsoft Azure Data Engineers
Microsoft Azure Data Scientist
Database and BI developers
Data Analyst or similar profiles
On-Premises Database related profiles who want to learn how to implement these technologies in Azure Cloud.
Anyone who is looking forward to starting his career as an Azure Data Engineer.
"if you are already experienced and working on these technologies, this may not be the best course for you."
I have a few crash courses (Free) for absolute beginners, you can find links on my website.
Basic T-SQL and Database concepts
Microsoft Azure Free trial Subscription
If you are not comfortable in English, please do not take a course, captions are not good enough to understand the course.
Video lectures, PPTs, Demo Resources, Quiz, Assignment, other important links
Full lifetime access with all future updates
Certificate of course completion
30-Day Money-Back Guarantee
I am consistently adding new content in terms of both lectures and demos. Please find below logs for past and upcoming changes.
Jan 2021 - Revised Synapse module with all new changes
Aug 2020 - Data Encryption related lessons added
July 2020 - Monitoring and Optimization of services
July 2020 - AMS (Azure Monitoring Service)
July 2020 - Re-recorded Azure Data Factory with all new updates
July 2020 - NoSQL Databases in Microsoft Azure (Azure Blob Storage)
July 2020 - Added Azure Databricks Module
July 2020 - Added Azure Streaming Analytics Module
June 2020 - Added Azure Cosmos DB Module
May 2020 - Full-length course on Data Lake
Apr 2020 - Added modules on Azure cloud computing basics, and Data Engineer profile
Apr 2020 - Added crash course on cloud computing and data warehouse
Mar 2020 - Added Azure Synapse Analytics
Feb 2020 - Added Azure SQL Database
Oct 2019 - Added Azure HDInsight
Sep 2019 - Added Azure Data Factory
Aug 2019 - Course Created on Azure Data Lake
Course In Detail
By the end of this course
Microsoft Azure SQL Server -
You will know the advantages of Azure Database over on-premises Database
You will be able to provision all three types of Azure Database PaaS Deployments (Single, Elastic Pool, Managed Instance)
You will learn different purchasing models and Service tiers and how to configure them according to requirements.
You will be able to provision Azure Database in Virtual Machine (IaaS)
You will be able to deploy Elastic Pool Database and able to add/remove more databases from the pool.
You will be able to deploy the Managed Instance Database, configure it and connect it with your SQL Server Management studio.
Microsoft Azure Synapse Analytics Service
You will learn why we should consider warehousing solutions in the cloud.
You will learn about Microsoft's brand new Azure Synapse analytics service, and how this service brings together enterprise data warehousing and Big Data analytics, and provide a unified experience to ingest, prepare, manage, and serve data for immediate BI and machine learning needs.
You will learn the difference between Traditional vs Modern vs Synapse Architecture.
You will learn Azure famous MPP (Massive Parallel Processing) architecture
You will also learn many internal concepts like Data Distribution, Sharding, and partitioning.
You will learn different migration methods and best practices.
You will learn PolyBase setup (Best Loading method)
You will perform a lot of demos to migrate data to Azure SQL Data warehouse using SSIS, Data Factory and PolyBase.
Microsoft Azure Data Lake Gen1
You will learn the limitations of traditional database systems to handle the Big Data revolution.
You will learn the difference between Azure Data Lake, SSIS, Hadoop and Data Warehouse.
You will be able to create Azure Data Lake Gen1 storage account, populate it will data and analyze it using U-SQL Language.
Microsoft Azure Data Factory -
You will understand Azure Data Factory's key components and advantages.
You will be able to create, schedule and monitor simple pipelines.
You will learn a fundamental understanding of the Hadoop Ecosystem and 3 main building blocks.
This module will prepare you to start learning Big Data in Azure Cloud using HDInsight.
Microsoft HDInsight -
You will learn what are the challenges with Hadoop and how HDInsight solves these challenges.
You will also learn Cluster types, HDInsight Architecture and other important aspects of Azure HDInsight.
You will also go through demo where we’ll fetch data from Data Lake, process it through Hive and later will store data in SQL Server.
Some students Feedback
One of the most amazing courses i have ever taken on Udemy. Please don't hesitate to take this course. The instructor is really professional and has a great experience about the subject of the course. - Khadija Badary
Very nicely explained most of the concepts. a must have course for beginners - Manoranjan Swain
I appreciate this course explaining everything in great detail for a beginner. This will assist me in overcoming challenges at my work - Benjamin Curtis
Good course for Beginners. Labs are really helpful to grasp the concept. Thank you - Sapna
Who this course is for:
- Beginners in Azure Platform
- Database Developer
- Database Administrators (DBA)
- Business Intelligence (BI) Developers
- Data Engineers
- Data Scientist
- Data Analyst or similar profiles
- Other on-premises Database related profiles who want to learn how to implement these technologies in Azure Cloud.
- Anyone who is looking forward to start his career as a Azure Data Engineer
I love to explain complicated things in a simple and effective way.
I have 16 years of extensive professional experience with expertise in Database and Business Intelligence Solutions, Advanced Analytics, Design and Solution Architect, Reporting, and Cloud Computing Technologies (Azure & AWS).
As a developer and architect, I have worked closely with customers, users, and colleagues to support business solutions across a variety of industries including healthcare, insurance, finance, and government ranging from small companies to fortune 500 companies.
Outside of the technical world, I love yoga and meditation. I am a student of the ancient yogic text Bhagavad Gita and love to discuss and practice philosophical teachings.