Big Data Analytics with Azure Databricks : Masterclass

Name: Big Data Analytics with Azure Databricks : Masterclass
Rating: 4.3 (244 reviews)

Learn how to perform ETL operations in Azure Databricks. Ideal for DP-203 exams

Last updated 3/2023

English

What you'll learn

4 sections • 12 lectures • 2h 43m total length

Why Cloud Computing ?7:46
Discover why cloud computing meets startup needs by comparing cloud-based solutions with on-prem centers, emphasizing pay as you go pricing, automatic updates, scalable resources, and remote data access.
What is Cloud Computing ?10:41
What is Azure? Create Free Azure Account5:53

Overview of Azure Databricks10:41
Discover how Azure Databricks provides a fully managed Apache Spark cluster in the cloud, enabling distributed data processing, seamless Azure integration, and end-to-end analytics from ingestion to dashboards.
Lab: Create Azure Databricks Workspace3:37
Create an Azure Databricks workspace by selecting a subscription, resource group, workspace name, and region. Explore the workspace to add notebooks, tables, clusters, and jobs.
How to download resources like source code or sourec files?0:04

End to End Data Architecture Overview6:39
Lab: Overview of Source and Destination16:25
Set up source data in a blob storage account, upload customers, product categories, and transactions, then configure a destination database, firewall rules, and a notebook to transform and load data.
Lab: Extract data from source11:54
Lab: Transform and Load Data22:22
Lab: Jobs4:48
Learn to schedule a notebook as a databricks job, configure a cluster (all-purpose vs job cluster), and set schedule, time zone, and start time for automated execution.

Databricks was developed with the original founders of Apache Spark with the motive to solve complex data engineering and data science problems in the most efficient way using distributed cluster based programming with the power of Spark framework under the hood.
Databricks provides fully managed clusters on cloud and integrates well with AWS and Azure both. But, in this course we are going to focus on how to create, manage and perform ETL operations using Azure platform.
In this course, you will learn right from the basics of Azure Databricks and slowly progress towards the advanced topics of performing ETL operations in Azure Databricks using practical hands on lab sessions.
This course is ideal for beginners with little or no knowledge of Databricks.
We will start right from the basics of cloud computing , overview of azure and will slowly progress with the databricks related topics.
All the topics of Azure Databricks are covered using practical hands on lab sessions with easy to understand examples.
Also, this course is helpful for those preparing for Azure Data Engineer Certification (DP-200. DP-201. DP-203)
For any questions or concerns, feel free to drop a message or question in the communication section of Udemy

Note: This course contains code written in scala and sql

Happy Learning !!