Master Microsoft Fabric: Data Engineer to Real-time Insight

Name: Master Microsoft Fabric: Data Engineer to Real-time Insight
Rating: 4.4 (3 reviews)

The Future of Unified Data Analytics by using Data engineer, Datawarehouse, Lakehouse and Realtime analytics

Created byi need techology

Last updated 6/2024

English

What you'll learn

Lakehouse
Datafactory
Dataflowgen-2
Notebook using pyspark
Data Warehouses
Realtime Intelligence

Course content

7 sections • 59 lectures • 5h 15m total length

What is Microsoft Fabric3:01
What is Microsoft fabric and benefits.
What is workspace and how to create it5:11

What is Pipeline in Data factory3:01
What is pipeline and use case in Data-factory.
What is Data factory and its use case3:21
In this video we are going to see what is data-factory and its use case.
Data factory Walkthrough4:50
In this video we will discuss about Data factory walkthrough.
What is IF activity in Datafactory6:03
In this video, we can see about If activity.
What is Getmetadata activity in Datafactory5:04
In this video, we can see about Getmetadata activity.
Get metadata with IF scenarios6:03
In this video, we can see about Getmetadata activity with If activity use case.
What is foreach activity2:11
What is foreach activity in Datafactory
What is lookup activity in data factory6:41
In this video, we can see about lookup activity and use case.
lookup activity with foreach activity scenario wise14:06
How to use use lookup activity with foreach based on scenariowise
What is switch activity & Parameter3:23
In this video, we can see about switch and parameter in data-factory.
Switch activity with Paramter use case scenario wise8:39
In this video, we can see about switch with parameter use case

What is Data warehouse in Microsoft fabric3:07
What is datawarehouse in Microsoft fabric
Datawarehouse Walkthrough4:34
In this section we can see for datawarehouse walkthrough
Get Data Approach using Pipeline in Datawarehouse5:58
We can see how to use get data using pipeline approach.
Get Data Approach using Dataflow gen2 in Datawarehouse7:04
We can see how to use get data using dataflowgen2 approach.
Creation of Dimension table and Fact table in Datawarehouse by scenario-16:34
In this video we can see about creation of Dimension table and Fact table creation in data warehouse.
Creation of stored procedure scenario-26:00
In this video we can see about creation of stored procedure in data warehouse.
What is T-sql in microsoft Fabric3:34
What TSQL in Microsoft fabric
TSql commands use case of -Create, Copy, CTAS4:40
In this video we can see about how to create, use copy and CTAS commands of TSQL
New sql query use case4:53
How to use newsql query option in Datawarehouse
Notebook use case in Lake house4:23
We can see about use case of Notebook.
What is Semantic Model in Lakeh ouse1:53
What is semantic model in Lakehouse.

What is lake-house in Microsoft Fabric4:21
In this video we will see about What is Lakehouse in Microsoft Fabric
What is workspace2:51
What is work space in Microsoft fabric.
Workspace and lake house creation in Microsoft fabric4:01
In this video we can see about workspace creation and Lakehouse.
Get data approach for file upload in lake house4:00
In this video we will see about get data upload option in Lakehouse.
Get_data using Pipeline in lake house.5:07
In this video we will see about get data pipleline option in Lakehouse.
Get data using Dataflow gen2 in lake house3:45
In this video we will see about get data dataflowgen2 option in Lakehouse.
Get data using Event streaming in lake house8:00
What is Semantic Model in Lakehouse1:53
What is semantic model .
Semantic model use case in Lakehouse5:37
use case of semantic model in lakehouse

What is Dataflow Gen2 in MF4:09
What is Dataflow gen2 in Microsoft fabric
Dataflow Gen2 walkthrough and creation of sample data set4:54
Dataflow gen 2 Walkthrough and creation
Dataflow gen2 Transformation(Filters, split columns, rename etc10:46
In this video we can see about Dataflow gen2 transformations of filter rename and split columns etc.
Data flow gen2 Transformation (joins, group by etc)8:44
in this video we can see about Dataflow gen2 transformations of Merger(joins) and group by etc.
What is Spark3:29
What is Spark in microsoft fabric

What is Notebook in Microsoft fabric3:46
What is Notebook in Microsoft fabric and use case
Notebook walkthrough and sample creation5:05
Notebook walk though and sample creation in Microsoft fabric.
Filter creation using Pyspark2:39
In this video we can see about filter creation in note book using pyspark.
Joins using Pyspark6:10
In this video we can see about joins by using pyspark in notebook
Aggregation using Pyspark4:38
In this video we can see about aggregation by using pyspark in notebook
Union using pyspark4:32
In this video we can see about unions by using pyspark in notebook.
Rank using pyspark3:28
Pivot using pyspark3:52
In this video we can see about pivot by using pyspark in notebook.
Unpivot using pyspark4:43
In this video we can see about unpivot by using pyspark in notebook.
Write method using pyspark6:26
In this video we can see about write method by using pyspark in notebook.
What is Delta table and how to create it6:19
In this video we see about what is Delta table and how to create it.

What is Realtime Intelligence1:55
What is KQL DB2:44
In this session you willl understand What is KQL DB in Realtime Intelligence.
What is event stream in Realtime intelligence2:51
What is KQL query2:55
In this session you get about what is KQL query in Realtime intelligence Microsoft fabric.
What is KQL query set its usecase4:56
Use-case of KQL DB and KQL query in realtime intelligence4:56
In this session you get about use case of KQL DB and KQL queries in Realtime intelligence Microsoft fabric.
Event streaming approach loading data to lake house7:47
In this session you get about how to load data to Lake house using of Event stream in Realtime intelligence in Microsoft fabric.
Data-loading to KQL DB using Event stream7:47
In this session you get about how to load data to KQL database using of Event stream in Realtime intelligence in Microsoft fabric.
Event house Walkthrough in Realtime Intelligence5:28
In this session you get about how to use Event house in Realtime intelligence in Microsoft fabric.
END To END project by using Event streaming for OTT data api26:51
In this session you will get an end to end project by use case in realtime intelligence.

Requirements

No prior experience with Microsoft Fabric is required Some experience with data analysis and/or data engineering would be helpful, but not required

Description

Unleash the power of your data for deeper insights!

Microsoft Fabric is a comprehensive suite of cloud-based data management and analytics services designed to simplify your data journey. This course equips you with the knowledge and skills to leverage Fabric's components to:

Ingest data from various sources like lakhehouse, cloud storage, and web APIs.
Transform and prepare data for analysis using intuitive visual tools and powerful data manipulation capabilities.
Store and manage data in a secure and scalable data lakehouse environment.
Analyze data with familiar SQL queries and interactive notebooks.
Build data pipelines to automate data processing tasks.
Gain insights from your data through powerful visualizations and reporting tools.

Key Components of Microsoft Fabric:

Azure Data Factory (ADF): Your central hub for building data pipelines that automate data movement and transformation.
Fabric Data Warehouse: A fast and scalable data warehouse powered by SQL, enabling you to analyze historical data for trends and insights.
Lakehouse: Combines the flexibility of a data lake with the structure of a data warehouse, allowing you to store and analyze all your data in a single platform.
Dataflow Gen2: A visual data workflow builder that simplifies data ingestion and transformation with drag-and-drop functionality.
SQL Analytics Endpoint: Provides a familiar SQL interface for querying data stored within your data lake.
Workspaces: Centralized locations to organize and manage your data objects, reports, and applications.
Integration with Power BI: Leverage the popular Power BI tool for interactive data visualization and reporting based on your Fabric data.
Realtime Intelligence: Explore major use case of Realtime Intelligence with visual interface

By the end of this course, you'll be able to:

Understand the core concepts of Microsoft Fabric and its components.
Build data pipelines using Azure Data Factory.
Explore and analyze data using the Fabric Data Warehouse and SQL queries.
Leverage notebooks for interactive data exploration and analysis.
Manage and collaborate on data projects within Fabric workspaces.
Gain valuable insights from your data to make informed decisions.

Ready to unlock the potential of your data? Enroll now and start your data analysis journey with Microsoft Fabric!

Who this course is for:

This course is designed for professionals in data analysis, data science, data engineering, Power BI development and other professional.
Curious beginners eager to learn this Microsoft Fabric key skills.

Master Microsoft Fabric: Data Engineer to Real-time Insight

What you'll learn

Explore related topics

Course content

Introductions2 lectures • 8min

Data Factory in Microsoft Fabric11 lectures • 1hr 3min

Datawarehouse in Microsoft Fabric11 lectures • 53min

Lakehouse in Microsoft Fabric9 lectures • 40min

Dataflow Gen2 in Microsoft Fabric5 lectures • 32min

Pyspark for Data engineer in Microsoft fabric11 lectures • 52min

Realtime Time Intelligence in Microsoft fabric10 lectures • 1hr 8min

Requirements

Description

Who this course is for: