Metadata Management Fundamentals
4.4 (55 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
201 students enrolled

Metadata Management Fundamentals

Back to Basics
4.3 (55 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
203 students enrolled
Created by Sid Inf
Last updated 10/2019
English
English [Auto]
Current price: $139.99 Original price: $199.99 Discount: 30% off
5 hours left at this price!
30-Day Money-Back Guarantee
This course includes
  • 3 hours on-demand video
  • 1 downloadable resource
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion
Training 5 or more people?

Get your team access to 4,000+ top Udemy courses anytime, anywhere.

Try Udemy for Business
What you'll learn
  • What is Metadata?
  • Learn about the importance of Metadata to an Enterprise
  • The Business Value of Metadata for an Enterprise
  • Types of Metadata
  • Real Time Use Case 1: How to fetch Metadata from different Data Layers of an Enterprise Data Warehouse?
  • Real Time Use Case 2:How to fetch Metadata from different Data Layers of a Hybrid Enterprise Data Warehouse involving Big Data?
  • How does the different data layers of an application connect via Metadata?
  • What problems does the Metadata Management Solves?
  • What business questions does the Metadata Management answer?
  • What are Data Assets?
  • What is Data Lineage?
  • What is Data Stewardship?
  • What are the different domains from which Metadata can be fetched and liked for trace-ability?
  • How does Metadata Management relate to Data Management?
Requirements
  • Data Warehouse Concepts
  • BigData Concepts
  • Data Management Concepts
Description

Let’s get started with the basics of Metadata Management.

Setting up the Metadata Management initiative at the enterprise level serves a variety of purposes. Data Asset discovery,  effective cataloging,  identifying resources, defining them by criteria, bringing similar resources together and the most important of them all is to have a Self Service approach to the enterprise assets.

It also is an effective means of organizing enterprise data assets, which is the need of the hour considering the huge variety and volumes of data and new ways of doing business online. Typically, all the metadata is stored in documents or excel sheets which are not usually up to date just for the namesake and these documents do not really have what one needs. A more efficient way is to use metadata to define, build lineage, relationships and create trace-ability so that the enterprise data citizens can easily find the data, the systems in which the data resides and the owners or stewards of the data.

Investing in metadata management/development have a lot of benefits:

  • Simplify data discovery and history of the data with a record of content-rich data across the enterprise.

  • Most of the enterprises have to manage increasingly complex systems in various locations and on varied platforms. By managing metadata effectively, organizations can create an inventory of its data and learn about its transformation across the life cycle, along with the variety of meaning and formats, and locations of each data object.

  • Drive consistency through data reuse, to increase productivity and reduce time needed for project implementation.

  • A managed metadata environment serves as the most effective way to identify the appropriate data elements / objects needed for any use.

  • Metadata Management allows companies to retire unused storage, reducing costs, and reducing time that was spent in deciding among “possibly correct” variations of an attribute.

  • Retain staff knowledge that is lost when business rules, definitions and other forms of metadata are not documented. Often, business metadata remains only in the minds of certain employees. When these individuals leave the company, this knowledge disappears with them. Implementing an enterprise approach to managing metadata preserves this knowledge and reduces the risk of losing valuable contextual knowledge.

  • Increase confidence in the data delivered to business users. Tracking data lineage provides important context to business users. Profiling data in source systems by business data stewards and IT staff can resolve data errors, which will result in accurate, reliable, high-quality data presented in reports, queries and analytics.

  • Improve IT performance in development, impact analysis, data integration, change management, etc… All of these enhancements will enable greater cooperation between business and IT, and ultimately lower total costs of any systems initiative. Metadata helps IT understand what data exists, where it is located, and what it means, minimizing information complexity. The ability to assess the impact of potential changes based on improved knowledge of the data can help managers estimate project duration and resource costs more accurately.

Who this course is for:
  • All roles which involves and works with data on a daily basis from a Developer to the CDO or a CIO
Course content
Expand all 35 lectures 02:48:15
+ Introduction
7 lectures 38:56

Metadata is simply data about data. It means it is a description and context of the data. It helps to organize, find and understand data.

Preview 02:50

Here are some of the Metadata examples which we see on a daily basis

Preview 09:47

Metadata is created and collected because it enables and improves use of that data. Metadata ensures that we will be able find data, use data, and preserve and re-use data in the future.

Preview 06:32

This lecture talks about the different common questions Metadata Management can answer.

What questions does Metadata Management helps us to answer?
05:06

This lecture talks about the common questions for a specific attribute in a real time project.

What are the common Questions specific to an attribute in a real time project?
01:55

How does Metadata help with the Business Processes and Procedures?

How does Metadata help with the Business Processes and Procedures?
07:29

How does Metadata help with the Regulations and compliance like GDPR and CCPA?

How does Metadata help with the Regulations and compliance like GDPR and CCPA?
05:17
+ Types of Metadata
8 lectures 27:37

Let's understand the different types of Metadata

Introduction to different types of Metadata
03:29
  • Business rules

  • Stewardship

  • Business Definitions

  • Auditing

  • Terminology

  • Glossaries

  • Algorithms

  • Lineage using business language

Business Metadata
06:47

Technical metadata consists of metadata that is associated with data transformation rules, data storage structures, semantic layers, and interface layers.

Technical Metadata
02:07

Difference between Technical Metadata and Business Metadata

Difference between Technical Metadata and Business Metadata
05:15

Operational metadata is made up of the operational reporting and statistics such as access logs, timestamps, transaction counts and volumes, or system performance and response times.

Operational Metadata
02:31

Governance Metadata Contains information about various data domains, data owners, data stakeholders, data stewards, data standards, policies, processes and workflows.

Governance Metadata
02:23

Let's do a quick review of the different types of Metadata

Summary of different types of Metadata
01:43

Descriptive, Structural and Administrative Metadata Types

Descriptive, Structural and Administrative Metadata Types
03:22
+ Metadata Origins in an Enterprise
1 lecture 08:10

Where does Metadata exists in the Organization?

Where does Metadata exists in the Organization?
08:10
+ Real Time Use Case : Using Enterprise Data Warehouse Applications
9 lectures 01:08:08

This lecture explains the overall data flow of the Generic Data Warehouse Architecture and how the different types of Metadata are available at different stages.

The Architecture
09:51

This lecture explains what is happening now at the Enterprise Level when it comes to Metadata with real time examples

What is happening now at an Enterprise level?
17:10

What are the common questions we get on a daily basis?

What are the common questions we get on a daily basis?
06:05

Metadata Repository is the answer

Metadata Repository is the answer
09:41

How do we access the Metadata Repository Tool?

How do we access the Metadata Repository Tool?
03:27

Self Service Metadata Management

Self Service Metadata Management
02:44

Data Lineage/ Data Traceability

Data Lineage/ Data Traceability
12:30

Relationships within Metadata

Relationships within Metadata
03:28

Enterprise View of Metadata

Enterprise View of Metadata
03:12
+ Real Time Use Case : How to fetch Metadata from BigData Tools and Technologies?
10 lectures 25:24

In this lecture, we will talk about the Hybrid BigData Warehouse Architecture

The Hybrid BigData Warehouse Architecture
07:22

We will talk about the different ways the Metadata can be ingested from various sources of the system.

Where to start the Metadata Ingestion?
03:13

Metadata from the Source Layer

Metadata from the Source Layer
01:50

Metadata from JSON format

Metadata from JSON format
00:50

Metadata from Relational tools and technologies

Metadata from Relational tools and technologies
00:49

Metadata from HDFS Layer

Metadata from HDFS Layer
04:02

Metadata from EDW/Data Marts/Hive/Analytics Layer

Metadata from EDW/Data Marts/Hive/Analytics Layer
01:04

Metadata from Analytics/Reporting Layer

Metadata from Analytics/Reporting Layer
01:03

Metadata from Data Science and Transformation Logic

Metadata from Data Science and Transformation Logic
03:55

How does all the Metadata tie up?

How does all the Metadata tie up?
01:16