SlideShare una empresa de Scribd logo
1 de 33
Role of Metadata
Why Metadata
 Before touches the keyboard by the
prominent(superlative) users.
 Several questions come to their mind.
What are various data in the data
warehouse?
Is there information about unit sale and
costs by product?
How old is the data in the warehouse.
When was the last time fresh data was
brought in?
Are there any summaries by month and
product?
Why Meta data contd.,
 These questions and several more
information are very valid and pertinent.
 What are answers? Where are the
answers? Can ur user see the answers?
How easy to get the answers?
What is Meta data?
 Metadata in a data warehouse contains
the answer to questions about the data
in the data warehouse.
 Keep the answer in a place called the
metadata repository.
Different definitions for
metadata
 Data about the data.
 Table of contents for the data.
 Catalog for the data.
 Data warehouse roadmap.
 Data warehouse directory.
 Tongs to handle the data.
 The nerve center.
So, what exactly is metadata
 It tells u more.
 It gives more than the explanation of the
semantics and the syntax.
 Describes all the pertinent(relevant)
aspect of the data in the data
warehouse.
 Pertinent to whom?
 The answer is – primarily to the user
and also developer and even project
team.
Meta data
Why it is important?
 Metadata is necessary for using,
building and administering your data
warehouse.
For using the data warehouse
 Without the metadata support, user
cannot get an information every time
they needed(user create their own ad
hoc report).
 Today data warehouses are much larger
in size, wide in scope.
 User critically need metadata.
For building the data
warehouse(extraction team)
 Need to know the structure and data
content in the data warehouse.
 Mapping and data transformations.
 Logical structure of data warehouse
database.
For administering the data
warehouse
 Impossible to administer the data
warehouse(size)
 Large no of questions and queries.
 Cannot administer without answers for
these questions.
 Metadata must address these issues.
List of questions relating to
data warehouse
Who needs metadata?
 Without metadata, Datawarehouse is
like such a filling cabinet without
information.
 Go through the image column(it address
the our question)
Like a nerve center
 Metadata placed in a key position and
enables communication among various
processes.
Why metadata is essential for
IT
 Development and deployment of data
warehouse is joint effort between users
and IT staff.
 Technical issue-IT primarily responsible
design and ongoing administration.
 Metadata essential for IT
 beginning with the data extraction and
ending with information delivery.
 It drives and record the each processes.
Summary list of process in which
metadata is significant for IT
 Data extraction
 Data transformation
 Data scrubbing
 Data staging
 Data refreshment
 Database design
 Query report and design
Automation of DWH tasks
Types by Functional Area
 Classify and group in various way-some
by usage and who use it
 Administrative/End-user/Optimization
 Technical/Business
 Development/usage
 In the data mart/At the workstation
 Bank room/front room
 Internal/External
Functional Areas
 Data Acquisition
 Data stroage
 Information delivery
Data Acquisition
 DWH process related to following
functions.
Data extraction
Data transformation
Data cleaning
Data integration
Data staging
Data aquisition
Data stroage
 Data loading
 Data archiving
 Data management
 Use metadata in this area for full data
refresh and load.
Information Delivery
 Report generating
 Query processing
 Complex analysis
Mostly this are meant for end-user.
Metadata recorded in processes of other
two areas.
It also record OLAP-the developer and
administrators are involved in this
processes.
Business METADATA
 It connect business with DWH.
 Business users need more than other
users.
 Business metadata is like a roadmap.
 Tout guide-managers and analysis.
 Must describe the contents in plain
language giving information in business
teerms.
 Example
The name of data tables (or) individual
element must not be cryptic.
The data item name-calc_pr_sle.
You need to rename this as calculated-prior-
month-sale
Business metadata Contd.,
 Much less structured than technical
metadata.
 Textual documents, spreadsheets, and
even business rules and policies not
written down completely.
Examples of Business
Metadata who Benefits?
 Primarily benefits end-users.
Managers
Business analysis
Power users
Regular users
Casual users
Senior managers/ junior managers
Technical Metadata
 IT staff- Development and
Administration of the data warehouse.
 Who Benefits?
Project manager
Data warehouse administrator
Metadata manager
Database administrator
Business analyst
Data quality analyst

Más contenido relacionado

La actualidad más candente

OLAP & DATA WAREHOUSE
OLAP & DATA WAREHOUSEOLAP & DATA WAREHOUSE
OLAP & DATA WAREHOUSEZalpa Rathod
 
1. Introduction to DBMS
1. Introduction to DBMS1. Introduction to DBMS
1. Introduction to DBMSkoolkampus
 
Data Warehouse Basic Guide
Data Warehouse Basic GuideData Warehouse Basic Guide
Data Warehouse Basic Guidethomasmary607
 
Data Warehouse Architectures
Data Warehouse ArchitecturesData Warehouse Architectures
Data Warehouse ArchitecturesTheju Paul
 
Data preprocessing
Data preprocessingData preprocessing
Data preprocessingankur bhalla
 
Building an Effective Data Warehouse Architecture
Building an Effective Data Warehouse ArchitectureBuilding an Effective Data Warehouse Architecture
Building an Effective Data Warehouse ArchitectureJames Serra
 
OLAP in Data Warehouse
OLAP in Data WarehouseOLAP in Data Warehouse
OLAP in Data WarehouseSOMASUNDARAM T
 
Data warehouse architecture
Data warehouse architecture Data warehouse architecture
Data warehouse architecture janani thirupathi
 
12. oracle database architecture
12. oracle database architecture12. oracle database architecture
12. oracle database architectureAmrit Kaur
 
Date warehousing concepts
Date warehousing conceptsDate warehousing concepts
Date warehousing conceptspcherukumalla
 
data warehouse , data mart, etl
data warehouse , data mart, etldata warehouse , data mart, etl
data warehouse , data mart, etlAashish Rathod
 
Data Warehousing and Data Mining
Data Warehousing and Data MiningData Warehousing and Data Mining
Data Warehousing and Data Miningidnats
 

La actualidad más candente (20)

OLAP & DATA WAREHOUSE
OLAP & DATA WAREHOUSEOLAP & DATA WAREHOUSE
OLAP & DATA WAREHOUSE
 
1. Introduction to DBMS
1. Introduction to DBMS1. Introduction to DBMS
1. Introduction to DBMS
 
Data warehouse
Data warehouseData warehouse
Data warehouse
 
Data warehouse
Data warehouseData warehouse
Data warehouse
 
Data Warehouse Basic Guide
Data Warehouse Basic GuideData Warehouse Basic Guide
Data Warehouse Basic Guide
 
Data warehouse
Data warehouse Data warehouse
Data warehouse
 
Data warehouse
Data warehouseData warehouse
Data warehouse
 
Data Warehouse Architectures
Data Warehouse ArchitecturesData Warehouse Architectures
Data Warehouse Architectures
 
Data warehouse
Data warehouseData warehouse
Data warehouse
 
Data preprocessing
Data preprocessingData preprocessing
Data preprocessing
 
Ppt
PptPpt
Ppt
 
Building an Effective Data Warehouse Architecture
Building an Effective Data Warehouse ArchitectureBuilding an Effective Data Warehouse Architecture
Building an Effective Data Warehouse Architecture
 
DBMS
DBMSDBMS
DBMS
 
OLAP in Data Warehouse
OLAP in Data WarehouseOLAP in Data Warehouse
OLAP in Data Warehouse
 
Data warehouse architecture
Data warehouse architecture Data warehouse architecture
Data warehouse architecture
 
12. oracle database architecture
12. oracle database architecture12. oracle database architecture
12. oracle database architecture
 
Date warehousing concepts
Date warehousing conceptsDate warehousing concepts
Date warehousing concepts
 
Data warehousing
Data warehousingData warehousing
Data warehousing
 
data warehouse , data mart, etl
data warehouse , data mart, etldata warehouse , data mart, etl
data warehouse , data mart, etl
 
Data Warehousing and Data Mining
Data Warehousing and Data MiningData Warehousing and Data Mining
Data Warehousing and Data Mining
 

Similar a Metadata in data warehouse

Dataware housing
Dataware housingDataware housing
Dataware housingwork
 
dw_concepts_2_day_course.ppt
dw_concepts_2_day_course.pptdw_concepts_2_day_course.ppt
dw_concepts_2_day_course.pptDougSchoemaker
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.pptSumathiG8
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.pptPalaniKumarR2
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousingwork
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousingsumit621
 
Report for internship
Report for internshipReport for internship
Report for internshipSalman Khan
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.pptSamPrem3
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data WarehousingJason S
 
Data warehouse
Data warehouseData warehouse
Data warehouseMR Z
 
Datawarehousing & DSS
Datawarehousing & DSSDatawarehousing & DSS
Datawarehousing & DSSDeepali Raut
 
3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.pptBsMath3rdsem
 
Data warehousing
Data warehousingData warehousing
Data warehousingkeeyre
 
Metadata Repositories in Health Care - Master Data Management Approach to Met...
Metadata Repositories in Health Care - Master Data Management Approach to Met...Metadata Repositories in Health Care - Master Data Management Approach to Met...
Metadata Repositories in Health Care - Master Data Management Approach to Met...Health Informatics New Zealand
 
Dw & etl concepts
Dw & etl conceptsDw & etl concepts
Dw & etl conceptsjeshocarme
 
Data warehouse-dimensional-modeling-and-design
Data warehouse-dimensional-modeling-and-designData warehouse-dimensional-modeling-and-design
Data warehouse-dimensional-modeling-and-designSarita Kataria
 

Similar a Metadata in data warehouse (20)

Metadata
MetadataMetadata
Metadata
 
Dataware housing
Dataware housingDataware housing
Dataware housing
 
dw_concepts_2_day_course.ppt
dw_concepts_2_day_course.pptdw_concepts_2_day_course.ppt
dw_concepts_2_day_course.ppt
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousing
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousing
 
E05WAREH1.PPT
E05WAREH1.PPTE05WAREH1.PPT
E05WAREH1.PPT
 
Planning Data Warehouse
Planning Data WarehousePlanning Data Warehouse
Planning Data Warehouse
 
Report for internship
Report for internshipReport for internship
Report for internship
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data Warehousing
 
Data warehouse
Data warehouseData warehouse
Data warehouse
 
Presentation
PresentationPresentation
Presentation
 
Datawarehousing & DSS
Datawarehousing & DSSDatawarehousing & DSS
Datawarehousing & DSS
 
3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt
 
Data warehousing
Data warehousingData warehousing
Data warehousing
 
Metadata Repositories in Health Care - Master Data Management Approach to Met...
Metadata Repositories in Health Care - Master Data Management Approach to Met...Metadata Repositories in Health Care - Master Data Management Approach to Met...
Metadata Repositories in Health Care - Master Data Management Approach to Met...
 
Dw & etl concepts
Dw & etl conceptsDw & etl concepts
Dw & etl concepts
 
Data warehouse-dimensional-modeling-and-design
Data warehouse-dimensional-modeling-and-designData warehouse-dimensional-modeling-and-design
Data warehouse-dimensional-modeling-and-design
 

Más de Siddique Ibrahim (20)

List in Python
List in PythonList in Python
List in Python
 
Python Control structures
Python Control structuresPython Control structures
Python Control structures
 
Python programming introduction
Python programming introductionPython programming introduction
Python programming introduction
 
Data mining basic fundamentals
Data mining basic fundamentalsData mining basic fundamentals
Data mining basic fundamentals
 
Basic networking
Basic networkingBasic networking
Basic networking
 
Virtualization Concepts
Virtualization ConceptsVirtualization Concepts
Virtualization Concepts
 
Networking devices(siddique)
Networking devices(siddique)Networking devices(siddique)
Networking devices(siddique)
 
Osi model 7 Layers
Osi model 7 LayersOsi model 7 Layers
Osi model 7 Layers
 
Mysql grand
Mysql grandMysql grand
Mysql grand
 
Getting started into mySQL
Getting started into mySQLGetting started into mySQL
Getting started into mySQL
 
pipelining
pipeliningpipelining
pipelining
 
Micro programmed control
Micro programmed controlMicro programmed control
Micro programmed control
 
Hardwired control
Hardwired controlHardwired control
Hardwired control
 
interface
interfaceinterface
interface
 
Interrupt
InterruptInterrupt
Interrupt
 
Interrupt
InterruptInterrupt
Interrupt
 
DMA
DMADMA
DMA
 
Io devies
Io deviesIo devies
Io devies
 
Stack & queue
Stack & queueStack & queue
Stack & queue
 
Data extraction, transformation, and loading
Data extraction, transformation, and loadingData extraction, transformation, and loading
Data extraction, transformation, and loading
 

Último

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbuapidays
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfOverkill Security
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesrafiqahmad00786416
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...apidays
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 

Último (20)

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 

Metadata in data warehouse

  • 2. Why Metadata  Before touches the keyboard by the prominent(superlative) users.  Several questions come to their mind. What are various data in the data warehouse? Is there information about unit sale and costs by product? How old is the data in the warehouse. When was the last time fresh data was brought in? Are there any summaries by month and product?
  • 3. Why Meta data contd.,  These questions and several more information are very valid and pertinent.  What are answers? Where are the answers? Can ur user see the answers? How easy to get the answers?
  • 4. What is Meta data?  Metadata in a data warehouse contains the answer to questions about the data in the data warehouse.  Keep the answer in a place called the metadata repository.
  • 5. Different definitions for metadata  Data about the data.  Table of contents for the data.  Catalog for the data.  Data warehouse roadmap.  Data warehouse directory.  Tongs to handle the data.  The nerve center.
  • 6. So, what exactly is metadata  It tells u more.  It gives more than the explanation of the semantics and the syntax.  Describes all the pertinent(relevant) aspect of the data in the data warehouse.  Pertinent to whom?  The answer is – primarily to the user and also developer and even project team.
  • 8. Why it is important?  Metadata is necessary for using, building and administering your data warehouse.
  • 9. For using the data warehouse  Without the metadata support, user cannot get an information every time they needed(user create their own ad hoc report).  Today data warehouses are much larger in size, wide in scope.  User critically need metadata.
  • 10. For building the data warehouse(extraction team)  Need to know the structure and data content in the data warehouse.  Mapping and data transformations.  Logical structure of data warehouse database.
  • 11. For administering the data warehouse  Impossible to administer the data warehouse(size)  Large no of questions and queries.  Cannot administer without answers for these questions.  Metadata must address these issues.
  • 12. List of questions relating to data warehouse
  • 13. Who needs metadata?  Without metadata, Datawarehouse is like such a filling cabinet without information.  Go through the image column(it address the our question)
  • 14.
  • 15. Like a nerve center  Metadata placed in a key position and enables communication among various processes.
  • 16.
  • 17. Why metadata is essential for IT  Development and deployment of data warehouse is joint effort between users and IT staff.  Technical issue-IT primarily responsible design and ongoing administration.  Metadata essential for IT  beginning with the data extraction and ending with information delivery.  It drives and record the each processes.
  • 18.
  • 19. Summary list of process in which metadata is significant for IT  Data extraction  Data transformation  Data scrubbing  Data staging  Data refreshment  Database design  Query report and design
  • 21. Types by Functional Area  Classify and group in various way-some by usage and who use it  Administrative/End-user/Optimization  Technical/Business  Development/usage  In the data mart/At the workstation  Bank room/front room  Internal/External
  • 22. Functional Areas  Data Acquisition  Data stroage  Information delivery
  • 23. Data Acquisition  DWH process related to following functions. Data extraction Data transformation Data cleaning Data integration Data staging
  • 25. Data stroage  Data loading  Data archiving  Data management  Use metadata in this area for full data refresh and load.
  • 26.
  • 27. Information Delivery  Report generating  Query processing  Complex analysis Mostly this are meant for end-user. Metadata recorded in processes of other two areas. It also record OLAP-the developer and administrators are involved in this processes.
  • 28.
  • 29. Business METADATA  It connect business with DWH.  Business users need more than other users.  Business metadata is like a roadmap.  Tout guide-managers and analysis.
  • 30.  Must describe the contents in plain language giving information in business teerms.  Example The name of data tables (or) individual element must not be cryptic. The data item name-calc_pr_sle. You need to rename this as calculated-prior- month-sale
  • 31. Business metadata Contd.,  Much less structured than technical metadata.  Textual documents, spreadsheets, and even business rules and policies not written down completely.
  • 32. Examples of Business Metadata who Benefits?  Primarily benefits end-users. Managers Business analysis Power users Regular users Casual users Senior managers/ junior managers
  • 33. Technical Metadata  IT staff- Development and Administration of the data warehouse.  Who Benefits? Project manager Data warehouse administrator Metadata manager Database administrator Business analyst Data quality analyst