SlideShare una empresa de Scribd logo
1 de 17
DESIGNING HIGH QUALITY DATA
DRIVEN SOLUTIONS
BY: MARIA HALSTEAD
NOV 5, 2020
OBJECTIVE
This presentation will cover some
fundamental principles around designing
systems with the goal of enabling
businesses to make data driven decisions.
2
AGENDA
• Typical Users & Ecosystem of Data
• Pitfalls & Benefits of Data Design
• Data Governance
• The Future of Predictive Analytics
• Data Tools & Resources
3
TYPICAL USAGE IN AN ORGANIZATION
Type of User Usage Explained
Day to day users of a system Need daily hands-on interaction with the data, such as a transactional
system for managing a particular line of business or work
Manager or team leads Need to oversee the work, and data reports will help here if designed
right
Leaders or company executives Need to see key performance indicator (KPI) metrics in order to run a
business and make decisions for business success
4
ECOSYSTEM OF SOURCE DATA – STANDARD OUTPUTS
5
Source
Data
Day to Day
User Queues
Manager &
Team Lead
Dashboards
Leadership &
Executive
Dashboards/
KPIs
Data Science
& Artificial
Intelligence
Data Trends
Standard &
Ad hoc Built
in Reports
Files
Extracted &
System
Integrations
CLASSIC PITFALLS
• Creates a lot of rework and data entry
• Band-Aid solutions develop, such as creating one-off
Excel spreadsheets, for gaps missed
• Often creates a lot of manual work for status reporting,
when data is not captured correctly at the source
• Users do not update data correctly, causing hours of
downstream cleanup work
• Systems die or are terminated, for lack of user adoption
• Other?
6
What happens when a system and its data is designed poorly?
BENEFITS OF DOING IT RIGHT
• It allows for scalability and growth
• Sets foundation for automation to occur
• Reduces the administrative burden
• Enables businesses to focus on what they are charted to do
• Other?
7
Data is a company’s primary asset and should be recognized for its value.
DESIGN FOR HIGH QUALITY
8
Requirements, requirements, requirements… really understand what the
user needs to do their work. Ask why and how, do job shadows, prototype out
solutions, etc.
Keep it simple… tables should use normalized data design with referential
integrity, to reduce redundancy
Keep it clear… Avoid acronyms and if used make sure they are defined, and
use common naming conventions, to avoid confusion or misuse
Quality controls… Put in field level edits from the start, such as; defined
field types (i.e. text, date/time, etc.) and define drop downs/lookup lists, to
have a solid foundation
ENTITY RELATIONSHIP DIAGRAM (ERD) EXAMPLE
9
DATA GOVERNANCE
10
THE FUTURE OF PREDICTIVE ANALYTICS
• Once data is captured in scale, there is
now the concept of artificial
intelligence (AI), data science and
machine learning that takes things one
step further
• This allows for analyzing data in mass
to do predictive analytics for the future
anticipated trends based on past data
11
Supervised learning allows you to collect data or produce a data output from the
previous experience.
Unsupervised learning is a machine learning technique, where you do not need to
supervise the model. Instead, you need to allow the model to work on its own to
information.
REAL WORLD EXAMPLES OF AI
12
Social Media
• Was one of pioneers due to open-source code and no regulations on the data
• Examples – Analyzing text, pictures, avoiding propaganda, deciding content flow, advertising, data gathering
https://klintmarketing.com/ai-social-media/
Healthcare
• Now emerging for trending and improving overall health outcomes based on prior patient data
• Example 1 – Hospitals predicting length of stay in beds for patients, formerly done by tribal knowledge
• Example 2 – Pharmacy trends and determining high usage patients and prescribing certain medications i.e.
Advocate Aurora Health Opioid study https://customers.microsoft.com/en-us/story/811799-AAH-Kensci-Azure
Technical Support
• In terms monitoring and chat-bots for user support
• Example – Data center technical issues and failures
https://www.forbes.com/sites/cognitiveworld/2019/05/31/exploring-the-impact-of-ai-in-the-data-
center/#23e2b88067c4
Other?
A FEW MACHINE LEARNING CHARTS
13
Thiel-Sen Slope:
Used for finding
outliers in the data
Cluster Chart:
Used for displaying
cohorts/groupings
in the data
Stacked Bar Chart:
Used for locating
solid bar trends in the
data
DATA TOOLS
• SQL Server, Oracle, other Backend Databases
• Excel
• SharePoint Lists
• MS Access
• Power BI, Tableau, other Data Visualizations
• Azure Cloud, Data Warehouse and other Big Data Tools
• Other?
14
RESOURCES
15
Entity Relationship Diagram (ERD) /
Normalized Data Design
https://www.visual-paradigm.com/guide/data-
modeling/what-is-entity-relationship-diagram/
Data Governance Standards https://www.informatica.com/solutions/what-is-intelligent-
data-governance.html
Data Science Certification https://learn-xpro.mit.edu/data-science
QUESTIONS?
16
THANK YOU!
17
Maria Halstead
mariahalstead206@gmail.com

Más contenido relacionado

La actualidad más candente

Creating Your Data Governance Dashboard
Creating Your Data Governance DashboardCreating Your Data Governance Dashboard
Creating Your Data Governance Dashboard
Trillium Software
 
TekMindz Master Data Management Capabilities
TekMindz Master Data Management CapabilitiesTekMindz Master Data Management Capabilities
TekMindz Master Data Management Capabilities
Akshay Pandita
 

La actualidad más candente (20)

The Importance of Master Data Management
The Importance of Master Data ManagementThe Importance of Master Data Management
The Importance of Master Data Management
 
Data Quality Management
Data Quality ManagementData Quality Management
Data Quality Management
 
Informatica MDM Presentation
Informatica MDM PresentationInformatica MDM Presentation
Informatica MDM Presentation
 
Unlocking Success in the 3 Stages of Master Data Management
Unlocking Success in the 3 Stages of Master Data ManagementUnlocking Success in the 3 Stages of Master Data Management
Unlocking Success in the 3 Stages of Master Data Management
 
Creating Your Data Governance Dashboard
Creating Your Data Governance DashboardCreating Your Data Governance Dashboard
Creating Your Data Governance Dashboard
 
Reference master data management
Reference master data managementReference master data management
Reference master data management
 
5 Level of MDM Maturity
5 Level of MDM Maturity5 Level of MDM Maturity
5 Level of MDM Maturity
 
Optimize the Value of Your Mainframe
Optimize the Value of Your MainframeOptimize the Value of Your Mainframe
Optimize the Value of Your Mainframe
 
Master Data Management - Gartner Presentation
Master Data Management - Gartner PresentationMaster Data Management - Gartner Presentation
Master Data Management - Gartner Presentation
 
Whitepaper on Master Data Management
Whitepaper on Master Data Management Whitepaper on Master Data Management
Whitepaper on Master Data Management
 
Lean Master Data Management
Lean Master Data ManagementLean Master Data Management
Lean Master Data Management
 
Data Quality - Standards and Application to Open Data
Data Quality - Standards and Application to Open DataData Quality - Standards and Application to Open Data
Data Quality - Standards and Application to Open Data
 
Your Data Sucks! How to Build Trust in Data for Better Decisions
Your Data Sucks! How to Build Trust in Data for Better DecisionsYour Data Sucks! How to Build Trust in Data for Better Decisions
Your Data Sucks! How to Build Trust in Data for Better Decisions
 
Tips & tricks to drive effective Master Data Management & ERP harmonization
Tips & tricks to drive effective Master Data Management & ERP harmonizationTips & tricks to drive effective Master Data Management & ERP harmonization
Tips & tricks to drive effective Master Data Management & ERP harmonization
 
TekMindz Master Data Management Capabilities
TekMindz Master Data Management CapabilitiesTekMindz Master Data Management Capabilities
TekMindz Master Data Management Capabilities
 
Master Data Management: Extracting Value from Your Most Important Intangible ...
Master Data Management: Extracting Value from Your Most Important Intangible ...Master Data Management: Extracting Value from Your Most Important Intangible ...
Master Data Management: Extracting Value from Your Most Important Intangible ...
 
Infosys best practices_mdm_wp
Infosys best practices_mdm_wpInfosys best practices_mdm_wp
Infosys best practices_mdm_wp
 
Master data management executive mdm buy in business case (2)
Master data management executive mdm buy in business case (2)Master data management executive mdm buy in business case (2)
Master data management executive mdm buy in business case (2)
 
Creating an Effective MDM Strategy for Salesforce
Creating an Effective MDM Strategy for SalesforceCreating an Effective MDM Strategy for Salesforce
Creating an Effective MDM Strategy for Salesforce
 
10 Worst Practices in Master Data Management
10 Worst Practices in Master Data Management10 Worst Practices in Master Data Management
10 Worst Practices in Master Data Management
 

Similar a Designing High Quality Data Driven Solutions 110520

Governed Self-service BI
Governed Self-service BIGoverned Self-service BI
Governed Self-service BI
Frank Silva
 

Similar a Designing High Quality Data Driven Solutions 110520 (20)

Tips --Break Down the Barriers to Better Data Analytics
Tips --Break Down the Barriers to Better Data AnalyticsTips --Break Down the Barriers to Better Data Analytics
Tips --Break Down the Barriers to Better Data Analytics
 
Bi
BiBi
Bi
 
Challenges in adapting predictive analytics
Challenges  in  adapting  predictive  analyticsChallenges  in  adapting  predictive  analytics
Challenges in adapting predictive analytics
 
Data Systems Integration & Business Value Pt. 1: Metadata
Data Systems Integration & Business Value Pt. 1: MetadataData Systems Integration & Business Value Pt. 1: Metadata
Data Systems Integration & Business Value Pt. 1: Metadata
 
Data-Ed: Data Systems Integration & Business Value PT. 1: Metadata
Data-Ed: Data Systems Integration & Business Value PT. 1: MetadataData-Ed: Data Systems Integration & Business Value PT. 1: Metadata
Data-Ed: Data Systems Integration & Business Value PT. 1: Metadata
 
Five Things to Consider About Data Mesh and Data Governance
Five Things to Consider About Data Mesh and Data GovernanceFive Things to Consider About Data Mesh and Data Governance
Five Things to Consider About Data Mesh and Data Governance
 
KIT601 Unit I.pptx
KIT601 Unit I.pptxKIT601 Unit I.pptx
KIT601 Unit I.pptx
 
Implementing Data Mesh WP LTIMindtree White Paper
Implementing Data Mesh WP LTIMindtree White PaperImplementing Data Mesh WP LTIMindtree White Paper
Implementing Data Mesh WP LTIMindtree White Paper
 
NZS-4555 - IT Analytics Keynote - IT Analytics for the Enterprise
NZS-4555 - IT Analytics Keynote - IT Analytics for the EnterpriseNZS-4555 - IT Analytics Keynote - IT Analytics for the Enterprise
NZS-4555 - IT Analytics Keynote - IT Analytics for the Enterprise
 
Data-Ed Webinar: Data Quality Engineering
Data-Ed Webinar: Data Quality EngineeringData-Ed Webinar: Data Quality Engineering
Data-Ed Webinar: Data Quality Engineering
 
2014 dqe handouts
2014 dqe handouts2014 dqe handouts
2014 dqe handouts
 
Governed Self-service BI
Governed Self-service BIGoverned Self-service BI
Governed Self-service BI
 
Business inteligence
Business inteligenceBusiness inteligence
Business inteligence
 
Data analytics and audit coverage guide
Data analytics and audit coverage guideData analytics and audit coverage guide
Data analytics and audit coverage guide
 
Denodo’s Data Catalog: Bridging the Gap between Data and Business
Denodo’s Data Catalog: Bridging the Gap between Data and BusinessDenodo’s Data Catalog: Bridging the Gap between Data and Business
Denodo’s Data Catalog: Bridging the Gap between Data and Business
 
Data analytics and audit coverage guide
Data analytics and audit coverage guideData analytics and audit coverage guide
Data analytics and audit coverage guide
 
2013 ALPFA Leadership Submit, Data Analytics in Practice
2013 ALPFA Leadership Submit, Data Analytics in Practice2013 ALPFA Leadership Submit, Data Analytics in Practice
2013 ALPFA Leadership Submit, Data Analytics in Practice
 
Building enterprise advance analytics platform
Building enterprise advance analytics platformBuilding enterprise advance analytics platform
Building enterprise advance analytics platform
 
Five Attributes to a Successful Big Data Strategy
Five Attributes to a Successful Big Data StrategyFive Attributes to a Successful Big Data Strategy
Five Attributes to a Successful Big Data Strategy
 
Big data analytics
Big data analyticsBig data analytics
Big data analytics
 

Último

%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
masabamasaba
 
The title is not connected to what is inside
The title is not connected to what is insideThe title is not connected to what is inside
The title is not connected to what is inside
shinachiaurasa2
 
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
Health
 

Último (20)

%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
 
The title is not connected to what is inside
The title is not connected to what is insideThe title is not connected to what is inside
The title is not connected to what is inside
 
Generic or specific? Making sensible software design decisions
Generic or specific? Making sensible software design decisionsGeneric or specific? Making sensible software design decisions
Generic or specific? Making sensible software design decisions
 
Microsoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdfMicrosoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdf
 
Exploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdfExploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdf
 
%+27788225528 love spells in Vancouver Psychic Readings, Attraction spells,Br...
%+27788225528 love spells in Vancouver Psychic Readings, Attraction spells,Br...%+27788225528 love spells in Vancouver Psychic Readings, Attraction spells,Br...
%+27788225528 love spells in Vancouver Psychic Readings, Attraction spells,Br...
 
Define the academic and professional writing..pdf
Define the academic and professional writing..pdfDefine the academic and professional writing..pdf
Define the academic and professional writing..pdf
 
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
 
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
 
Chinsurah Escorts ☎️8617697112 Starting From 5K to 15K High Profile Escorts ...
Chinsurah Escorts ☎️8617697112  Starting From 5K to 15K High Profile Escorts ...Chinsurah Escorts ☎️8617697112  Starting From 5K to 15K High Profile Escorts ...
Chinsurah Escorts ☎️8617697112 Starting From 5K to 15K High Profile Escorts ...
 
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Models
 
%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview Questions
 
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
 
AI & Machine Learning Presentation Template
AI & Machine Learning Presentation TemplateAI & Machine Learning Presentation Template
AI & Machine Learning Presentation Template
 
%in Lydenburg+277-882-255-28 abortion pills for sale in Lydenburg
%in Lydenburg+277-882-255-28 abortion pills for sale in Lydenburg%in Lydenburg+277-882-255-28 abortion pills for sale in Lydenburg
%in Lydenburg+277-882-255-28 abortion pills for sale in Lydenburg
 
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
 

Designing High Quality Data Driven Solutions 110520

  • 1. DESIGNING HIGH QUALITY DATA DRIVEN SOLUTIONS BY: MARIA HALSTEAD NOV 5, 2020
  • 2. OBJECTIVE This presentation will cover some fundamental principles around designing systems with the goal of enabling businesses to make data driven decisions. 2
  • 3. AGENDA • Typical Users & Ecosystem of Data • Pitfalls & Benefits of Data Design • Data Governance • The Future of Predictive Analytics • Data Tools & Resources 3
  • 4. TYPICAL USAGE IN AN ORGANIZATION Type of User Usage Explained Day to day users of a system Need daily hands-on interaction with the data, such as a transactional system for managing a particular line of business or work Manager or team leads Need to oversee the work, and data reports will help here if designed right Leaders or company executives Need to see key performance indicator (KPI) metrics in order to run a business and make decisions for business success 4
  • 5. ECOSYSTEM OF SOURCE DATA – STANDARD OUTPUTS 5 Source Data Day to Day User Queues Manager & Team Lead Dashboards Leadership & Executive Dashboards/ KPIs Data Science & Artificial Intelligence Data Trends Standard & Ad hoc Built in Reports Files Extracted & System Integrations
  • 6. CLASSIC PITFALLS • Creates a lot of rework and data entry • Band-Aid solutions develop, such as creating one-off Excel spreadsheets, for gaps missed • Often creates a lot of manual work for status reporting, when data is not captured correctly at the source • Users do not update data correctly, causing hours of downstream cleanup work • Systems die or are terminated, for lack of user adoption • Other? 6 What happens when a system and its data is designed poorly?
  • 7. BENEFITS OF DOING IT RIGHT • It allows for scalability and growth • Sets foundation for automation to occur • Reduces the administrative burden • Enables businesses to focus on what they are charted to do • Other? 7 Data is a company’s primary asset and should be recognized for its value.
  • 8. DESIGN FOR HIGH QUALITY 8 Requirements, requirements, requirements… really understand what the user needs to do their work. Ask why and how, do job shadows, prototype out solutions, etc. Keep it simple… tables should use normalized data design with referential integrity, to reduce redundancy Keep it clear… Avoid acronyms and if used make sure they are defined, and use common naming conventions, to avoid confusion or misuse Quality controls… Put in field level edits from the start, such as; defined field types (i.e. text, date/time, etc.) and define drop downs/lookup lists, to have a solid foundation
  • 9. ENTITY RELATIONSHIP DIAGRAM (ERD) EXAMPLE 9
  • 11. THE FUTURE OF PREDICTIVE ANALYTICS • Once data is captured in scale, there is now the concept of artificial intelligence (AI), data science and machine learning that takes things one step further • This allows for analyzing data in mass to do predictive analytics for the future anticipated trends based on past data 11 Supervised learning allows you to collect data or produce a data output from the previous experience. Unsupervised learning is a machine learning technique, where you do not need to supervise the model. Instead, you need to allow the model to work on its own to information.
  • 12. REAL WORLD EXAMPLES OF AI 12 Social Media • Was one of pioneers due to open-source code and no regulations on the data • Examples – Analyzing text, pictures, avoiding propaganda, deciding content flow, advertising, data gathering https://klintmarketing.com/ai-social-media/ Healthcare • Now emerging for trending and improving overall health outcomes based on prior patient data • Example 1 – Hospitals predicting length of stay in beds for patients, formerly done by tribal knowledge • Example 2 – Pharmacy trends and determining high usage patients and prescribing certain medications i.e. Advocate Aurora Health Opioid study https://customers.microsoft.com/en-us/story/811799-AAH-Kensci-Azure Technical Support • In terms monitoring and chat-bots for user support • Example – Data center technical issues and failures https://www.forbes.com/sites/cognitiveworld/2019/05/31/exploring-the-impact-of-ai-in-the-data- center/#23e2b88067c4 Other?
  • 13. A FEW MACHINE LEARNING CHARTS 13 Thiel-Sen Slope: Used for finding outliers in the data Cluster Chart: Used for displaying cohorts/groupings in the data Stacked Bar Chart: Used for locating solid bar trends in the data
  • 14. DATA TOOLS • SQL Server, Oracle, other Backend Databases • Excel • SharePoint Lists • MS Access • Power BI, Tableau, other Data Visualizations • Azure Cloud, Data Warehouse and other Big Data Tools • Other? 14
  • 15. RESOURCES 15 Entity Relationship Diagram (ERD) / Normalized Data Design https://www.visual-paradigm.com/guide/data- modeling/what-is-entity-relationship-diagram/ Data Governance Standards https://www.informatica.com/solutions/what-is-intelligent- data-governance.html Data Science Certification https://learn-xpro.mit.edu/data-science

Notas del editor

  1. New provider information system Procurement and logistics database Azure DevOps forms for managing work