SlideShare una empresa de Scribd logo
1 de 9
Descargar para leer sin conexión
Data Virtualization for
Compliance – Creating a
Controlled Data Environment
Stan Sobol
Head of Data Architecture and Data Services
CIT Group, Inc.
Abstract
Data Virtualization for Compliance – Creating a
Controlled Data Environment
Enterprises face a variety of data management
challenges that influence their ability to leverage
accurate, meaningful information, quickly and
efficiently. Data virtualization is an enabling
technology which can address many of these
challenges.
This session will explore how data virtualization is
being used to dramatically reduce data proliferation
and ensure that all consumers are working from a
single source of the truth. It will also look at how
data virtualization can drive standardization,
measure & improve data quality, abstract data
consumers from data providers, expose data
lineage, enable cross-company data integration,
and serve a common provisioning point from which
to access all authoritative sources of data.
• Whether within IT or the business, employees
find ways to access the data they need to do
their job.
• Often times, data is copied, processed offline
(eg Excel & Access) , and somehow fed back
into the sausage grinder of data movement that
exists in many enterprises.
• Data is often enriched and adjusted along the
way, potentially resulting in inconsistent
information across internal organizations,
sometimes requiring additional reconciliations
and duplicated efforts.
• Self-serve data can be powerful, but requires
the guide rails of standards, access control,
certified provisioning points, and strong data
governance.
• Old habits die hard. Culture is a difficult thing
to change.
The Problem: Data Everywhere
• Financial Services companies are experiencing
unprecedented regulatory scrutiny with an
increased focus on data management
practices.
• Banks need to evolve their critical data flows to
provide increased frequency, granularity, and
auditable aggregation of data used to manage
risk.
• Systemically Important Financial Institutions
(SIFIs) or “too big to fail” banks must operate
with strict controls around their data and
increasingly mature their data management
practices to meet evolving industry standards.
• Regulatory authorities continue to move the
goal post with publications like BCBS 239,
which is positioned as a guideline, but
expected to become a requirement.
• Other industries like Pharma, Insurance and
Energy face similar challenges with their own
data management practices and challenging
regulatory requirements.
Regulatory Backdrop
• Common provisioning point from which to access all
authoritative sources of data.
• Beyond data integration capabilities, the DSL provides usage
metering, monitoring of in-flight data movement, and
orchestration of data APIs.
• The DSL is not a data repository, it is a framework to leverage
data that is persisted, mastered and managed elsewhere.
• Created with a collection of technologies, from traditional ETL
and sftp, to more modern RESTful interfaces supported by
data virtualization and API gateway technology.
• Provides metadata and lineage around data flows that
leverage the DSL.
• Data virtualization can reduce unnecessary copies, the root of
data proliferation.
• Consumers need to trust that historical data is durable and
consistent
• “Publish ready” APIs don’t just serve up data, they apply data
quality monitoring rules and trigger data stewardship activities.
• Data virtualization is a foundational technology within the DSL.
The Solution: The Data Services Layer (or “DSL”)
Data Architecture – Key Principles
• Realize value from data
• Access all data through common provisioning
point
• Avoid point-to-point integration
• Build once, use many times
• Minimize data replication and
proliferation
• Eliminate data redundancy, unnecessary
copies
• Eliminate redundant data reconciliation efforts
• Enables effective Data Governance
• Enforce policies, standards and procedures
• Define & publish authoritative sources of data
• Efficient data lineage and metadata
management
• Monitoring of data quality before consumption
• Pragmatic data integration strategy
• Faster time-to-market delivery
• Incremental information delivery
Data Provisioning Layer
Party
Master
Finance PlatformAuthoritative Data
Lease
Loan
Bank
Mortgage
Data Quality Monitoring
Data Access (Integration) Layer
Downstream Systems
Risk
Finance
Fit for purpose
Data Marts
Reporting Layer
AR Systems Risk Systems HR Systems
SystemofRecordDataDelivery
CertifiedGolden
Source
Data Virtualization in the Target State Architecture
• Build the team and the infrastructure capacity to provide an enterprise service.
• Establish policy requiring all strategic data flows to go through the DSL.
• Validate data lineage, ensure data consumption from authoritative sources.
• Disassemble the sausage grinder of data movement:
• Start to unwind legacy ETL and rewire strategic data flows through the DSL
• Aspire to have all data movement occur within a “single hop” of the DSL
• Explore metadata discovery tools to understand non-DSL data movement
• Smart automation (not everything) – quality rules, remediation workflow, etc.
• Study metering data, understand how data is consumed to help optimize services.
• Establish standards around how data is exposed:
• Everyone consumes data via a shared canonical model.
• Expose data as services at the finest granularity that makes sense.
• Rationalize data service APIs, ensure consistency & referential integrity across
business segments.
• Establish foundational data management platform with evolutionary path towards a
micro-services architecture.
• Start small, evolve with demand and growth.
We have the technology … Now what?
• Data governance is critical to the success of any data virtualization effort
• Consumers need to trust that data is owned, managed, and certified
• Establish a data governance framework that ensures accountability, empowers owners
of data, and fosters a culture of good data hygiene:
• Firm-wide policy establishing the data governance framework & governing bodies
• Data management committee aligned to senior-most governing body of firm
• Accountable executives on point for data quality by segment
• Data standards against which to measure data quality
• Data stewards empowered to own & remediate critical data elements
• Insightful, actionable metrics / dashboards targeted at executives, stewards, data
consumers
• Data quality has many dimensions, prioritize the ones that matter most
• eg completeness, validity, accuracy, timeliness, granularity, etc.
• Use a canonical model with shared terms defined in a firm-wide business glossary
• The Chief Data Officer owns the policy, provides stewardship of the data governance
framework, and serves as an evangelist for good data management practices
• Data virtualization can be an enabling technology for smart data governance
Data Governance is Critical
Data Virtualization for Compliance – Creating a Controlled Data Environment

Más contenido relacionado

La actualidad más candente

Multi cloud data integration with data virtualization
Multi cloud data integration with data virtualizationMulti cloud data integration with data virtualization
Multi cloud data integration with data virtualization
Denodo
 
Data Services and the Modern Data Ecosystem (Middle East)
Data Services and the Modern Data Ecosystem (Middle East)Data Services and the Modern Data Ecosystem (Middle East)
Data Services and the Modern Data Ecosystem (Middle East)
Denodo
 

La actualidad más candente (20)

Reinvent Your Data Management Strategy for Successful Digital Transformation
Reinvent Your Data Management Strategy for Successful Digital TransformationReinvent Your Data Management Strategy for Successful Digital Transformation
Reinvent Your Data Management Strategy for Successful Digital Transformation
 
Best Practices in the Cloud for Data Management (US)
Best Practices in the Cloud for Data Management (US)Best Practices in the Cloud for Data Management (US)
Best Practices in the Cloud for Data Management (US)
 
Big Data Fabric: A Necessity For Any Successful Big Data Initiative
Big Data Fabric: A Necessity For Any Successful Big Data InitiativeBig Data Fabric: A Necessity For Any Successful Big Data Initiative
Big Data Fabric: A Necessity For Any Successful Big Data Initiative
 
Big Data Fabric: A Recipe for Big Data Initiatives
Big Data Fabric: A Recipe for Big Data InitiativesBig Data Fabric: A Recipe for Big Data Initiatives
Big Data Fabric: A Recipe for Big Data Initiatives
 
Partner Keynote: How Logical Data Fabric Knits Together Data Visualization wi...
Partner Keynote: How Logical Data Fabric Knits Together Data Visualization wi...Partner Keynote: How Logical Data Fabric Knits Together Data Visualization wi...
Partner Keynote: How Logical Data Fabric Knits Together Data Visualization wi...
 
A Logical Architecture is Always a Flexible Architecture (ASEAN)
A Logical Architecture is Always a Flexible Architecture (ASEAN)A Logical Architecture is Always a Flexible Architecture (ASEAN)
A Logical Architecture is Always a Flexible Architecture (ASEAN)
 
KASHTECH AND DENODO: ROI and Economic Value of Data Virtualization
KASHTECH AND DENODO: ROI and Economic Value of Data VirtualizationKASHTECH AND DENODO: ROI and Economic Value of Data Virtualization
KASHTECH AND DENODO: ROI and Economic Value of Data Virtualization
 
Data Virtualization: An Introduction
Data Virtualization: An IntroductionData Virtualization: An Introduction
Data Virtualization: An Introduction
 
Reinventing and Simplifying Data Management for a Successful Hybrid and Multi...
Reinventing and Simplifying Data Management for a Successful Hybrid and Multi...Reinventing and Simplifying Data Management for a Successful Hybrid and Multi...
Reinventing and Simplifying Data Management for a Successful Hybrid and Multi...
 
Multi-Cloud Data Integration with Data Virtualization (APAC)
Multi-Cloud Data Integration with Data Virtualization (APAC)Multi-Cloud Data Integration with Data Virtualization (APAC)
Multi-Cloud Data Integration with Data Virtualization (APAC)
 
Multi cloud data integration with data virtualization
Multi cloud data integration with data virtualizationMulti cloud data integration with data virtualization
Multi cloud data integration with data virtualization
 
Data Virtualization: An Introduction
Data Virtualization: An IntroductionData Virtualization: An Introduction
Data Virtualization: An Introduction
 
Role of Unified AI and ML in Cloud Technologies. Which Cloud Service Provider...
Role of Unified AI and ML in Cloud Technologies. Which Cloud Service Provider...Role of Unified AI and ML in Cloud Technologies. Which Cloud Service Provider...
Role of Unified AI and ML in Cloud Technologies. Which Cloud Service Provider...
 
Data Services and the Modern Data Ecosystem (Middle East)
Data Services and the Modern Data Ecosystem (Middle East)Data Services and the Modern Data Ecosystem (Middle East)
Data Services and the Modern Data Ecosystem (Middle East)
 
Logical Data Warehouse: The Foundation of Modern Data and Analytics (APAC)
Logical Data Warehouse: The Foundation of Modern Data and Analytics (APAC)Logical Data Warehouse: The Foundation of Modern Data and Analytics (APAC)
Logical Data Warehouse: The Foundation of Modern Data and Analytics (APAC)
 
Introduction to Modern Data Virtualization (US)
Introduction to Modern Data Virtualization (US)Introduction to Modern Data Virtualization (US)
Introduction to Modern Data Virtualization (US)
 
Introduction to Modern Data Virtualization 2021 (APAC)
Introduction to Modern Data Virtualization 2021 (APAC)Introduction to Modern Data Virtualization 2021 (APAC)
Introduction to Modern Data Virtualization 2021 (APAC)
 
Cloud Modernization and Data as a Service Option
Cloud Modernization and Data as a Service OptionCloud Modernization and Data as a Service Option
Cloud Modernization and Data as a Service Option
 
Education Seminar: Self-service BI, Logical Data Warehouse and Data Lakes
Education Seminar: Self-service BI, Logical Data Warehouse and Data LakesEducation Seminar: Self-service BI, Logical Data Warehouse and Data Lakes
Education Seminar: Self-service BI, Logical Data Warehouse and Data Lakes
 
Why Data Virtualization? An Introduction
Why Data Virtualization? An IntroductionWhy Data Virtualization? An Introduction
Why Data Virtualization? An Introduction
 

Destacado

Gauchão 2014 escala de arbitragem 3ª rodada
Gauchão 2014   escala de arbitragem 3ª rodadaGauchão 2014   escala de arbitragem 3ª rodada
Gauchão 2014 escala de arbitragem 3ª rodada
Rafael Passos
 
Glosario 3
Glosario 3Glosario 3
Glosario 3
ejoya
 
Power profe manuel trabajo nº 3
Power profe manuel trabajo nº 3Power profe manuel trabajo nº 3
Power profe manuel trabajo nº 3
ejoya
 
MKOEN Teaching Philosophy with Summary Evals docx
MKOEN Teaching Philosophy with Summary Evals docxMKOEN Teaching Philosophy with Summary Evals docx
MKOEN Teaching Philosophy with Summary Evals docx
Marthinus (Martin) Koen
 
Edwar y pineda ultiomo
Edwar y pineda ultiomoEdwar y pineda ultiomo
Edwar y pineda ultiomo
Edwar Perez
 
Tiendas virtuales
Tiendas virtualesTiendas virtuales
Tiendas virtuales
karlamasi
 

Destacado (20)

JBoss Enterprise Data Services (Data Virtualization)
JBoss Enterprise Data Services (Data Virtualization)JBoss Enterprise Data Services (Data Virtualization)
JBoss Enterprise Data Services (Data Virtualization)
 
Hot tech 20161005-ep0016-idera - index insanity - how to avoid database chaos...
Hot tech 20161005-ep0016-idera - index insanity - how to avoid database chaos...Hot tech 20161005-ep0016-idera - index insanity - how to avoid database chaos...
Hot tech 20161005-ep0016-idera - index insanity - how to avoid database chaos...
 
Gauchão 2014 escala de arbitragem 3ª rodada
Gauchão 2014   escala de arbitragem 3ª rodadaGauchão 2014   escala de arbitragem 3ª rodada
Gauchão 2014 escala de arbitragem 3ª rodada
 
Glosario 3
Glosario 3Glosario 3
Glosario 3
 
JN Resume (1)
JN Resume (1)JN Resume (1)
JN Resume (1)
 
Power profe manuel trabajo nº 3
Power profe manuel trabajo nº 3Power profe manuel trabajo nº 3
Power profe manuel trabajo nº 3
 
ΕΥΧΑΡΙΣΤΟΥΜΕ
ΕΥΧΑΡΙΣΤΟΥΜΕΕΥΧΑΡΙΣΤΟΥΜΕ
ΕΥΧΑΡΙΣΤΟΥΜΕ
 
Deportivo
DeportivoDeportivo
Deportivo
 
Cersaie 2009
Cersaie 2009Cersaie 2009
Cersaie 2009
 
Coleção design itália
Coleção design itáliaColeção design itália
Coleção design itália
 
Revista revenda construção
Revista revenda construçãoRevista revenda construção
Revista revenda construção
 
MKOEN Teaching Philosophy with Summary Evals docx
MKOEN Teaching Philosophy with Summary Evals docxMKOEN Teaching Philosophy with Summary Evals docx
MKOEN Teaching Philosophy with Summary Evals docx
 
Hadoop and Data Virtualization - A Case Study by VHA
Hadoop and Data Virtualization - A Case Study by VHAHadoop and Data Virtualization - A Case Study by VHA
Hadoop and Data Virtualization - A Case Study by VHA
 
Metros Ligeros y la revitalización de los Centros urbanos andaluces
Metros Ligeros y la revitalización de los Centros urbanos andalucesMetros Ligeros y la revitalización de los Centros urbanos andaluces
Metros Ligeros y la revitalización de los Centros urbanos andaluces
 
Constructivismo y TIC
Constructivismo y TICConstructivismo y TIC
Constructivismo y TIC
 
Edwar y pineda ultiomo
Edwar y pineda ultiomoEdwar y pineda ultiomo
Edwar y pineda ultiomo
 
The 3-Speed Chief Data Officer
The 3-Speed Chief Data OfficerThe 3-Speed Chief Data Officer
The 3-Speed Chief Data Officer
 
Anuário de Revestimentos, Louças e Metais
Anuário de Revestimentos, Louças e MetaisAnuário de Revestimentos, Louças e Metais
Anuário de Revestimentos, Louças e Metais
 
Extreme Analytics @ eBay
Extreme Analytics @ eBayExtreme Analytics @ eBay
Extreme Analytics @ eBay
 
Tiendas virtuales
Tiendas virtualesTiendas virtuales
Tiendas virtuales
 

Similar a Data Virtualization for Compliance – Creating a Controlled Data Environment

Achieving a Single View of Business – Critical Data with Master Data Management
Achieving a Single View of Business – Critical Data with Master Data ManagementAchieving a Single View of Business – Critical Data with Master Data Management
Achieving a Single View of Business – Critical Data with Master Data Management
DATAVERSITY
 
Data Governance Overview - Doreen Christian
Data Governance Overview - Doreen ChristianData Governance Overview - Doreen Christian
Data Governance Overview - Doreen Christian
Doreen Christian
 
Data Mesh in Azure using Cloud Scale Analytics (WAF)
Data Mesh in Azure using Cloud Scale Analytics (WAF)Data Mesh in Azure using Cloud Scale Analytics (WAF)
Data Mesh in Azure using Cloud Scale Analytics (WAF)
Nathan Bijnens
 
data_blending
data_blendingdata_blending
data_blending
subit1615
 

Similar a Data Virtualization for Compliance – Creating a Controlled Data Environment (20)

Increasing Agility Through Data Virtualization
Increasing Agility Through Data VirtualizationIncreasing Agility Through Data Virtualization
Increasing Agility Through Data Virtualization
 
ADV Slides: Data Pipelines in the Enterprise and Comparison
ADV Slides: Data Pipelines in the Enterprise and ComparisonADV Slides: Data Pipelines in the Enterprise and Comparison
ADV Slides: Data Pipelines in the Enterprise and Comparison
 
Digital intelligence satish bhatia
Digital intelligence satish bhatiaDigital intelligence satish bhatia
Digital intelligence satish bhatia
 
Ensuring Data Quality and Lineage in Cloud Migration - Dan Power
Ensuring Data Quality and Lineage in Cloud Migration - Dan PowerEnsuring Data Quality and Lineage in Cloud Migration - Dan Power
Ensuring Data Quality and Lineage in Cloud Migration - Dan Power
 
Big data
Big dataBig data
Big data
 
The Shifting Landscape of Data Integration
The Shifting Landscape of Data IntegrationThe Shifting Landscape of Data Integration
The Shifting Landscape of Data Integration
 
Deliveinrg explainable AI
Deliveinrg explainable AIDeliveinrg explainable AI
Deliveinrg explainable AI
 
Achieving a Single View of Business – Critical Data with Master Data Management
Achieving a Single View of Business – Critical Data with Master Data ManagementAchieving a Single View of Business – Critical Data with Master Data Management
Achieving a Single View of Business – Critical Data with Master Data Management
 
Big data
Big dataBig data
Big data
 
Data Governance Overview - Doreen Christian
Data Governance Overview - Doreen ChristianData Governance Overview - Doreen Christian
Data Governance Overview - Doreen Christian
 
Credit Suisse: Multi-Domain Enterprise Reference Data
Credit Suisse: Multi-Domain Enterprise Reference DataCredit Suisse: Multi-Domain Enterprise Reference Data
Credit Suisse: Multi-Domain Enterprise Reference Data
 
Data Mesh in Azure using Cloud Scale Analytics (WAF)
Data Mesh in Azure using Cloud Scale Analytics (WAF)Data Mesh in Azure using Cloud Scale Analytics (WAF)
Data Mesh in Azure using Cloud Scale Analytics (WAF)
 
Accelerate Cloud Migrations and Architecture with Data Virtualization
Accelerate Cloud Migrations and Architecture with Data VirtualizationAccelerate Cloud Migrations and Architecture with Data Virtualization
Accelerate Cloud Migrations and Architecture with Data Virtualization
 
Data Virtualization: The Agile Delivery Platform
Data Virtualization: The Agile Delivery PlatformData Virtualization: The Agile Delivery Platform
Data Virtualization: The Agile Delivery Platform
 
Foundational Strategies for Trusted Data: Getting Your Data to the Cloud
Foundational Strategies for Trusted Data: Getting Your Data to the CloudFoundational Strategies for Trusted Data: Getting Your Data to the Cloud
Foundational Strategies for Trusted Data: Getting Your Data to the Cloud
 
data_blending
data_blendingdata_blending
data_blending
 
Fuse Analytics - HR & Payroll Cloud Transformation Pitfalls, Lessons Learned
 Fuse Analytics - HR & Payroll Cloud Transformation Pitfalls, Lessons Learned Fuse Analytics - HR & Payroll Cloud Transformation Pitfalls, Lessons Learned
Fuse Analytics - HR & Payroll Cloud Transformation Pitfalls, Lessons Learned
 
Operationalize analytics through modern data strategy
Operationalize analytics through modern data strategyOperationalize analytics through modern data strategy
Operationalize analytics through modern data strategy
 
Sgcp14dunlea
Sgcp14dunleaSgcp14dunlea
Sgcp14dunlea
 
(Data) Integrity Matters: Four Ways You Can Build Trust in Your Data
(Data) Integrity Matters: Four Ways You Can Build Trust in Your Data(Data) Integrity Matters: Four Ways You Can Build Trust in Your Data
(Data) Integrity Matters: Four Ways You Can Build Trust in Your Data
 

Más de Denodo

Mastering Data Compliance in a Dynamic Business Landscape
Mastering Data Compliance in a Dynamic Business LandscapeMastering Data Compliance in a Dynamic Business Landscape
Mastering Data Compliance in a Dynamic Business Landscape
Denodo
 
Expert Panel: Overcoming Challenges with Distributed Data to Maximize Busines...
Expert Panel: Overcoming Challenges with Distributed Data to Maximize Busines...Expert Panel: Overcoming Challenges with Distributed Data to Maximize Busines...
Expert Panel: Overcoming Challenges with Distributed Data to Maximize Busines...
Denodo
 
Знакомство с виртуализацией данных для профессионалов в области данных
Знакомство с виртуализацией данных для профессионалов в области данныхЗнакомство с виртуализацией данных для профессионалов в области данных
Знакомство с виртуализацией данных для профессионалов в области данных
Denodo
 
Quels sont les facteurs-clés de succès pour appliquer au mieux le RGPD à votr...
Quels sont les facteurs-clés de succès pour appliquer au mieux le RGPD à votr...Quels sont les facteurs-clés de succès pour appliquer au mieux le RGPD à votr...
Quels sont les facteurs-clés de succès pour appliquer au mieux le RGPD à votr...
Denodo
 

Más de Denodo (20)

Enterprise Monitoring and Auditing in Denodo
Enterprise Monitoring and Auditing in DenodoEnterprise Monitoring and Auditing in Denodo
Enterprise Monitoring and Auditing in Denodo
 
Lunch and Learn ANZ: Mastering Cloud Data Cost Control: A FinOps Approach
Lunch and Learn ANZ: Mastering Cloud Data Cost Control: A FinOps ApproachLunch and Learn ANZ: Mastering Cloud Data Cost Control: A FinOps Approach
Lunch and Learn ANZ: Mastering Cloud Data Cost Control: A FinOps Approach
 
Achieving Self-Service Analytics with a Governed Data Services Layer
Achieving Self-Service Analytics with a Governed Data Services LayerAchieving Self-Service Analytics with a Governed Data Services Layer
Achieving Self-Service Analytics with a Governed Data Services Layer
 
What you need to know about Generative AI and Data Management?
What you need to know about Generative AI and Data Management?What you need to know about Generative AI and Data Management?
What you need to know about Generative AI and Data Management?
 
Mastering Data Compliance in a Dynamic Business Landscape
Mastering Data Compliance in a Dynamic Business LandscapeMastering Data Compliance in a Dynamic Business Landscape
Mastering Data Compliance in a Dynamic Business Landscape
 
Denodo Partner Connect: Business Value Demo with Denodo Demo Lite
Denodo Partner Connect: Business Value Demo with Denodo Demo LiteDenodo Partner Connect: Business Value Demo with Denodo Demo Lite
Denodo Partner Connect: Business Value Demo with Denodo Demo Lite
 
Expert Panel: Overcoming Challenges with Distributed Data to Maximize Busines...
Expert Panel: Overcoming Challenges with Distributed Data to Maximize Busines...Expert Panel: Overcoming Challenges with Distributed Data to Maximize Busines...
Expert Panel: Overcoming Challenges with Distributed Data to Maximize Busines...
 
Drive Data Privacy Regulatory Compliance
Drive Data Privacy Regulatory ComplianceDrive Data Privacy Regulatory Compliance
Drive Data Privacy Regulatory Compliance
 
Знакомство с виртуализацией данных для профессионалов в области данных
Знакомство с виртуализацией данных для профессионалов в области данныхЗнакомство с виртуализацией данных для профессионалов в области данных
Знакомство с виртуализацией данных для профессионалов в области данных
 
Data Democratization: A Secret Sauce to Say Goodbye to Data Fragmentation
Data Democratization: A Secret Sauce to Say Goodbye to Data FragmentationData Democratization: A Secret Sauce to Say Goodbye to Data Fragmentation
Data Democratization: A Secret Sauce to Say Goodbye to Data Fragmentation
 
Denodo Partner Connect - Technical Webinar - Ask Me Anything
Denodo Partner Connect - Technical Webinar - Ask Me AnythingDenodo Partner Connect - Technical Webinar - Ask Me Anything
Denodo Partner Connect - Technical Webinar - Ask Me Anything
 
Lunch and Learn ANZ: Key Takeaways for 2023!
Lunch and Learn ANZ: Key Takeaways for 2023!Lunch and Learn ANZ: Key Takeaways for 2023!
Lunch and Learn ANZ: Key Takeaways for 2023!
 
It’s a Wrap! 2023 – A Groundbreaking Year for AI and The Way Forward
It’s a Wrap! 2023 – A Groundbreaking Year for AI and The Way ForwardIt’s a Wrap! 2023 – A Groundbreaking Year for AI and The Way Forward
It’s a Wrap! 2023 – A Groundbreaking Year for AI and The Way Forward
 
Quels sont les facteurs-clés de succès pour appliquer au mieux le RGPD à votr...
Quels sont les facteurs-clés de succès pour appliquer au mieux le RGPD à votr...Quels sont les facteurs-clés de succès pour appliquer au mieux le RGPD à votr...
Quels sont les facteurs-clés de succès pour appliquer au mieux le RGPD à votr...
 
Lunch and Learn ANZ: Achieving Self-Service Analytics with a Governed Data Se...
Lunch and Learn ANZ: Achieving Self-Service Analytics with a Governed Data Se...Lunch and Learn ANZ: Achieving Self-Service Analytics with a Governed Data Se...
Lunch and Learn ANZ: Achieving Self-Service Analytics with a Governed Data Se...
 
How to Build Your Data Marketplace with Data Virtualization?
How to Build Your Data Marketplace with Data Virtualization?How to Build Your Data Marketplace with Data Virtualization?
How to Build Your Data Marketplace with Data Virtualization?
 
Webinar #2 - Transforming Challenges into Opportunities for Credit Unions
Webinar #2 - Transforming Challenges into Opportunities for Credit UnionsWebinar #2 - Transforming Challenges into Opportunities for Credit Unions
Webinar #2 - Transforming Challenges into Opportunities for Credit Unions
 
Enabling Data Catalog users with advanced usability
Enabling Data Catalog users with advanced usabilityEnabling Data Catalog users with advanced usability
Enabling Data Catalog users with advanced usability
 
Denodo Partner Connect: Technical Webinar - Architect Associate Certification...
Denodo Partner Connect: Technical Webinar - Architect Associate Certification...Denodo Partner Connect: Technical Webinar - Architect Associate Certification...
Denodo Partner Connect: Technical Webinar - Architect Associate Certification...
 
GenAI y el futuro de la gestión de datos: mitos y realidades
GenAI y el futuro de la gestión de datos: mitos y realidadesGenAI y el futuro de la gestión de datos: mitos y realidades
GenAI y el futuro de la gestión de datos: mitos y realidades
 

Último

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 

Último (20)

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Cyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfCyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdf
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 

Data Virtualization for Compliance – Creating a Controlled Data Environment

  • 1. Data Virtualization for Compliance – Creating a Controlled Data Environment Stan Sobol Head of Data Architecture and Data Services CIT Group, Inc.
  • 2. Abstract Data Virtualization for Compliance – Creating a Controlled Data Environment Enterprises face a variety of data management challenges that influence their ability to leverage accurate, meaningful information, quickly and efficiently. Data virtualization is an enabling technology which can address many of these challenges. This session will explore how data virtualization is being used to dramatically reduce data proliferation and ensure that all consumers are working from a single source of the truth. It will also look at how data virtualization can drive standardization, measure & improve data quality, abstract data consumers from data providers, expose data lineage, enable cross-company data integration, and serve a common provisioning point from which to access all authoritative sources of data.
  • 3. • Whether within IT or the business, employees find ways to access the data they need to do their job. • Often times, data is copied, processed offline (eg Excel & Access) , and somehow fed back into the sausage grinder of data movement that exists in many enterprises. • Data is often enriched and adjusted along the way, potentially resulting in inconsistent information across internal organizations, sometimes requiring additional reconciliations and duplicated efforts. • Self-serve data can be powerful, but requires the guide rails of standards, access control, certified provisioning points, and strong data governance. • Old habits die hard. Culture is a difficult thing to change. The Problem: Data Everywhere
  • 4. • Financial Services companies are experiencing unprecedented regulatory scrutiny with an increased focus on data management practices. • Banks need to evolve their critical data flows to provide increased frequency, granularity, and auditable aggregation of data used to manage risk. • Systemically Important Financial Institutions (SIFIs) or “too big to fail” banks must operate with strict controls around their data and increasingly mature their data management practices to meet evolving industry standards. • Regulatory authorities continue to move the goal post with publications like BCBS 239, which is positioned as a guideline, but expected to become a requirement. • Other industries like Pharma, Insurance and Energy face similar challenges with their own data management practices and challenging regulatory requirements. Regulatory Backdrop
  • 5. • Common provisioning point from which to access all authoritative sources of data. • Beyond data integration capabilities, the DSL provides usage metering, monitoring of in-flight data movement, and orchestration of data APIs. • The DSL is not a data repository, it is a framework to leverage data that is persisted, mastered and managed elsewhere. • Created with a collection of technologies, from traditional ETL and sftp, to more modern RESTful interfaces supported by data virtualization and API gateway technology. • Provides metadata and lineage around data flows that leverage the DSL. • Data virtualization can reduce unnecessary copies, the root of data proliferation. • Consumers need to trust that historical data is durable and consistent • “Publish ready” APIs don’t just serve up data, they apply data quality monitoring rules and trigger data stewardship activities. • Data virtualization is a foundational technology within the DSL. The Solution: The Data Services Layer (or “DSL”)
  • 6. Data Architecture – Key Principles • Realize value from data • Access all data through common provisioning point • Avoid point-to-point integration • Build once, use many times • Minimize data replication and proliferation • Eliminate data redundancy, unnecessary copies • Eliminate redundant data reconciliation efforts • Enables effective Data Governance • Enforce policies, standards and procedures • Define & publish authoritative sources of data • Efficient data lineage and metadata management • Monitoring of data quality before consumption • Pragmatic data integration strategy • Faster time-to-market delivery • Incremental information delivery Data Provisioning Layer Party Master Finance PlatformAuthoritative Data Lease Loan Bank Mortgage Data Quality Monitoring Data Access (Integration) Layer Downstream Systems Risk Finance Fit for purpose Data Marts Reporting Layer AR Systems Risk Systems HR Systems SystemofRecordDataDelivery CertifiedGolden Source Data Virtualization in the Target State Architecture
  • 7. • Build the team and the infrastructure capacity to provide an enterprise service. • Establish policy requiring all strategic data flows to go through the DSL. • Validate data lineage, ensure data consumption from authoritative sources. • Disassemble the sausage grinder of data movement: • Start to unwind legacy ETL and rewire strategic data flows through the DSL • Aspire to have all data movement occur within a “single hop” of the DSL • Explore metadata discovery tools to understand non-DSL data movement • Smart automation (not everything) – quality rules, remediation workflow, etc. • Study metering data, understand how data is consumed to help optimize services. • Establish standards around how data is exposed: • Everyone consumes data via a shared canonical model. • Expose data as services at the finest granularity that makes sense. • Rationalize data service APIs, ensure consistency & referential integrity across business segments. • Establish foundational data management platform with evolutionary path towards a micro-services architecture. • Start small, evolve with demand and growth. We have the technology … Now what?
  • 8. • Data governance is critical to the success of any data virtualization effort • Consumers need to trust that data is owned, managed, and certified • Establish a data governance framework that ensures accountability, empowers owners of data, and fosters a culture of good data hygiene: • Firm-wide policy establishing the data governance framework & governing bodies • Data management committee aligned to senior-most governing body of firm • Accountable executives on point for data quality by segment • Data standards against which to measure data quality • Data stewards empowered to own & remediate critical data elements • Insightful, actionable metrics / dashboards targeted at executives, stewards, data consumers • Data quality has many dimensions, prioritize the ones that matter most • eg completeness, validity, accuracy, timeliness, granularity, etc. • Use a canonical model with shared terms defined in a firm-wide business glossary • The Chief Data Officer owns the policy, provides stewardship of the data governance framework, and serves as an evangelist for good data management practices • Data virtualization can be an enabling technology for smart data governance Data Governance is Critical