SlideShare una empresa de Scribd logo
1 de 15
Descargar para leer sin conexión
Event:   DDMA Data Quality Awards 2010
Spreker: Mark Humphries – Essent Belgium
Datum:   14 oktober 2010, Klooster Noordwijk




                                     www.ddma.n
                                     l
Project Dynamo




                 Data Quality : delivered
Our business


               We buy energy from the wholesale market

               We sell energy to the retail market

               Selling price – purchase price

                    gross profit

               We collect transport, distribution

               and taxes




               That´s all we do
Data fuels our business


     We collect information


     We update information
       when it changes


     We process information
           correctly

         Data Quality :
     “getting the data right”
Context
  Rapid growth of the business

  •0 customers in 2002
  •80k customers in 2006
  •240k customers in 2007

  Complex application environment

  •High maintenance costs
  •Poor integration
  •Unnecessary complexity

  Lack of controls

  •Poor data quality
  •Downstream errors

  Transaction based applications

  •No support for process integration
  •Inconsistent way of working
  •No structured exception handling
Objectives

Objectives :       -   Simplification and automation of processes
                   -   Focus on error handling
                   -   Increased data quality
                   -   Support for new market processes (MIG 4.0, SEPA, …)



   #   Principle                  Aim
       Customer central           The customer is the starting point for all processes

       First contact resolution   Respond to customers’ needs in one contact

       First time right           Eliminate errors

                                  Delegate responsibility by giving employees the
       Empowerment
                                  tools and the information they need to act
                                  Reduce costs by eliminating unnecessary
       Simplify
                                  complexity
The business case

Annual cost of poor data        Investment in Data Quality +
quality                         Migration
Customer data              235 DQ & Mig Platform         398
Contract data              748 Customer data             221
Billing                    124 Master data                 46
Forecast & purchasing      240 Referential Integrity       20
Business Incidents         179 Products & tariffs          58
                                Validation on input      119
                                Software & data          316
                                Hardware                 100
Total                   1.526 Total                     1.278


All amounts in k€
The power to shock
Customer number 67256292
Name                 Andre Richard        customer
Date of birth        15/3/1971            moves
                                                     Customer number 67268392
Address              Rue du Chêne 12
                     4680 Oupeye                     Name                 André Richard
                                                     Date of birth        null
                                                     Address              Rue Georges Simenon 7
Customer number 67635725                                                  4680 Hermée
                                        new
Name                Francoise Declerc   customer
Date of birth       5/7/1969
Address             Rue Du Chene 12
                    4680 Hermée




                                             11
                                                         EAN              541456700000827610
                                                         Address Essent   Rue Georges Simenon 7
EAN              541456700000672615                                       4680 Hermée

Address Essent   Rue Du Chene 12                         Address DGO      Rue Georges Simenon 7
                 4680 Hermée                                              4680 Oupeye

Address DGO      Rue du Chêne 12
                 4680 Oupeye
Cleaning for Dynamo
                                                                manual
                                                                cleansing




                          data
                update             correct                    export   scripts    insert
                         pump
    Axapta                                                                                   Mecoms
                                             DQ & Migration
  Back Office                                                                                Dynamo
                         extract




         Customer                                                                   Installation

Tools                       Human
                                                 Road 65
                           Inference




                                                            Access                 DNB
Data             WDM               Graydon
                                                           Register              Snapshots
Validation of addresses

                            Phonetic suggestion
                            is correct




Phonetic suggestion
is wrong
Person or organisation?
        Z          d
 '                      d
s d                      No change needed               3.444
 
                               Automatic change (3 - 1)       6.656
   
                                 Investigation needed (2 - 2)    201
 
   
                               3.444 B2B with no VAT number
d                                5.909 B2C with B2B tariff
Profiles and Meter Readings
 0,2
0,18
0,16                                                              Calculating the monthly advance
0,14
0,12                                                 Elec S21
 0,1                                                 Elec S22                      SLP          S31            Gas
0,08                                                 Gas S31                       EAC          30.000         kWh/year
0,06
                                                     Gas S32                       Price           0,05        €/kwH
0,04
0,02
  0
                                                    Month Flat             SLP           Flat      SLP         Budget
       1   2   3   4   5   6   7   8   9 10 11 12
                                                            1     125,00     271,41
                                                            2     125,00     231,30
   Synthetic Load Profiles                                  3     125,00     210,39
         for 2010                                           4     125,00     104,19       125,00      104,19     39,35 Contract start
                                                            5     125,00         40,46    125,00       40,46     39,35
                                                            6     125,00         20,55    125,00       20,55     39,35
                                                            7     125,00         15,95    125,00       15,95     39,35
                                                            8     125,00         15,58    125,00       15,58     39,35 Meter reading
                                                            9     125,00         30,30
                                                        10        125,00     102,57
                                                        11        125,00     195,49
                                                        12        125,00     261,81
                                                    Total       1.500,00 1.500,00 625,00 196,73 196,75
Migration validation

  Transformation   Loading       Total fallout




     116 steps      75 steps          0,2%



        500         1600
     validations   validations
It’s not all good news


   Social tariff is reserved for private persons

   • Organisations that had a social tariff have lost it
   • An order of nuns received a large correction bill


   A person must have a first name

   • Despite cleaning we still have customers called “.”
   • De Konink is all we have


   House number is mandatory

   • Sometimes the correct address has no house number
   • ‘t Frituurke - Arenbergplein
What now?

Más contenido relacionado

Más de DDMA

DM Barometer - Social marketing, puberaal of volwassen?
DM Barometer - Social marketing, puberaal of volwassen?DM Barometer - Social marketing, puberaal of volwassen?
DM Barometer - Social marketing, puberaal of volwassen?DDMA
 
DM Barometer - De marketeer in 2015
DM Barometer - De marketeer in 2015DM Barometer - De marketeer in 2015
DM Barometer - De marketeer in 2015DDMA
 
DDMA Usability onderzoek e-mailnieuwsbrieven
DDMA Usability onderzoek e-mailnieuwsbrievenDDMA Usability onderzoek e-mailnieuwsbrieven
DDMA Usability onderzoek e-mailnieuwsbrievenDDMA
 
Nationale E-mail Benchmark 2013
Nationale E-mail Benchmark 2013Nationale E-mail Benchmark 2013
Nationale E-mail Benchmark 2013DDMA
 
DDMA Nationale E-mail Benchmark 2014
DDMA Nationale E-mail Benchmark 2014DDMA Nationale E-mail Benchmark 2014
DDMA Nationale E-mail Benchmark 2014DDMA
 
DM Barometer Special - Mobile mysteries ontrafeld
DM Barometer Special - Mobile mysteries ontrafeldDM Barometer Special - Mobile mysteries ontrafeld
DM Barometer Special - Mobile mysteries ontrafeldDDMA
 
DM Barometer Special - Is data een kritische succesfactor
DM Barometer Special - Is data een kritische succesfactorDM Barometer Special - Is data een kritische succesfactor
DM Barometer Special - Is data een kritische succesfactorDDMA
 
DM Barometer Special - De stand van loyalty
DM Barometer Special - De stand van loyaltyDM Barometer Special - De stand van loyalty
DM Barometer Special - De stand van loyaltyDDMA
 
DM Barometer Special - De marketeer in 2014
DM Barometer Special - De marketeer in 2014DM Barometer Special - De marketeer in 2014
DM Barometer Special - De marketeer in 2014DDMA
 
DM Barometer - Search marketing
DM Barometer - Search marketingDM Barometer - Search marketing
DM Barometer - Search marketingDDMA
 
DM Barometer - Special: De marketeer in 2013
DM Barometer - Special: De marketeer in 2013DM Barometer - Special: De marketeer in 2013
DM Barometer - Special: De marketeer in 2013DDMA
 
DM Barometer - Special: Zoekmachine marketing
DM Barometer - Special: Zoekmachine marketingDM Barometer - Special: Zoekmachine marketing
DM Barometer - Special: Zoekmachine marketingDDMA
 
DM Barometer - Special: Geen fabels maar feiten over e-mail (editie 2012)
DM Barometer - Special: Geen fabels maar feiten over e-mail (editie 2012)DM Barometer - Special: Geen fabels maar feiten over e-mail (editie 2012)
DM Barometer - Special: Geen fabels maar feiten over e-mail (editie 2012)DDMA
 
Trendonderzoek dialoogmedia - editie 2012 (Samenvatting)
Trendonderzoek dialoogmedia - editie 2012 (Samenvatting)Trendonderzoek dialoogmedia - editie 2012 (Samenvatting)
Trendonderzoek dialoogmedia - editie 2012 (Samenvatting)DDMA
 
DDMA Nationale E-mail Benchmark 2011
DDMA Nationale E-mail Benchmark 2011DDMA Nationale E-mail Benchmark 2011
DDMA Nationale E-mail Benchmark 2011DDMA
 
DDMA vooorlichting Code Social Media marketing code juni 2012
DDMA vooorlichting Code Social Media marketing code juni 2012DDMA vooorlichting Code Social Media marketing code juni 2012
DDMA vooorlichting Code Social Media marketing code juni 2012DDMA
 
Ppt jaarplan 2012 commissie onderzoek & educatie
Ppt jaarplan 2012 commissie onderzoek & educatiePpt jaarplan 2012 commissie onderzoek & educatie
Ppt jaarplan 2012 commissie onderzoek & educatieDDMA
 
Ppt jaarplan 2012 cie. events & awards
Ppt jaarplan 2012 cie. events & awardsPpt jaarplan 2012 cie. events & awards
Ppt jaarplan 2012 cie. events & awardsDDMA
 
Ppt jaarplan 2012 commissie kennis & redactie
Ppt jaarplan 2012 commissie kennis & redactiePpt jaarplan 2012 commissie kennis & redactie
Ppt jaarplan 2012 commissie kennis & redactieDDMA
 
Jaarplan 2012 commissie esp's
Jaarplan 2012 commissie esp'sJaarplan 2012 commissie esp's
Jaarplan 2012 commissie esp'sDDMA
 

Más de DDMA (20)

DM Barometer - Social marketing, puberaal of volwassen?
DM Barometer - Social marketing, puberaal of volwassen?DM Barometer - Social marketing, puberaal of volwassen?
DM Barometer - Social marketing, puberaal of volwassen?
 
DM Barometer - De marketeer in 2015
DM Barometer - De marketeer in 2015DM Barometer - De marketeer in 2015
DM Barometer - De marketeer in 2015
 
DDMA Usability onderzoek e-mailnieuwsbrieven
DDMA Usability onderzoek e-mailnieuwsbrievenDDMA Usability onderzoek e-mailnieuwsbrieven
DDMA Usability onderzoek e-mailnieuwsbrieven
 
Nationale E-mail Benchmark 2013
Nationale E-mail Benchmark 2013Nationale E-mail Benchmark 2013
Nationale E-mail Benchmark 2013
 
DDMA Nationale E-mail Benchmark 2014
DDMA Nationale E-mail Benchmark 2014DDMA Nationale E-mail Benchmark 2014
DDMA Nationale E-mail Benchmark 2014
 
DM Barometer Special - Mobile mysteries ontrafeld
DM Barometer Special - Mobile mysteries ontrafeldDM Barometer Special - Mobile mysteries ontrafeld
DM Barometer Special - Mobile mysteries ontrafeld
 
DM Barometer Special - Is data een kritische succesfactor
DM Barometer Special - Is data een kritische succesfactorDM Barometer Special - Is data een kritische succesfactor
DM Barometer Special - Is data een kritische succesfactor
 
DM Barometer Special - De stand van loyalty
DM Barometer Special - De stand van loyaltyDM Barometer Special - De stand van loyalty
DM Barometer Special - De stand van loyalty
 
DM Barometer Special - De marketeer in 2014
DM Barometer Special - De marketeer in 2014DM Barometer Special - De marketeer in 2014
DM Barometer Special - De marketeer in 2014
 
DM Barometer - Search marketing
DM Barometer - Search marketingDM Barometer - Search marketing
DM Barometer - Search marketing
 
DM Barometer - Special: De marketeer in 2013
DM Barometer - Special: De marketeer in 2013DM Barometer - Special: De marketeer in 2013
DM Barometer - Special: De marketeer in 2013
 
DM Barometer - Special: Zoekmachine marketing
DM Barometer - Special: Zoekmachine marketingDM Barometer - Special: Zoekmachine marketing
DM Barometer - Special: Zoekmachine marketing
 
DM Barometer - Special: Geen fabels maar feiten over e-mail (editie 2012)
DM Barometer - Special: Geen fabels maar feiten over e-mail (editie 2012)DM Barometer - Special: Geen fabels maar feiten over e-mail (editie 2012)
DM Barometer - Special: Geen fabels maar feiten over e-mail (editie 2012)
 
Trendonderzoek dialoogmedia - editie 2012 (Samenvatting)
Trendonderzoek dialoogmedia - editie 2012 (Samenvatting)Trendonderzoek dialoogmedia - editie 2012 (Samenvatting)
Trendonderzoek dialoogmedia - editie 2012 (Samenvatting)
 
DDMA Nationale E-mail Benchmark 2011
DDMA Nationale E-mail Benchmark 2011DDMA Nationale E-mail Benchmark 2011
DDMA Nationale E-mail Benchmark 2011
 
DDMA vooorlichting Code Social Media marketing code juni 2012
DDMA vooorlichting Code Social Media marketing code juni 2012DDMA vooorlichting Code Social Media marketing code juni 2012
DDMA vooorlichting Code Social Media marketing code juni 2012
 
Ppt jaarplan 2012 commissie onderzoek & educatie
Ppt jaarplan 2012 commissie onderzoek & educatiePpt jaarplan 2012 commissie onderzoek & educatie
Ppt jaarplan 2012 commissie onderzoek & educatie
 
Ppt jaarplan 2012 cie. events & awards
Ppt jaarplan 2012 cie. events & awardsPpt jaarplan 2012 cie. events & awards
Ppt jaarplan 2012 cie. events & awards
 
Ppt jaarplan 2012 commissie kennis & redactie
Ppt jaarplan 2012 commissie kennis & redactiePpt jaarplan 2012 commissie kennis & redactie
Ppt jaarplan 2012 commissie kennis & redactie
 
Jaarplan 2012 commissie esp's
Jaarplan 2012 commissie esp'sJaarplan 2012 commissie esp's
Jaarplan 2012 commissie esp's
 

Último

Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Kaya Weers
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Mark Goldstein
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesManik S Magar
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
React Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkReact Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkPixlogix Infotech
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Hiroshi SHIBATA
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterMydbops
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...itnewsafrica
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructureitnewsafrica
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesBernd Ruecker
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxfnnc6jmgwh
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Alkin Tezuysal
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 

Último (20)

Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdf
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
React Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkReact Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App Framework
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL Router
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architectures
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 

DDMA Data Quality Award 2010 - Presentatie Mark Humphries - Essent Belgium

  • 1. Event: DDMA Data Quality Awards 2010 Spreker: Mark Humphries – Essent Belgium Datum: 14 oktober 2010, Klooster Noordwijk www.ddma.n l
  • 2. Project Dynamo Data Quality : delivered
  • 3. Our business We buy energy from the wholesale market We sell energy to the retail market Selling price – purchase price gross profit We collect transport, distribution and taxes That´s all we do
  • 4. Data fuels our business We collect information We update information when it changes We process information correctly Data Quality : “getting the data right”
  • 5. Context Rapid growth of the business •0 customers in 2002 •80k customers in 2006 •240k customers in 2007 Complex application environment •High maintenance costs •Poor integration •Unnecessary complexity Lack of controls •Poor data quality •Downstream errors Transaction based applications •No support for process integration •Inconsistent way of working •No structured exception handling
  • 6. Objectives Objectives : - Simplification and automation of processes - Focus on error handling - Increased data quality - Support for new market processes (MIG 4.0, SEPA, …) # Principle Aim Customer central The customer is the starting point for all processes First contact resolution Respond to customers’ needs in one contact First time right Eliminate errors Delegate responsibility by giving employees the Empowerment tools and the information they need to act Reduce costs by eliminating unnecessary Simplify complexity
  • 7. The business case Annual cost of poor data Investment in Data Quality + quality Migration Customer data 235 DQ & Mig Platform 398 Contract data 748 Customer data 221 Billing 124 Master data 46 Forecast & purchasing 240 Referential Integrity 20 Business Incidents 179 Products & tariffs 58 Validation on input 119 Software & data 316 Hardware 100 Total 1.526 Total 1.278 All amounts in k€
  • 8. The power to shock Customer number 67256292 Name Andre Richard customer Date of birth 15/3/1971 moves Customer number 67268392 Address Rue du Chêne 12 4680 Oupeye Name André Richard Date of birth null Address Rue Georges Simenon 7 Customer number 67635725 4680 Hermée new Name Francoise Declerc customer Date of birth 5/7/1969 Address Rue Du Chene 12 4680 Hermée 11 EAN 541456700000827610 Address Essent Rue Georges Simenon 7 EAN 541456700000672615 4680 Hermée Address Essent Rue Du Chene 12 Address DGO Rue Georges Simenon 7 4680 Hermée 4680 Oupeye Address DGO Rue du Chêne 12 4680 Oupeye
  • 9. Cleaning for Dynamo manual cleansing data update correct export scripts insert pump Axapta Mecoms DQ & Migration Back Office Dynamo extract Customer Installation Tools Human Road 65 Inference Access DNB Data WDM Graydon Register Snapshots
  • 10. Validation of addresses Phonetic suggestion is correct Phonetic suggestion is wrong
  • 11. Person or organisation? Z d ' d s d No change needed 3.444 Automatic change (3 - 1) 6.656 Investigation needed (2 - 2) 201 3.444 B2B with no VAT number d 5.909 B2C with B2B tariff
  • 12. Profiles and Meter Readings 0,2 0,18 0,16 Calculating the monthly advance 0,14 0,12 Elec S21 0,1 Elec S22 SLP S31 Gas 0,08 Gas S31 EAC 30.000 kWh/year 0,06 Gas S32 Price 0,05 €/kwH 0,04 0,02 0 Month Flat SLP Flat SLP Budget 1 2 3 4 5 6 7 8 9 10 11 12 1 125,00 271,41 2 125,00 231,30 Synthetic Load Profiles 3 125,00 210,39 for 2010 4 125,00 104,19 125,00 104,19 39,35 Contract start 5 125,00 40,46 125,00 40,46 39,35 6 125,00 20,55 125,00 20,55 39,35 7 125,00 15,95 125,00 15,95 39,35 8 125,00 15,58 125,00 15,58 39,35 Meter reading 9 125,00 30,30 10 125,00 102,57 11 125,00 195,49 12 125,00 261,81 Total 1.500,00 1.500,00 625,00 196,73 196,75
  • 13. Migration validation Transformation Loading Total fallout 116 steps 75 steps 0,2% 500 1600 validations validations
  • 14. It’s not all good news Social tariff is reserved for private persons • Organisations that had a social tariff have lost it • An order of nuns received a large correction bill A person must have a first name • Despite cleaning we still have customers called “.” • De Konink is all we have House number is mandatory • Sometimes the correct address has no house number • ‘t Frituurke - Arenbergplein