SlideShare una empresa de Scribd logo
1 de 24
Smart networks shed new light
on old water loss facts
  Haggai Scolnicov, TaKaDu
WHAT IS TAKADU?


                  2
Let’s revisit Active Leakage Control




                      Data
          Flow
                     analysis    Field
 DMAs   meters at                         Repairs
                       and      surveys
         inlets
                    targeting




                                                    3
Let’s revisit Active Leakage Control



                   Data
                   Data
     Data                        Field
                 analysis
                  analysis
   Continuous       and
                    and       Triggered by
   monitoring    targeting   specific events
                targeting



                                               4
Let’s revisit Active Leakage Control



                          Data
                          Data
         Data                            Field
Flow, GIS, calendar,    analysis Early repairs
                         analysis
      Continuous
network operations,        and
                           and       Triggered by
                                  Less visible bursts
      monitoring        targeting   specific events
pressure, weather,     targeting  Continuous service
schematics…                        Cost and capacity


                                                        5
You can’t just “look for flow increases”



                Other      Complex
     Data
               network      utility
    quality
                events     process



                                       6
Analyst = Superman?
• Sifting
  Check all data for all DMAs
• Statistical estimation
  Is flow surprisingly high?
• Special knowledge
  Was it caused by something else?

 TaKaDu’s algorithms help boost this phase

                                              7
TaKaDu monitors network anomalies




                                    8
WHY WE NEED TO STUDY LEAKS
(AND HOW WE GOT TO BE GOOD AT IT)

                                    9
Can you spot the hiding elephant?




                                    10
Some leaks are easy to spot




• Great for marketing and conference slides
But…
• You don’t need a fancy algorithm to find this
• You may not even need an analyst
But most leaks are a little trickier




                                       12
But most leaks are a little trickier




                                       13
But most leaks are a little trickier




                                       14
How leaks hide in data

•   Small leaks (1 l/s) in large DMAs (XX l/s)
•   Other flow increases (legitimate or other faults)
•   Concurrent flow decrease
•   Concurrent expected flow increase
•   Random variability
                                       Other   Complex
•   Wrong data!                Data
                                      network   utility
                              quality
                                       events  process
•   Gradual increase

                                                     15
Field experience and hard evidence

• Millions of sensor-days of data processed
• Thousands of leaks found, analysed and
  reported at a dozen utilities
• Every utility is unique (really!)
• … But some basic truths are common




                                              16
TOP FACTS ABOUT LEAKAGE
(WHICH DON’T GET ENOUGH PUBLICITY)

                                     17
Many leaks start abruptly at 0.5-5 l/s

                                   4 l/s leak starts




• You can target significant leaks soon after start
• “DMA has 2 leaks, one X l/s and one Y l/s” vs.
  “DMA total leakage is Z l/s”

                                                       18
Leaks start small and grow




• Early intervention is worth more than it seems
• A 1 l/s leak is just a 5 l/s leak waiting to happen


                                                    19
… Or they cause major visible bursts




• Early intervention prevents costly bursts
• You often have weeks and even months before
  the “big pop”

                                            20
Do many leaks last years and years?

• Very rare in events noticeable in data (~ 1 l/s)
• Perhaps common in leaks of 0.1 l/s or 0.01 l/s?
     Does anyone have solid evidence for this?
     Are many DMAs leaking 20 x 0.1 l/s?
     Tinier leaks are vast majority of repairs,
     but do they matter?


• So where does (real) water loss come from?

                                                     21
Many leaks last weeks to months
(then they are repaired after a visible burst or ALC)




                                     110 l/s burst




• Several megalitres lost before repair / big burst

• This is a huge component of water loss
                                                     22
Some leaks grow very slowly




• Rare, but possibly a distinct category of leak
• Anecdotally tougher to locate (many months)
• Maybe old pipe perforating at many locations?


                                               23
Thank you!

Más contenido relacionado

Similar a what leaks really look like: challenging conventional wisdom with smart water knowledge

incident analysis - procedure and approach
incident analysis - procedure and approachincident analysis - procedure and approach
incident analysis - procedure and approach
Derek Chang
 
Error in hadoop
Error in hadoopError in hadoop
Error in hadoop
Len Bass
 
Secondary data analysis with digital trace data
Secondary data analysis with digital trace dataSecondary data analysis with digital trace data
Secondary data analysis with digital trace data
Andrea Wiggins
 

Similar a what leaks really look like: challenging conventional wisdom with smart water knowledge (20)

10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...
10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...
10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...
 
The Central Hub: Defining the Data Lake
The Central Hub: Defining the Data LakeThe Central Hub: Defining the Data Lake
The Central Hub: Defining the Data Lake
 
Stationarity is the new speed
Stationarity is the new speedStationarity is the new speed
Stationarity is the new speed
 
incident analysis - procedure and approach
incident analysis - procedure and approachincident analysis - procedure and approach
incident analysis - procedure and approach
 
Cyber Analytics Applications for Data-Intensive Computing
Cyber Analytics Applications for Data-Intensive ComputingCyber Analytics Applications for Data-Intensive Computing
Cyber Analytics Applications for Data-Intensive Computing
 
Performance is a Shape, Not a Number
Performance is a Shape, Not a NumberPerformance is a Shape, Not a Number
Performance is a Shape, Not a Number
 
Error in hadoop
Error in hadoopError in hadoop
Error in hadoop
 
Observability - The good, the bad and the ugly Xp Days 2019 Kiev Ukraine
Observability -  The good, the bad and the ugly Xp Days 2019 Kiev Ukraine Observability -  The good, the bad and the ugly Xp Days 2019 Kiev Ukraine
Observability - The good, the bad and the ugly Xp Days 2019 Kiev Ukraine
 
Big Data Approaches to Cloud Security
Big Data Approaches to Cloud SecurityBig Data Approaches to Cloud Security
Big Data Approaches to Cloud Security
 
Gigamon U - Real Time Real Clear, Real Time Solutions for Today’s Application...
Gigamon U - Real Time Real Clear, Real Time Solutions for Today’s Application...Gigamon U - Real Time Real Clear, Real Time Solutions for Today’s Application...
Gigamon U - Real Time Real Clear, Real Time Solutions for Today’s Application...
 
Data Intensive Engineering
Data Intensive EngineeringData Intensive Engineering
Data Intensive Engineering
 
Big data pipelines
Big data pipelinesBig data pipelines
Big data pipelines
 
A Deep Learning use case for water end use detection by Roberto Díaz and José...
A Deep Learning use case for water end use detection by Roberto Díaz and José...A Deep Learning use case for water end use detection by Roberto Díaz and José...
A Deep Learning use case for water end use detection by Roberto Díaz and José...
 
Multi-Cluster and Failover for Apache Kafka - Kafka Summit SF 17
Multi-Cluster and Failover for Apache Kafka - Kafka Summit SF 17Multi-Cluster and Failover for Apache Kafka - Kafka Summit SF 17
Multi-Cluster and Failover for Apache Kafka - Kafka Summit SF 17
 
Big Data Rampage
Big Data RampageBig Data Rampage
Big Data Rampage
 
Big Events Cause Network Mayhem
Big Events Cause Network MayhemBig Events Cause Network Mayhem
Big Events Cause Network Mayhem
 
IT Operation Analytic for security- MiSSconf(sp1)
IT Operation Analytic for security- MiSSconf(sp1)IT Operation Analytic for security- MiSSconf(sp1)
IT Operation Analytic for security- MiSSconf(sp1)
 
POD-Diagnosis: Error Detection and Diagnosis of Sporadic Operations on Cloud ...
POD-Diagnosis: Error Detection and Diagnosis of Sporadic Operations on Cloud ...POD-Diagnosis: Error Detection and Diagnosis of Sporadic Operations on Cloud ...
POD-Diagnosis: Error Detection and Diagnosis of Sporadic Operations on Cloud ...
 
Observability - the good, the bad, and the ugly
Observability - the good, the bad, and the uglyObservability - the good, the bad, and the ugly
Observability - the good, the bad, and the ugly
 
Secondary data analysis with digital trace data
Secondary data analysis with digital trace dataSecondary data analysis with digital trace data
Secondary data analysis with digital trace data
 

Último

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Último (20)

CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 

what leaks really look like: challenging conventional wisdom with smart water knowledge

  • 1. Smart networks shed new light on old water loss facts Haggai Scolnicov, TaKaDu
  • 3. Let’s revisit Active Leakage Control Data Flow analysis Field DMAs meters at Repairs and surveys inlets targeting 3
  • 4. Let’s revisit Active Leakage Control Data Data Data Field analysis analysis Continuous and and Triggered by monitoring targeting specific events targeting 4
  • 5. Let’s revisit Active Leakage Control Data Data Data Field Flow, GIS, calendar, analysis Early repairs analysis Continuous network operations, and and Triggered by Less visible bursts monitoring targeting specific events pressure, weather, targeting Continuous service schematics… Cost and capacity 5
  • 6. You can’t just “look for flow increases” Other Complex Data network utility quality events process 6
  • 7. Analyst = Superman? • Sifting Check all data for all DMAs • Statistical estimation Is flow surprisingly high? • Special knowledge Was it caused by something else?  TaKaDu’s algorithms help boost this phase 7
  • 9. WHY WE NEED TO STUDY LEAKS (AND HOW WE GOT TO BE GOOD AT IT) 9
  • 10. Can you spot the hiding elephant? 10
  • 11. Some leaks are easy to spot • Great for marketing and conference slides But… • You don’t need a fancy algorithm to find this • You may not even need an analyst
  • 12. But most leaks are a little trickier 12
  • 13. But most leaks are a little trickier 13
  • 14. But most leaks are a little trickier 14
  • 15. How leaks hide in data • Small leaks (1 l/s) in large DMAs (XX l/s) • Other flow increases (legitimate or other faults) • Concurrent flow decrease • Concurrent expected flow increase • Random variability Other Complex • Wrong data! Data network utility quality events process • Gradual increase 15
  • 16. Field experience and hard evidence • Millions of sensor-days of data processed • Thousands of leaks found, analysed and reported at a dozen utilities • Every utility is unique (really!) • … But some basic truths are common 16
  • 17. TOP FACTS ABOUT LEAKAGE (WHICH DON’T GET ENOUGH PUBLICITY) 17
  • 18. Many leaks start abruptly at 0.5-5 l/s 4 l/s leak starts • You can target significant leaks soon after start • “DMA has 2 leaks, one X l/s and one Y l/s” vs. “DMA total leakage is Z l/s” 18
  • 19. Leaks start small and grow • Early intervention is worth more than it seems • A 1 l/s leak is just a 5 l/s leak waiting to happen 19
  • 20. … Or they cause major visible bursts • Early intervention prevents costly bursts • You often have weeks and even months before the “big pop” 20
  • 21. Do many leaks last years and years? • Very rare in events noticeable in data (~ 1 l/s) • Perhaps common in leaks of 0.1 l/s or 0.01 l/s? Does anyone have solid evidence for this? Are many DMAs leaking 20 x 0.1 l/s? Tinier leaks are vast majority of repairs, but do they matter? • So where does (real) water loss come from? 21
  • 22. Many leaks last weeks to months (then they are repaired after a visible burst or ALC) 110 l/s burst • Several megalitres lost before repair / big burst • This is a huge component of water loss 22
  • 23. Some leaks grow very slowly • Rare, but possibly a distinct category of leak • Anecdotally tougher to locate (many months) • Maybe old pipe perforating at many locations? 23