SlideShare una empresa de Scribd logo
1 de 20
1
The Challenge of Driving Business Value from AoT
Eliano Marques
April 2017
Unlock the Possibilities of Big Data
2
Introduction
3
Think Big Analytics History
1st Big Data Solution and Services provider with 100% focus on ecosystem analytics
with integration of open source Apache and cloud
• Founded in 2010; Big Data industry thought leader
• Open source integration expertise
• Full spectrum consulting, data engineering, data sciences & support
• 150+ successful projects & 100+ clients
• Global delivery model to balance needs (on-site, near-shore, off-shore)
• Fixed fee option experience for predictable risk and spend
• Field based software IP development model
Kafka
© 2016 Think Big, A Teradata Company
4
Intro to AoT
Use Cases
Our Experience
Key Patterns
Path-to-Production
Key takeaways
Agenda
© 2014 Teradata4
5
‘Things’ are listeningSpeech, location,
places, music,
browsing, app data,
health, commute,
social network, device
logs
PEOPLE: Faces, gait,
demographics
ENVIRONMENT:
sound, weather, air
quality, traffic,
gunshots, speeders,
live video
ME: Speech,
location, places,
driving behavior
CAR:
operational &
performance
logs
Speech, location,
places, music,
browsing, app data,
health, commute,
social network, device
logsPEOPLE: Faces, gait,
demographics, device,
network traffic
ENVIRONMENT: sound,
air quality, mechanicals,
live video
PEOPLE: employee
actions and behaviors
SHIP: operational &
performance logs,
geolocation
6
This Changes Everything
PRODUCT
One-time product
design
Continuous design/
feedback
MANUFACTURING
Silos, manual
operations
Automated
Smart factories
SUPPORT
Unplanned
downtime
Fixed before
it breaks
ORGANIZATION
Independent
business units
Cross-functional
coordination
BUSINESS GOALS
Product
centered
New digital
business revenue
7
This Changes Everything
8
Use-cases
9
Use cases
Automotive
conglomerate
Use-case: Smart
navigation, object
recognition & smart
parking assistance
Lead-time: Real-
time
# Data Sources: 6+
Value: Reducing
accidents, road traffic,
improving driving
experience
ML Accuracy: 98%
Savings: on-going
(with potential to reduce
accidents & traffic)
Storage
technologies
Use-case: Reduce
analyze time failures
& defect patterns
Lead-time: near
Real-time
# Data Sources: 10+
Value: Reduce dev.
time, improved
manufacturing yield,
customer satisfaction
ML Accuracy: n/a
Savings: $m/year
Shipping
company
Use-case: Predicting
Piston Ring Failure
Lead-time: 10 days
# Data Sources: 8
Value: Reducing
maintenance costs
with repairs &
replacement (R&R)
ML Accuracy: 63%
Savings: $m/year
Railway
company
Use-case: Predicting
Engine failures
Lead-time: 7-30 days
# Data Sources: 4
Value: Improving
downtime, customer
expe-rience &
optimize R&R costs
ML Accuracy: 87%
Savings: $m/year
Network
rail
Use-case: Predicting
switches failures
Lead-time: 7-30 days
# Data Sources: 6
Value: Reducing
delays, improve
service & optimize
R&R costs
ML Accuracy: 85%
Savings: $m/year
10
Use cases
Shipping
company
Use-case: Predicting
Piston Ring Failure
Lead-time: 10 days
# Data Sources: 8
Value: Reducing
maintenance costs
with repairs &
replacement (R&R)
ML Accuracy: 63%
Savings: $m/year
Length 400 m
Beam 59 m
Draft 16 m
Capacity 18000+ TEU
Price 185M USD
Dual engines Ultra long stroke,
2-stroke diesel, 86000 hp
Engine room
(one of the
engines)
11
2
3
4
1
2
Cylinder and piston on a two-stroke engine
Use-case: Predicting Piston Ring Failure
1
2
3
4
Rings changed due to failure on ring no.2
Rings changed due to failure on ring no.2
12
Approach
A
Data capturing
• Determining sources of data and
making data available
• Processing before data can be
used
Readability of the data, not just
access to the data was a key
learning
B
Data understanding
• Discussions with SME to
understand the data
• Determination of data focus
• Data Analysis
• Learnings
Significant learnings while
understanding the raw data
available from various sources
C
Developing the model
• Model development
• Model fine-tuning
• Model validation
• Promotion to Production
The deteriorating general piston
ring condition can be predicted
with a lead time of 10 days
D
Implementing the model
• Run in Production
• Catalog Model
• Promote to Scoring
• Design and Implement Alerting
The model supports engineers to
plan maintenance of the engine
by alarming about potential
failures
Activities Activities Activities
Take-away Take-away Take-away
Activities
Take-away
13
High-level process conducted
Learnings
• Understanding engineering processes
and technology of the engine and its
components is a major facilitator in
determining the right focus on the data
Sensor Data
Sensor
Descriptions
Maintenance
Data
Inspections
…
• Cleansing
• Outlier
removal
• Removal of
inactive
sensors
• Time series
alignment
In conjunction with
customers SME:
• Sensor hierarchy
creation
• Identification of
sensors relevant for
engines
• Sensor prioritization
based on engineering
knowledge
• Identification of
failures
• Inspection of various
data sources for
usability
Data to Model
• Feature
Engineer
ing
• Statistical
Analysis
• Correlation
Analysis
• Machine
Learning Model
• Cross-Validation
• Business
Validation
14
An example to put “Things” in context
1 month
High
Low
Abnormalcylinderbehaviour*
Lead
time
Port stays
PROB1
0.0
0.2
0.4
0.6
0.8
20xx-xx-xx 20xx-xx-xx 20xx-xx-xx 20xx-xx-xx
Piston ring change
Cylinders
Piston ring(s) changed Threshold
Abnormal behaviour:
Everything above
the threshold triggers
an alarm
Other cylinders below
threshold
Worn piston ring was
changed
Each point is a
combination of selected
sensor data for a
specific cylinder
15
Parameters Target
Level of detail
Prediction of piston
ring condition
Coverage
Accuracy
Lead time
60-80%
50-65%
10 days
Success criteria
Prediction piston condition on
engine level
75%
63%
>10 days
Results Success
Outcome
Results
16
Path-to-production
17
Data Lake (Production)
Catalog
Model
Run Production
Pipeline & update
Models
Promote to
Scoring
(packaging)
data lab (Development)
Model
(Dev, Test,
Validate)
Wrangle
Promote
model to
production
Path to Production
© 2016 Think Big, A Teradata Company
• Feature Enrichment
• Scoring
• Logging
• Feature Enrichment
• Scoring
• Logging
• Feature Enrichment
• Scoring
• Logging
• Feature Enrichment
• Scoring
• Logging
Model Consumption/ Serving (Scoring)
• In-Data Lake
• In-Database
• Near run-time systems
• Multiple Regions
• OnPrem & Cloud
• Insights Generation
• Question/Answer Agile
Discovery
• Business Outcomes
• Use-case execution
• Executing the Data
Science Promise
• Where Dreams
come True
Real
Time/Bash
Data
18
Key takeaways
19
Lessons Learned and key takeaways
Include All the
data,
not just sensor
data and it
changes
Combine
Science/Engine
ering with SME
Knowledge
Validate the
results &
measure the
uplift/savings
Measure the
cost of putting
the solution in
production
Measure the
Lead-time
required upfront
Don’t assume
your data is not
good enough
but measure the
quality upfront
Share the
results in a
business
language with
relevant
stakeholders
Manage the
expectations
all the time
20
Think you
Thank Big

Más contenido relacionado

La actualidad más candente

Extend Governance in Hadoop with Atlas Ecosystem: Waterline, Attivo & Trifacta
Extend Governance in Hadoop with Atlas Ecosystem: Waterline, Attivo & TrifactaExtend Governance in Hadoop with Atlas Ecosystem: Waterline, Attivo & Trifacta
Extend Governance in Hadoop with Atlas Ecosystem: Waterline, Attivo & TrifactaDataWorks Summit/Hadoop Summit
 
Reaching scale limits on a Hadoop platform: issues and errors created by spee...
Reaching scale limits on a Hadoop platform: issues and errors created by spee...Reaching scale limits on a Hadoop platform: issues and errors created by spee...
Reaching scale limits on a Hadoop platform: issues and errors created by spee...DataWorks Summit
 
Eliminating the Challenges of Big Data Management Inside Hadoop
Eliminating the Challenges of Big Data Management Inside HadoopEliminating the Challenges of Big Data Management Inside Hadoop
Eliminating the Challenges of Big Data Management Inside HadoopHortonworks
 
How to Optimize Hortonworks Apache Spark ML Workloads on Modern Processors
How to Optimize Hortonworks Apache Spark ML Workloads on Modern Processors How to Optimize Hortonworks Apache Spark ML Workloads on Modern Processors
How to Optimize Hortonworks Apache Spark ML Workloads on Modern Processors DataWorks Summit/Hadoop Summit
 
ING's Customer-Centric Data Journey from Community Idea to Private Cloud Depl...
ING's Customer-Centric Data Journey from Community Idea to Private Cloud Depl...ING's Customer-Centric Data Journey from Community Idea to Private Cloud Depl...
ING's Customer-Centric Data Journey from Community Idea to Private Cloud Depl...DataWorks Summit/Hadoop Summit
 
How Market Intelligence From Hadoop on Azure Shows Trucking Companies a Clear...
How Market Intelligence From Hadoop on Azure Shows Trucking Companies a Clear...How Market Intelligence From Hadoop on Azure Shows Trucking Companies a Clear...
How Market Intelligence From Hadoop on Azure Shows Trucking Companies a Clear...DataWorks Summit
 
Benefits of Transferring Real-Time Data to Hadoop at Scale
Benefits of Transferring Real-Time Data to Hadoop at ScaleBenefits of Transferring Real-Time Data to Hadoop at Scale
Benefits of Transferring Real-Time Data to Hadoop at ScaleHortonworks
 
Security, ETL, BI & Analytics, and Software Integration
Security, ETL, BI & Analytics, and Software IntegrationSecurity, ETL, BI & Analytics, and Software Integration
Security, ETL, BI & Analytics, and Software IntegrationDataWorks Summit
 
Apache Hadoop Crash Course
Apache Hadoop Crash CourseApache Hadoop Crash Course
Apache Hadoop Crash CourseDataWorks Summit
 
Machine Learning Everywhere
Machine Learning EverywhereMachine Learning Everywhere
Machine Learning EverywhereDataWorks Summit
 
Oracle Stream Analytics - Developer Introduction
Oracle Stream Analytics - Developer IntroductionOracle Stream Analytics - Developer Introduction
Oracle Stream Analytics - Developer IntroductionJeffrey T. Pollock
 
Accelerating Data Science and Real Time Analytics at Scale
Accelerating Data Science and Real Time Analytics at ScaleAccelerating Data Science and Real Time Analytics at Scale
Accelerating Data Science and Real Time Analytics at ScaleHortonworks
 
How Apache Spark and Apache Hadoop are being used to keep banking regulators ...
How Apache Spark and Apache Hadoop are being used to keep banking regulators ...How Apache Spark and Apache Hadoop are being used to keep banking regulators ...
How Apache Spark and Apache Hadoop are being used to keep banking regulators ...DataWorks Summit
 
Real-time Data Pipelines with SAP and Apache Kafka
Real-time Data Pipelines with SAP and Apache KafkaReal-time Data Pipelines with SAP and Apache Kafka
Real-time Data Pipelines with SAP and Apache KafkaCarole Gunst
 
Swimming Across the Data Lake, Lessons learned and keys to success
Swimming Across the Data Lake, Lessons learned and keys to success Swimming Across the Data Lake, Lessons learned and keys to success
Swimming Across the Data Lake, Lessons learned and keys to success DataWorks Summit/Hadoop Summit
 
The Power of your Data Achieved - Next Gen Modernization
The Power of your Data Achieved - Next Gen ModernizationThe Power of your Data Achieved - Next Gen Modernization
The Power of your Data Achieved - Next Gen ModernizationHortonworks
 

La actualidad más candente (20)

Apache Spark Crash Course
Apache Spark Crash CourseApache Spark Crash Course
Apache Spark Crash Course
 
Keys for Success from Streams to Queries
Keys for Success from Streams to QueriesKeys for Success from Streams to Queries
Keys for Success from Streams to Queries
 
Extend Governance in Hadoop with Atlas Ecosystem: Waterline, Attivo & Trifacta
Extend Governance in Hadoop with Atlas Ecosystem: Waterline, Attivo & TrifactaExtend Governance in Hadoop with Atlas Ecosystem: Waterline, Attivo & Trifacta
Extend Governance in Hadoop with Atlas Ecosystem: Waterline, Attivo & Trifacta
 
Reaching scale limits on a Hadoop platform: issues and errors created by spee...
Reaching scale limits on a Hadoop platform: issues and errors created by spee...Reaching scale limits on a Hadoop platform: issues and errors created by spee...
Reaching scale limits on a Hadoop platform: issues and errors created by spee...
 
Eliminating the Challenges of Big Data Management Inside Hadoop
Eliminating the Challenges of Big Data Management Inside HadoopEliminating the Challenges of Big Data Management Inside Hadoop
Eliminating the Challenges of Big Data Management Inside Hadoop
 
How to Optimize Hortonworks Apache Spark ML Workloads on Modern Processors
How to Optimize Hortonworks Apache Spark ML Workloads on Modern Processors How to Optimize Hortonworks Apache Spark ML Workloads on Modern Processors
How to Optimize Hortonworks Apache Spark ML Workloads on Modern Processors
 
ING's Customer-Centric Data Journey from Community Idea to Private Cloud Depl...
ING's Customer-Centric Data Journey from Community Idea to Private Cloud Depl...ING's Customer-Centric Data Journey from Community Idea to Private Cloud Depl...
ING's Customer-Centric Data Journey from Community Idea to Private Cloud Depl...
 
How Market Intelligence From Hadoop on Azure Shows Trucking Companies a Clear...
How Market Intelligence From Hadoop on Azure Shows Trucking Companies a Clear...How Market Intelligence From Hadoop on Azure Shows Trucking Companies a Clear...
How Market Intelligence From Hadoop on Azure Shows Trucking Companies a Clear...
 
The Manulife Journey
The Manulife JourneyThe Manulife Journey
The Manulife Journey
 
Benefits of Transferring Real-Time Data to Hadoop at Scale
Benefits of Transferring Real-Time Data to Hadoop at ScaleBenefits of Transferring Real-Time Data to Hadoop at Scale
Benefits of Transferring Real-Time Data to Hadoop at Scale
 
Security, ETL, BI & Analytics, and Software Integration
Security, ETL, BI & Analytics, and Software IntegrationSecurity, ETL, BI & Analytics, and Software Integration
Security, ETL, BI & Analytics, and Software Integration
 
Apache Hadoop Crash Course
Apache Hadoop Crash CourseApache Hadoop Crash Course
Apache Hadoop Crash Course
 
Machine Learning Everywhere
Machine Learning EverywhereMachine Learning Everywhere
Machine Learning Everywhere
 
Oracle Stream Analytics - Developer Introduction
Oracle Stream Analytics - Developer IntroductionOracle Stream Analytics - Developer Introduction
Oracle Stream Analytics - Developer Introduction
 
Accelerating Data Science and Real Time Analytics at Scale
Accelerating Data Science and Real Time Analytics at ScaleAccelerating Data Science and Real Time Analytics at Scale
Accelerating Data Science and Real Time Analytics at Scale
 
Big Data at your Desk with KNIME
Big Data at your Desk with KNIMEBig Data at your Desk with KNIME
Big Data at your Desk with KNIME
 
How Apache Spark and Apache Hadoop are being used to keep banking regulators ...
How Apache Spark and Apache Hadoop are being used to keep banking regulators ...How Apache Spark and Apache Hadoop are being used to keep banking regulators ...
How Apache Spark and Apache Hadoop are being used to keep banking regulators ...
 
Real-time Data Pipelines with SAP and Apache Kafka
Real-time Data Pipelines with SAP and Apache KafkaReal-time Data Pipelines with SAP and Apache Kafka
Real-time Data Pipelines with SAP and Apache Kafka
 
Swimming Across the Data Lake, Lessons learned and keys to success
Swimming Across the Data Lake, Lessons learned and keys to success Swimming Across the Data Lake, Lessons learned and keys to success
Swimming Across the Data Lake, Lessons learned and keys to success
 
The Power of your Data Achieved - Next Gen Modernization
The Power of your Data Achieved - Next Gen ModernizationThe Power of your Data Achieved - Next Gen Modernization
The Power of your Data Achieved - Next Gen Modernization
 

Similar a The Challenge of Driving Business Value from the Analytics of Things (AOT)

Barga ACM DEBS 2013 Keynote
Barga ACM DEBS 2013 KeynoteBarga ACM DEBS 2013 Keynote
Barga ACM DEBS 2013 KeynoteRoger Barga
 
How komatsu is driving operational efficiencies using io t and machine learni...
How komatsu is driving operational efficiencies using io t and machine learni...How komatsu is driving operational efficiencies using io t and machine learni...
How komatsu is driving operational efficiencies using io t and machine learni...Cloudera, Inc.
 
Predictive Maintenance with R
Predictive Maintenance with RPredictive Maintenance with R
Predictive Maintenance with Reoda GmbH
 
e-mining Increasing visibility and efficiency of Mining Operations
e-mining Increasing visibility and efficiency of Mining Operationse-mining Increasing visibility and efficiency of Mining Operations
e-mining Increasing visibility and efficiency of Mining OperationsGiorgos Papapanagiotakis
 
Big Data: Operational Excellence
Big Data: Operational ExcellenceBig Data: Operational Excellence
Big Data: Operational ExcellenceMatthias Vallaey
 
A Mathematical Model for Evaluation of Data Analytics Implementation Alternat...
A Mathematical Model for Evaluation of Data Analytics Implementation Alternat...A Mathematical Model for Evaluation of Data Analytics Implementation Alternat...
A Mathematical Model for Evaluation of Data Analytics Implementation Alternat...Jānis Grabis
 
BCT-PTC Digital Webinar - IoT and Asset Analytics
BCT-PTC Digital Webinar - IoT and Asset Analytics BCT-PTC Digital Webinar - IoT and Asset Analytics
BCT-PTC Digital Webinar - IoT and Asset Analytics Bahwan CyberTek
 
Open Source Data Management for Industry 4.0
Open Source Data Management for Industry 4.0Open Source Data Management for Industry 4.0
Open Source Data Management for Industry 4.0DataWorks Summit
 
Mdm for materials –positive impact of data quality improvement
Mdm for materials –positive impact of data quality improvementMdm for materials –positive impact of data quality improvement
Mdm for materials –positive impact of data quality improvementVerdantis Inc.
 
NREL Drive cycle data focused tools- matching the right tech to the right app
NREL Drive cycle data focused tools- matching the right tech to the right appNREL Drive cycle data focused tools- matching the right tech to the right app
NREL Drive cycle data focused tools- matching the right tech to the right appCALSTART
 
Rolling Stock Maintenance Summit 2016
Rolling Stock Maintenance Summit 2016Rolling Stock Maintenance Summit 2016
Rolling Stock Maintenance Summit 2016marketinglbcg
 
Industrial asset optimization overview slideshare
Industrial asset optimization   overview slideshareIndustrial asset optimization   overview slideshare
Industrial asset optimization overview slideshareGenpact Ltd
 
Optimizing Observability Spend: Metrics
Optimizing Observability Spend: MetricsOptimizing Observability Spend: Metrics
Optimizing Observability Spend: MetricsEric D. Schabell
 
Driving the Data Pipelines for Connected Vehicles with Spring Cloud Data Flow
Driving the Data Pipelines for Connected Vehicles with Spring Cloud Data FlowDriving the Data Pipelines for Connected Vehicles with Spring Cloud Data Flow
Driving the Data Pipelines for Connected Vehicles with Spring Cloud Data FlowVMware Tanzu
 
Handling Big Data in Ship Performance & Navigation Monitoring.
Handling Big Data in Ship Performance & Navigation Monitoring.Handling Big Data in Ship Performance & Navigation Monitoring.
Handling Big Data in Ship Performance & Navigation Monitoring.Lokukaluge Prasad Perera
 
PDO Predictive Analytics Share for the Annual Research Forum 2015
PDO Predictive Analytics Share for the Annual Research Forum 2015PDO Predictive Analytics Share for the Annual Research Forum 2015
PDO Predictive Analytics Share for the Annual Research Forum 2015Faris Al-Kharusi
 
Digital Transformation through Product and Service Innovation - Session Spons...
Digital Transformation through Product and Service Innovation - Session Spons...Digital Transformation through Product and Service Innovation - Session Spons...
Digital Transformation through Product and Service Innovation - Session Spons...Amazon Web Services
 

Similar a The Challenge of Driving Business Value from the Analytics of Things (AOT) (20)

APM
APMAPM
APM
 
Barga ACM DEBS 2013 Keynote
Barga ACM DEBS 2013 KeynoteBarga ACM DEBS 2013 Keynote
Barga ACM DEBS 2013 Keynote
 
How komatsu is driving operational efficiencies using io t and machine learni...
How komatsu is driving operational efficiencies using io t and machine learni...How komatsu is driving operational efficiencies using io t and machine learni...
How komatsu is driving operational efficiencies using io t and machine learni...
 
Predictive Maintenance with R
Predictive Maintenance with RPredictive Maintenance with R
Predictive Maintenance with R
 
e-mining Increasing visibility and efficiency of Mining Operations
e-mining Increasing visibility and efficiency of Mining Operationse-mining Increasing visibility and efficiency of Mining Operations
e-mining Increasing visibility and efficiency of Mining Operations
 
Big Data: Operational Excellence
Big Data: Operational ExcellenceBig Data: Operational Excellence
Big Data: Operational Excellence
 
A Mathematical Model for Evaluation of Data Analytics Implementation Alternat...
A Mathematical Model for Evaluation of Data Analytics Implementation Alternat...A Mathematical Model for Evaluation of Data Analytics Implementation Alternat...
A Mathematical Model for Evaluation of Data Analytics Implementation Alternat...
 
BCT-PTC Digital Webinar - IoT and Asset Analytics
BCT-PTC Digital Webinar - IoT and Asset Analytics BCT-PTC Digital Webinar - IoT and Asset Analytics
BCT-PTC Digital Webinar - IoT and Asset Analytics
 
Michael Hummel - Stop Storing Data! - Parstream
Michael Hummel - Stop Storing Data! - ParstreamMichael Hummel - Stop Storing Data! - Parstream
Michael Hummel - Stop Storing Data! - Parstream
 
Open Source Data Management for Industry 4.0
Open Source Data Management for Industry 4.0Open Source Data Management for Industry 4.0
Open Source Data Management for Industry 4.0
 
Mdm for materials –positive impact of data quality improvement
Mdm for materials –positive impact of data quality improvementMdm for materials –positive impact of data quality improvement
Mdm for materials –positive impact of data quality improvement
 
NREL Drive cycle data focused tools- matching the right tech to the right app
NREL Drive cycle data focused tools- matching the right tech to the right appNREL Drive cycle data focused tools- matching the right tech to the right app
NREL Drive cycle data focused tools- matching the right tech to the right app
 
Rolling Stock Maintenance Summit 2016
Rolling Stock Maintenance Summit 2016Rolling Stock Maintenance Summit 2016
Rolling Stock Maintenance Summit 2016
 
A2IoT OBDII Case Study
A2IoT OBDII Case StudyA2IoT OBDII Case Study
A2IoT OBDII Case Study
 
Industrial asset optimization overview slideshare
Industrial asset optimization   overview slideshareIndustrial asset optimization   overview slideshare
Industrial asset optimization overview slideshare
 
Optimizing Observability Spend: Metrics
Optimizing Observability Spend: MetricsOptimizing Observability Spend: Metrics
Optimizing Observability Spend: Metrics
 
Driving the Data Pipelines for Connected Vehicles with Spring Cloud Data Flow
Driving the Data Pipelines for Connected Vehicles with Spring Cloud Data FlowDriving the Data Pipelines for Connected Vehicles with Spring Cloud Data Flow
Driving the Data Pipelines for Connected Vehicles with Spring Cloud Data Flow
 
Handling Big Data in Ship Performance & Navigation Monitoring.
Handling Big Data in Ship Performance & Navigation Monitoring.Handling Big Data in Ship Performance & Navigation Monitoring.
Handling Big Data in Ship Performance & Navigation Monitoring.
 
PDO Predictive Analytics Share for the Annual Research Forum 2015
PDO Predictive Analytics Share for the Annual Research Forum 2015PDO Predictive Analytics Share for the Annual Research Forum 2015
PDO Predictive Analytics Share for the Annual Research Forum 2015
 
Digital Transformation through Product and Service Innovation - Session Spons...
Digital Transformation through Product and Service Innovation - Session Spons...Digital Transformation through Product and Service Innovation - Session Spons...
Digital Transformation through Product and Service Innovation - Session Spons...
 

Más de DataWorks Summit/Hadoop Summit

Unleashing the Power of Apache Atlas with Apache Ranger
Unleashing the Power of Apache Atlas with Apache RangerUnleashing the Power of Apache Atlas with Apache Ranger
Unleashing the Power of Apache Atlas with Apache RangerDataWorks Summit/Hadoop Summit
 
Enabling Digital Diagnostics with a Data Science Platform
Enabling Digital Diagnostics with a Data Science PlatformEnabling Digital Diagnostics with a Data Science Platform
Enabling Digital Diagnostics with a Data Science PlatformDataWorks Summit/Hadoop Summit
 
Double Your Hadoop Performance with Hortonworks SmartSense
Double Your Hadoop Performance with Hortonworks SmartSenseDouble Your Hadoop Performance with Hortonworks SmartSense
Double Your Hadoop Performance with Hortonworks SmartSenseDataWorks Summit/Hadoop Summit
 
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...DataWorks Summit/Hadoop Summit
 
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...DataWorks Summit/Hadoop Summit
 
Mool - Automated Log Analysis using Data Science and ML
Mool - Automated Log Analysis using Data Science and MLMool - Automated Log Analysis using Data Science and ML
Mool - Automated Log Analysis using Data Science and MLDataWorks Summit/Hadoop Summit
 
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...DataWorks Summit/Hadoop Summit
 
Scaling HDFS to Manage Billions of Files with Distributed Storage Schemes
Scaling HDFS to Manage Billions of Files with Distributed Storage SchemesScaling HDFS to Manage Billions of Files with Distributed Storage Schemes
Scaling HDFS to Manage Billions of Files with Distributed Storage SchemesDataWorks Summit/Hadoop Summit
 
Modernizing Business Processes with Big Data: Real-World Use Cases for Produc...
Modernizing Business Processes with Big Data: Real-World Use Cases for Produc...Modernizing Business Processes with Big Data: Real-World Use Cases for Produc...
Modernizing Business Processes with Big Data: Real-World Use Cases for Produc...DataWorks Summit/Hadoop Summit
 

Más de DataWorks Summit/Hadoop Summit (20)

Running Apache Spark & Apache Zeppelin in Production
Running Apache Spark & Apache Zeppelin in ProductionRunning Apache Spark & Apache Zeppelin in Production
Running Apache Spark & Apache Zeppelin in Production
 
State of Security: Apache Spark & Apache Zeppelin
State of Security: Apache Spark & Apache ZeppelinState of Security: Apache Spark & Apache Zeppelin
State of Security: Apache Spark & Apache Zeppelin
 
Unleashing the Power of Apache Atlas with Apache Ranger
Unleashing the Power of Apache Atlas with Apache RangerUnleashing the Power of Apache Atlas with Apache Ranger
Unleashing the Power of Apache Atlas with Apache Ranger
 
Enabling Digital Diagnostics with a Data Science Platform
Enabling Digital Diagnostics with a Data Science PlatformEnabling Digital Diagnostics with a Data Science Platform
Enabling Digital Diagnostics with a Data Science Platform
 
Revolutionize Text Mining with Spark and Zeppelin
Revolutionize Text Mining with Spark and ZeppelinRevolutionize Text Mining with Spark and Zeppelin
Revolutionize Text Mining with Spark and Zeppelin
 
Double Your Hadoop Performance with Hortonworks SmartSense
Double Your Hadoop Performance with Hortonworks SmartSenseDouble Your Hadoop Performance with Hortonworks SmartSense
Double Your Hadoop Performance with Hortonworks SmartSense
 
Hadoop Crash Course
Hadoop Crash CourseHadoop Crash Course
Hadoop Crash Course
 
Data Science Crash Course
Data Science Crash CourseData Science Crash Course
Data Science Crash Course
 
Dataflow with Apache NiFi
Dataflow with Apache NiFiDataflow with Apache NiFi
Dataflow with Apache NiFi
 
Schema Registry - Set you Data Free
Schema Registry - Set you Data FreeSchema Registry - Set you Data Free
Schema Registry - Set you Data Free
 
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
 
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
 
Mool - Automated Log Analysis using Data Science and ML
Mool - Automated Log Analysis using Data Science and MLMool - Automated Log Analysis using Data Science and ML
Mool - Automated Log Analysis using Data Science and ML
 
How Hadoop Makes the Natixis Pack More Efficient
How Hadoop Makes the Natixis Pack More Efficient How Hadoop Makes the Natixis Pack More Efficient
How Hadoop Makes the Natixis Pack More Efficient
 
HBase in Practice
HBase in Practice HBase in Practice
HBase in Practice
 
Breaking the 1 Million OPS/SEC Barrier in HOPS Hadoop
Breaking the 1 Million OPS/SEC Barrier in HOPS HadoopBreaking the 1 Million OPS/SEC Barrier in HOPS Hadoop
Breaking the 1 Million OPS/SEC Barrier in HOPS Hadoop
 
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
 
Backup and Disaster Recovery in Hadoop
Backup and Disaster Recovery in Hadoop Backup and Disaster Recovery in Hadoop
Backup and Disaster Recovery in Hadoop
 
Scaling HDFS to Manage Billions of Files with Distributed Storage Schemes
Scaling HDFS to Manage Billions of Files with Distributed Storage SchemesScaling HDFS to Manage Billions of Files with Distributed Storage Schemes
Scaling HDFS to Manage Billions of Files with Distributed Storage Schemes
 
Modernizing Business Processes with Big Data: Real-World Use Cases for Produc...
Modernizing Business Processes with Big Data: Real-World Use Cases for Produc...Modernizing Business Processes with Big Data: Real-World Use Cases for Produc...
Modernizing Business Processes with Big Data: Real-World Use Cases for Produc...
 

Último

Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demoHarshalMandlekar2
 
Assure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyesAssure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyesThousandEyes
 
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Scott Andery
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...AliaaTarek5
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfNeo4j
 
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...panagenda
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Farhan Tariq
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityIES VE
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationKnoldus Inc.
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI AgeCprime
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterMydbops
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 

Último (20)

Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
 
Assure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyesAssure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyes
 
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdf
 
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a reality
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog Presentation
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI Age
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL Router
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 

The Challenge of Driving Business Value from the Analytics of Things (AOT)

  • 1. 1 The Challenge of Driving Business Value from AoT Eliano Marques April 2017 Unlock the Possibilities of Big Data
  • 3. 3 Think Big Analytics History 1st Big Data Solution and Services provider with 100% focus on ecosystem analytics with integration of open source Apache and cloud • Founded in 2010; Big Data industry thought leader • Open source integration expertise • Full spectrum consulting, data engineering, data sciences & support • 150+ successful projects & 100+ clients • Global delivery model to balance needs (on-site, near-shore, off-shore) • Fixed fee option experience for predictable risk and spend • Field based software IP development model Kafka © 2016 Think Big, A Teradata Company
  • 4. 4 Intro to AoT Use Cases Our Experience Key Patterns Path-to-Production Key takeaways Agenda © 2014 Teradata4
  • 5. 5 ‘Things’ are listeningSpeech, location, places, music, browsing, app data, health, commute, social network, device logs PEOPLE: Faces, gait, demographics ENVIRONMENT: sound, weather, air quality, traffic, gunshots, speeders, live video ME: Speech, location, places, driving behavior CAR: operational & performance logs Speech, location, places, music, browsing, app data, health, commute, social network, device logsPEOPLE: Faces, gait, demographics, device, network traffic ENVIRONMENT: sound, air quality, mechanicals, live video PEOPLE: employee actions and behaviors SHIP: operational & performance logs, geolocation
  • 6. 6 This Changes Everything PRODUCT One-time product design Continuous design/ feedback MANUFACTURING Silos, manual operations Automated Smart factories SUPPORT Unplanned downtime Fixed before it breaks ORGANIZATION Independent business units Cross-functional coordination BUSINESS GOALS Product centered New digital business revenue
  • 9. 9 Use cases Automotive conglomerate Use-case: Smart navigation, object recognition & smart parking assistance Lead-time: Real- time # Data Sources: 6+ Value: Reducing accidents, road traffic, improving driving experience ML Accuracy: 98% Savings: on-going (with potential to reduce accidents & traffic) Storage technologies Use-case: Reduce analyze time failures & defect patterns Lead-time: near Real-time # Data Sources: 10+ Value: Reduce dev. time, improved manufacturing yield, customer satisfaction ML Accuracy: n/a Savings: $m/year Shipping company Use-case: Predicting Piston Ring Failure Lead-time: 10 days # Data Sources: 8 Value: Reducing maintenance costs with repairs & replacement (R&R) ML Accuracy: 63% Savings: $m/year Railway company Use-case: Predicting Engine failures Lead-time: 7-30 days # Data Sources: 4 Value: Improving downtime, customer expe-rience & optimize R&R costs ML Accuracy: 87% Savings: $m/year Network rail Use-case: Predicting switches failures Lead-time: 7-30 days # Data Sources: 6 Value: Reducing delays, improve service & optimize R&R costs ML Accuracy: 85% Savings: $m/year
  • 10. 10 Use cases Shipping company Use-case: Predicting Piston Ring Failure Lead-time: 10 days # Data Sources: 8 Value: Reducing maintenance costs with repairs & replacement (R&R) ML Accuracy: 63% Savings: $m/year Length 400 m Beam 59 m Draft 16 m Capacity 18000+ TEU Price 185M USD Dual engines Ultra long stroke, 2-stroke diesel, 86000 hp Engine room (one of the engines)
  • 11. 11 2 3 4 1 2 Cylinder and piston on a two-stroke engine Use-case: Predicting Piston Ring Failure 1 2 3 4 Rings changed due to failure on ring no.2 Rings changed due to failure on ring no.2
  • 12. 12 Approach A Data capturing • Determining sources of data and making data available • Processing before data can be used Readability of the data, not just access to the data was a key learning B Data understanding • Discussions with SME to understand the data • Determination of data focus • Data Analysis • Learnings Significant learnings while understanding the raw data available from various sources C Developing the model • Model development • Model fine-tuning • Model validation • Promotion to Production The deteriorating general piston ring condition can be predicted with a lead time of 10 days D Implementing the model • Run in Production • Catalog Model • Promote to Scoring • Design and Implement Alerting The model supports engineers to plan maintenance of the engine by alarming about potential failures Activities Activities Activities Take-away Take-away Take-away Activities Take-away
  • 13. 13 High-level process conducted Learnings • Understanding engineering processes and technology of the engine and its components is a major facilitator in determining the right focus on the data Sensor Data Sensor Descriptions Maintenance Data Inspections … • Cleansing • Outlier removal • Removal of inactive sensors • Time series alignment In conjunction with customers SME: • Sensor hierarchy creation • Identification of sensors relevant for engines • Sensor prioritization based on engineering knowledge • Identification of failures • Inspection of various data sources for usability Data to Model • Feature Engineer ing • Statistical Analysis • Correlation Analysis • Machine Learning Model • Cross-Validation • Business Validation
  • 14. 14 An example to put “Things” in context 1 month High Low Abnormalcylinderbehaviour* Lead time Port stays PROB1 0.0 0.2 0.4 0.6 0.8 20xx-xx-xx 20xx-xx-xx 20xx-xx-xx 20xx-xx-xx Piston ring change Cylinders Piston ring(s) changed Threshold Abnormal behaviour: Everything above the threshold triggers an alarm Other cylinders below threshold Worn piston ring was changed Each point is a combination of selected sensor data for a specific cylinder
  • 15. 15 Parameters Target Level of detail Prediction of piston ring condition Coverage Accuracy Lead time 60-80% 50-65% 10 days Success criteria Prediction piston condition on engine level 75% 63% >10 days Results Success Outcome Results
  • 17. 17 Data Lake (Production) Catalog Model Run Production Pipeline & update Models Promote to Scoring (packaging) data lab (Development) Model (Dev, Test, Validate) Wrangle Promote model to production Path to Production © 2016 Think Big, A Teradata Company • Feature Enrichment • Scoring • Logging • Feature Enrichment • Scoring • Logging • Feature Enrichment • Scoring • Logging • Feature Enrichment • Scoring • Logging Model Consumption/ Serving (Scoring) • In-Data Lake • In-Database • Near run-time systems • Multiple Regions • OnPrem & Cloud • Insights Generation • Question/Answer Agile Discovery • Business Outcomes • Use-case execution • Executing the Data Science Promise • Where Dreams come True Real Time/Bash Data
  • 19. 19 Lessons Learned and key takeaways Include All the data, not just sensor data and it changes Combine Science/Engine ering with SME Knowledge Validate the results & measure the uplift/savings Measure the cost of putting the solution in production Measure the Lead-time required upfront Don’t assume your data is not good enough but measure the quality upfront Share the results in a business language with relevant stakeholders Manage the expectations all the time