SlideShare a Scribd company logo
1 of 25
The Price Is
Right
THE PRICE
IS RIGHT
USING MACHINE TO MAXIMIZE COMPANY PROFIT
Agenda
• About me!?
• Dynamic Deal Scoring
• How do we do it?
• Project outcome…
• Q&A
Am I relevant ?
198
4
Dynamic Deal Scoring
(a.k.a. The Price is Right)
Motivation
• For every product, we should be able to find
the optimal price that a customer is willing to
pay
• We would factor in highly specific insights
that would influence the price
• Customer has ~750k of custom products – manual
practices for setting prices make it virtually
impossible to see the pricing patterns
• Dynamic deal scoring integrated into the core
commercial process will help organization to
price smarter, streamline the approval process,
and win more deals
Fact finding mission
• Sales reps often argue that higher discounts
are necessary to win deals
• FALSE - research across companies consistently
shows the opposite to be true: successful deals
almost always have lower average discounts than
deals that were lost
• A pricing infrastructure can be difficult and
costly to create
• TRUE - It requires investing appropriately,
empowering the right people, articulating clear
targets and goals, and managing risk, but….
Dynamic Deal Scoring
• is certainly not new, having been pioneered by
airlines in the ‘70s and now widely used by
hotels, airlines, and car rental and tour
operators
• it’s not only being used in online
environments. Traditional bricks and mortar
companies are also revolutionizing how they
monetize, finding new ways to tap into
customers’ willingness to pay
• can be located within a broader move towards
customization and personalization with the
emergence of data
Dynamic Deal Scoring
• On average, a 1% price increase translates into
an 8.7% increase in operating profits (assuming
no loss of volume, of course)
• 30% of all pricing decisions companies make
every year fail to deliver the best price!!! –
a lot of lost revenue
• CAUTION! Dynamic Deal Scoring when used blindly
or in isolation , i.e. without human oversight
and a clear strategy, can at worst destroy
reputation and erode consumer trust
How do we do it?
Requires (some) technical
skills
Hard work and long nights …
• Hypotheses
• Apply experiments
• Read measurement
• Deduce next steps
• We used CRISP methodology
Six steps to build the model
Data prepStep
▪ A piece of R code
takes the invoice
data and:
– Filters out
data that
should not be
considered in
the model
– Creates
synthetic
variables based
upon the
existing data
– Combines
invoices into
deals (there
are multiple
invoices
associated with
each deal)
▪ A piece of R code
calculates the
margin cutoffs
for A, B, C, D,
and F deals
within each node
▪ An tool shows the
distribution of
grades across
various
dimensions
including
Industry, and
Product Group.
Where there
exists a strong
skew towards A
grades or F
grades, the tool
will be used to
adjust margin
cutoffs to reduce
the uneven
distribution
▪ The DW team
provides invoice
data with margins
adjusted to match
the P&L and
additional
variables mapped
in from sources
outside the ERP
▪ The DDS model
embedded within
SalesForce
Detail
Input data DDS tree building Scoring Adjustments Output to tool
1 2 3 4 5 6
▪ Building the tree
involves two sub-
steps:
– Choosing
appropriate
variables based
on business
logic and
predictive
power
– Using the
regular method
to grow the
tree within the
bounds of best
practices. All
deals will be
sorted into
nodes of
similar
business
characteristics
and margin
3a
3b
Data prep
Data prep flow
This flow filters data, applies sales adjustments, and applies cost
adjustments
X
Sales adjustments
Cost adjustments
X
X
Filters
Combined invoice file
=
Sales + cost file by invoice
The output is a file with the sales and cost for each invoice
line. This file is mapped into the R data prep code
Data prep
Synthetic
variables
▪ Top Customer: This variables has 7 values; the 6 largest customers
and “other”
▪ Annual customer spend: The spend for the top customer for 2018
▪ Product Super Group: Assigned based on product group
▪ No of items in platform: sums up number of unique items within a
platform
▪ Deal size: Sum of invoice sales for that deal (as defined below)
▪ Spend per customer per item: % of a customer’s annual sales
represented by that item
▪ Platform: binary yes/no; is that item part of a platform
▪ Make vs Buy: binary make/buy
▪ No items in quote: “Quote” is same Sales Rep, same Customer, same
Order Date
Filters
▪ Intercompany sales
▪ Tooling and engineering charges
▪ Returns
▪ Invoices with sales > $10M or < -$10M
▪ Deals with margin > 100% or < 0%
▪ MOV/MOQ’s
Combining
invoices into
deals
▪ Deals are defined as the same customer, same item, same invoiced
price; all invoices fitting this criteria are combined
DDS tree building
Choosing
Variables
DDS Tree
3a
3b
▪ Before running the tree code, it is necessary to select final list of
variables to be used in tree
▪ The selection criteria should be a combination of the relative
predictive power and the business logic of the variables
▪ The tree should not branch on something that shouldn't be
prescriptive, even though it is descriptive of today’s behavior
(e.g., month of year)
▪ The variable should be capturable as an input during quotation
process
▪ With the list of variables finalized, manually select the branches of
the first two or three levels of the tree
▪ The remaining levels can be built automatically (allow the code to
select the most logical branching), but throughout the process, apply
best practices to guide and adjust the tree
▪ The “N” of terminal nodes should be no less than 50 and the P-value
of each branch should be below 0.05
▪ Best practice is for the R-square of the tree as a whole to be
greater than 30%.
Validate against Best Practice

Proposed modelBest practice
4220+
175-10+
31%130%+
Number of deal parameters analyzed
Number of deal parameters found predictive and
used for deal scoring
Predictive power of the scoring algorithm (R2)
Price realization uplift expected 2-3%2-7%1
Cutoff adjustment
Pre-adjustment distribution
Post-adjustment
distribution
Project outcome…
Project outcome…
• Project engagement: 8 weeks over 3 month period
• Project cost: 90% of cost was pure R’n’R –
traveling and accommodation cost due client
world wide presence
• 3 for 3 : project was fully paid of by correct
and timely pricing within 3 months of use in
production and measured above product price
baseline
• now in Revenue share mode 
www.atmc.ai
info@atmc.ai
The price is right - Tomislav Krizan

More Related Content

What's hot

Sonum Procurement Operations Planning
Sonum Procurement Operations Planning  Sonum Procurement Operations Planning
Sonum Procurement Operations Planning Anaplan
 
Profit is an Opinion,but Cash or lack thereof, is Cold Hard Reality
Profit is an Opinion,but Cash or lack thereof, is Cold Hard RealityProfit is an Opinion,but Cash or lack thereof, is Cold Hard Reality
Profit is an Opinion,but Cash or lack thereof, is Cold Hard RealityDennis L. Thompson, CPA, CFE
 
Earning capacity ratios
Earning capacity ratiosEarning capacity ratios
Earning capacity ratiosCollege
 
Earning capacity ratios
Earning capacity ratiosEarning capacity ratios
Earning capacity ratiosCollege
 
Financial reports and ratios
Financial reports and ratiosFinancial reports and ratios
Financial reports and ratiosCollege
 
150928 MAP Economics v1
150928 MAP Economics v1150928 MAP Economics v1
150928 MAP Economics v1Warren Leow
 
Incentive based IT outsourcing
Incentive based IT outsourcingIncentive based IT outsourcing
Incentive based IT outsourcingJohn UE
 
Pace 2009 Effective Financial Management
Pace 2009 Effective Financial ManagementPace 2009 Effective Financial Management
Pace 2009 Effective Financial ManagementLinnea Blair
 
5 Essential Startup Metrics
5 Essential Startup Metrics5 Essential Startup Metrics
5 Essential Startup MetricsReuven Cohen
 
Comparative analysis of fair value and historical cost accounting on reported...
Comparative analysis of fair value and historical cost accounting on reported...Comparative analysis of fair value and historical cost accounting on reported...
Comparative analysis of fair value and historical cost accounting on reported...Alexander Decker
 
Managerial Economics Scope by Bedaduri rama murthy
Managerial Economics Scope by Bedaduri rama murthyManagerial Economics Scope by Bedaduri rama murthy
Managerial Economics Scope by Bedaduri rama murthyB S R MURTHY
 
Types of Financial Model - Financial Modeling by EduCBA
Types of Financial Model - Financial Modeling by EduCBATypes of Financial Model - Financial Modeling by EduCBA
Types of Financial Model - Financial Modeling by EduCBAeduCBA
 
Financial modelling 2016 WEB VERSION
Financial modelling 2016 WEB VERSIONFinancial modelling 2016 WEB VERSION
Financial modelling 2016 WEB VERSIONAlistair Hynd
 
SPEND ANALYSIS KEY TO PURCHASING SUCCESS
SPEND ANALYSIS KEY TO PURCHASING SUCCESSSPEND ANALYSIS KEY TO PURCHASING SUCCESS
SPEND ANALYSIS KEY TO PURCHASING SUCCESSBill Kohnen
 
When is Driver-Based Modeling Applicable
When is Driver-Based Modeling ApplicableWhen is Driver-Based Modeling Applicable
When is Driver-Based Modeling ApplicableNilly Essaides
 
Home assignment - Tal Elor
Home assignment   - Tal ElorHome assignment   - Tal Elor
Home assignment - Tal Elorssuser88467b
 
Technical Interview Workshop Sept 17 2007 V2 Website
Technical Interview Workshop Sept 17 2007 V2 WebsiteTechnical Interview Workshop Sept 17 2007 V2 Website
Technical Interview Workshop Sept 17 2007 V2 WebsiteMcGill Investment Club
 

What's hot (20)

Sonum Procurement Operations Planning
Sonum Procurement Operations Planning  Sonum Procurement Operations Planning
Sonum Procurement Operations Planning
 
Profit is an Opinion,but Cash or lack thereof, is Cold Hard Reality
Profit is an Opinion,but Cash or lack thereof, is Cold Hard RealityProfit is an Opinion,but Cash or lack thereof, is Cold Hard Reality
Profit is an Opinion,but Cash or lack thereof, is Cold Hard Reality
 
Return on Investment
Return on InvestmentReturn on Investment
Return on Investment
 
Earning capacity ratios
Earning capacity ratiosEarning capacity ratios
Earning capacity ratios
 
Earning capacity ratios
Earning capacity ratiosEarning capacity ratios
Earning capacity ratios
 
Financial reports and ratios
Financial reports and ratiosFinancial reports and ratios
Financial reports and ratios
 
CMI Slides
CMI SlidesCMI Slides
CMI Slides
 
150928 MAP Economics v1
150928 MAP Economics v1150928 MAP Economics v1
150928 MAP Economics v1
 
Incentive based IT outsourcing
Incentive based IT outsourcingIncentive based IT outsourcing
Incentive based IT outsourcing
 
Pace 2009 Effective Financial Management
Pace 2009 Effective Financial ManagementPace 2009 Effective Financial Management
Pace 2009 Effective Financial Management
 
5 Essential Startup Metrics
5 Essential Startup Metrics5 Essential Startup Metrics
5 Essential Startup Metrics
 
Comparative analysis of fair value and historical cost accounting on reported...
Comparative analysis of fair value and historical cost accounting on reported...Comparative analysis of fair value and historical cost accounting on reported...
Comparative analysis of fair value and historical cost accounting on reported...
 
Managerial Economics Scope by Bedaduri rama murthy
Managerial Economics Scope by Bedaduri rama murthyManagerial Economics Scope by Bedaduri rama murthy
Managerial Economics Scope by Bedaduri rama murthy
 
Nobel overview
Nobel overviewNobel overview
Nobel overview
 
Types of Financial Model - Financial Modeling by EduCBA
Types of Financial Model - Financial Modeling by EduCBATypes of Financial Model - Financial Modeling by EduCBA
Types of Financial Model - Financial Modeling by EduCBA
 
Financial modelling 2016 WEB VERSION
Financial modelling 2016 WEB VERSIONFinancial modelling 2016 WEB VERSION
Financial modelling 2016 WEB VERSION
 
SPEND ANALYSIS KEY TO PURCHASING SUCCESS
SPEND ANALYSIS KEY TO PURCHASING SUCCESSSPEND ANALYSIS KEY TO PURCHASING SUCCESS
SPEND ANALYSIS KEY TO PURCHASING SUCCESS
 
When is Driver-Based Modeling Applicable
When is Driver-Based Modeling ApplicableWhen is Driver-Based Modeling Applicable
When is Driver-Based Modeling Applicable
 
Home assignment - Tal Elor
Home assignment   - Tal ElorHome assignment   - Tal Elor
Home assignment - Tal Elor
 
Technical Interview Workshop Sept 17 2007 V2 Website
Technical Interview Workshop Sept 17 2007 V2 WebsiteTechnical Interview Workshop Sept 17 2007 V2 Website
Technical Interview Workshop Sept 17 2007 V2 Website
 

Similar to The price is right - Tomislav Krizan

Leveraging Data Analysis for Sales
Leveraging Data Analysis for SalesLeveraging Data Analysis for Sales
Leveraging Data Analysis for SalesAditya Ratnaparkhi
 
Multiquip Goes AI with Involve
Multiquip Goes AI with InvolveMultiquip Goes AI with Involve
Multiquip Goes AI with InvolveRazaSiddiqui9
 
Vendavo Pricing Guidance - Deliver 2-5% Margin Improvement in Weeks
Vendavo Pricing Guidance - Deliver 2-5% Margin Improvement in WeeksVendavo Pricing Guidance - Deliver 2-5% Margin Improvement in Weeks
Vendavo Pricing Guidance - Deliver 2-5% Margin Improvement in WeeksCaroline Burns
 
Financial Modeling
Financial ModelingFinancial Modeling
Financial ModelingJeremy Horn
 
Sales White Paper: ROI On Sales Effectiveness
Sales White Paper: ROI On Sales EffectivenessSales White Paper: ROI On Sales Effectiveness
Sales White Paper: ROI On Sales EffectivenessAltify
 
Confessions of a RevOps Curmudgeon - How sales leaders can get the greenligh...
Confessions of a RevOps Curmudgeon  - How sales leaders can get the greenligh...Confessions of a RevOps Curmudgeon  - How sales leaders can get the greenligh...
Confessions of a RevOps Curmudgeon - How sales leaders can get the greenligh...Tenbound
 
Pricing for product managers vancouver nov 2017
Pricing for product managers vancouver nov 2017Pricing for product managers vancouver nov 2017
Pricing for product managers vancouver nov 2017Steven Forth
 
20120628 building the sfdc business case-ar-mad
20120628 building the sfdc business case-ar-mad20120628 building the sfdc business case-ar-mad
20120628 building the sfdc business case-ar-madFlorian Zink
 
What's an ABM Solution Really Worth? Understanding the Total Economic Impact ...
What's an ABM Solution Really Worth? Understanding the Total Economic Impact ...What's an ABM Solution Really Worth? Understanding the Total Economic Impact ...
What's an ABM Solution Really Worth? Understanding the Total Economic Impact ...Demandbase
 
TPM Retail Increasing Business Value - Joel Cartwright
TPM Retail Increasing Business Value - Joel CartwrightTPM Retail Increasing Business Value - Joel Cartwright
TPM Retail Increasing Business Value - Joel CartwrightGlobal Creative Group, Inc
 
MonetizingStatistics
MonetizingStatisticsMonetizingStatistics
MonetizingStatisticsAaron Sankey
 
Best Practices in Sales Operations v5
Best Practices in Sales Operations v5Best Practices in Sales Operations v5
Best Practices in Sales Operations v5565 Business Group
 
Creating a Business Case for Global Payroll - APA Fall Forum
Creating a Business Case for Global Payroll - APA Fall ForumCreating a Business Case for Global Payroll - APA Fall Forum
Creating a Business Case for Global Payroll - APA Fall ForumCatriona Keevans
 
How to Measure the Impact of Quote-to-Cash Business Transformation
How to Measure the Impact of Quote-to-Cash Business TransformationHow to Measure the Impact of Quote-to-Cash Business Transformation
How to Measure the Impact of Quote-to-Cash Business TransformationApttus
 
Subscribed NYC 2017: Aligning Pricing and Revenue – Two Sides Of A Very Valua...
Subscribed NYC 2017: Aligning Pricing and Revenue – Two Sides Of A Very Valua...Subscribed NYC 2017: Aligning Pricing and Revenue – Two Sides Of A Very Valua...
Subscribed NYC 2017: Aligning Pricing and Revenue – Two Sides Of A Very Valua...Zuora, Inc.
 

Similar to The price is right - Tomislav Krizan (20)

Leveraging Data Analysis for Sales
Leveraging Data Analysis for SalesLeveraging Data Analysis for Sales
Leveraging Data Analysis for Sales
 
Multiquip Goes AI with Involve
Multiquip Goes AI with InvolveMultiquip Goes AI with Involve
Multiquip Goes AI with Involve
 
Competitive Analysis & Intelligence
Competitive Analysis & IntelligenceCompetitive Analysis & Intelligence
Competitive Analysis & Intelligence
 
Vendavo Pricing Guidance - Deliver 2-5% Margin Improvement in Weeks
Vendavo Pricing Guidance - Deliver 2-5% Margin Improvement in WeeksVendavo Pricing Guidance - Deliver 2-5% Margin Improvement in Weeks
Vendavo Pricing Guidance - Deliver 2-5% Margin Improvement in Weeks
 
Financial Modeling
Financial ModelingFinancial Modeling
Financial Modeling
 
Sales White Paper: ROI On Sales Effectiveness
Sales White Paper: ROI On Sales EffectivenessSales White Paper: ROI On Sales Effectiveness
Sales White Paper: ROI On Sales Effectiveness
 
Confessions of a RevOps Curmudgeon - How sales leaders can get the greenligh...
Confessions of a RevOps Curmudgeon  - How sales leaders can get the greenligh...Confessions of a RevOps Curmudgeon  - How sales leaders can get the greenligh...
Confessions of a RevOps Curmudgeon - How sales leaders can get the greenligh...
 
Pricing for product managers vancouver nov 2017
Pricing for product managers vancouver nov 2017Pricing for product managers vancouver nov 2017
Pricing for product managers vancouver nov 2017
 
20120628 building the sfdc business case-ar-mad
20120628 building the sfdc business case-ar-mad20120628 building the sfdc business case-ar-mad
20120628 building the sfdc business case-ar-mad
 
What's an ABM Solution Really Worth? Understanding the Total Economic Impact ...
What's an ABM Solution Really Worth? Understanding the Total Economic Impact ...What's an ABM Solution Really Worth? Understanding the Total Economic Impact ...
What's an ABM Solution Really Worth? Understanding the Total Economic Impact ...
 
TPM Retail Increasing Business Value - Joel Cartwright
TPM Retail Increasing Business Value - Joel CartwrightTPM Retail Increasing Business Value - Joel Cartwright
TPM Retail Increasing Business Value - Joel Cartwright
 
MonetizingStatistics
MonetizingStatisticsMonetizingStatistics
MonetizingStatistics
 
Wettemann
WettemannWettemann
Wettemann
 
Best Practices in Sales Operations v5
Best Practices in Sales Operations v5Best Practices in Sales Operations v5
Best Practices in Sales Operations v5
 
Creating a Business Case for Global Payroll - APA Fall Forum
Creating a Business Case for Global Payroll - APA Fall ForumCreating a Business Case for Global Payroll - APA Fall Forum
Creating a Business Case for Global Payroll - APA Fall Forum
 
CaseStudy.pptx
CaseStudy.pptxCaseStudy.pptx
CaseStudy.pptx
 
How to Measure the Impact of Quote-to-Cash Business Transformation
How to Measure the Impact of Quote-to-Cash Business TransformationHow to Measure the Impact of Quote-to-Cash Business Transformation
How to Measure the Impact of Quote-to-Cash Business Transformation
 
Subscribed NYC 2017: Aligning Pricing and Revenue – Two Sides Of A Very Valua...
Subscribed NYC 2017: Aligning Pricing and Revenue – Two Sides Of A Very Valua...Subscribed NYC 2017: Aligning Pricing and Revenue – Two Sides Of A Very Valua...
Subscribed NYC 2017: Aligning Pricing and Revenue – Two Sides Of A Very Valua...
 
TradeSmart Case Studies
TradeSmart Case StudiesTradeSmart Case Studies
TradeSmart Case Studies
 
IT Cost Benefits Strategy
IT Cost Benefits StrategyIT Cost Benefits Strategy
IT Cost Benefits Strategy
 

More from Institute of Contemporary Sciences

Building valuable (online and offline) Data Science communities - Experience ...
Building valuable (online and offline) Data Science communities - Experience ...Building valuable (online and offline) Data Science communities - Experience ...
Building valuable (online and offline) Data Science communities - Experience ...Institute of Contemporary Sciences
 
Data Science Master 4.0 on Belgrade University - Drazen Draskovic
Data Science Master 4.0 on Belgrade University - Drazen DraskovicData Science Master 4.0 on Belgrade University - Drazen Draskovic
Data Science Master 4.0 on Belgrade University - Drazen DraskovicInstitute of Contemporary Sciences
 
Deep learning fast and slow, a responsible and explainable AI framework - Ahm...
Deep learning fast and slow, a responsible and explainable AI framework - Ahm...Deep learning fast and slow, a responsible and explainable AI framework - Ahm...
Deep learning fast and slow, a responsible and explainable AI framework - Ahm...Institute of Contemporary Sciences
 
Solving churn challenge in Big Data environment - Jelena Pekez
Solving churn challenge in Big Data environment  - Jelena PekezSolving churn challenge in Big Data environment  - Jelena Pekez
Solving churn challenge in Big Data environment - Jelena PekezInstitute of Contemporary Sciences
 
Application of Business Intelligence in bank risk management - Dimitar Dilov
Application of Business Intelligence in bank risk management - Dimitar DilovApplication of Business Intelligence in bank risk management - Dimitar Dilov
Application of Business Intelligence in bank risk management - Dimitar DilovInstitute of Contemporary Sciences
 
Trends and practical applications of AI/ML in Fin Tech industry - Milos Kosan...
Trends and practical applications of AI/ML in Fin Tech industry - Milos Kosan...Trends and practical applications of AI/ML in Fin Tech industry - Milos Kosan...
Trends and practical applications of AI/ML in Fin Tech industry - Milos Kosan...Institute of Contemporary Sciences
 
Recommender systems for personalized financial advice from concept to product...
Recommender systems for personalized financial advice from concept to product...Recommender systems for personalized financial advice from concept to product...
Recommender systems for personalized financial advice from concept to product...Institute of Contemporary Sciences
 
Advanced tools in real time analytics and AI in customer support - Milan Sima...
Advanced tools in real time analytics and AI in customer support - Milan Sima...Advanced tools in real time analytics and AI in customer support - Milan Sima...
Advanced tools in real time analytics and AI in customer support - Milan Sima...Institute of Contemporary Sciences
 
Complex AI forecasting methods for investments portfolio optimization - Pawel...
Complex AI forecasting methods for investments portfolio optimization - Pawel...Complex AI forecasting methods for investments portfolio optimization - Pawel...
Complex AI forecasting methods for investments portfolio optimization - Pawel...Institute of Contemporary Sciences
 
Reality and traps of real time data engineering - Milos Solujic
Reality and traps of real time data engineering - Milos SolujicReality and traps of real time data engineering - Milos Solujic
Reality and traps of real time data engineering - Milos SolujicInstitute of Contemporary Sciences
 
Sensor networks for personalized health monitoring - Vladimir Brusic
Sensor networks for personalized health monitoring - Vladimir BrusicSensor networks for personalized health monitoring - Vladimir Brusic
Sensor networks for personalized health monitoring - Vladimir BrusicInstitute of Contemporary Sciences
 
Prediction of good patterns for future sales using image recognition
Prediction of good patterns for future sales using image recognitionPrediction of good patterns for future sales using image recognition
Prediction of good patterns for future sales using image recognitionInstitute of Contemporary Sciences
 
Using data to fight corruption: full budget transparency in local government
Using data to fight corruption: full budget transparency in local governmentUsing data to fight corruption: full budget transparency in local government
Using data to fight corruption: full budget transparency in local governmentInstitute of Contemporary Sciences
 
Machine Learning-Driven Injury Prediction for a Professional Sports Team
Machine Learning-Driven Injury Prediction for a Professional Sports TeamMachine Learning-Driven Injury Prediction for a Professional Sports Team
Machine Learning-Driven Injury Prediction for a Professional Sports TeamInstitute of Contemporary Sciences
 

More from Institute of Contemporary Sciences (20)

First 5 years of PSI:ML - Filip Panjevic
First 5 years of PSI:ML - Filip PanjevicFirst 5 years of PSI:ML - Filip Panjevic
First 5 years of PSI:ML - Filip Panjevic
 
Building valuable (online and offline) Data Science communities - Experience ...
Building valuable (online and offline) Data Science communities - Experience ...Building valuable (online and offline) Data Science communities - Experience ...
Building valuable (online and offline) Data Science communities - Experience ...
 
Data Science Master 4.0 on Belgrade University - Drazen Draskovic
Data Science Master 4.0 on Belgrade University - Drazen DraskovicData Science Master 4.0 on Belgrade University - Drazen Draskovic
Data Science Master 4.0 on Belgrade University - Drazen Draskovic
 
Deep learning fast and slow, a responsible and explainable AI framework - Ahm...
Deep learning fast and slow, a responsible and explainable AI framework - Ahm...Deep learning fast and slow, a responsible and explainable AI framework - Ahm...
Deep learning fast and slow, a responsible and explainable AI framework - Ahm...
 
Solving churn challenge in Big Data environment - Jelena Pekez
Solving churn challenge in Big Data environment  - Jelena PekezSolving churn challenge in Big Data environment  - Jelena Pekez
Solving churn challenge in Big Data environment - Jelena Pekez
 
Application of Business Intelligence in bank risk management - Dimitar Dilov
Application of Business Intelligence in bank risk management - Dimitar DilovApplication of Business Intelligence in bank risk management - Dimitar Dilov
Application of Business Intelligence in bank risk management - Dimitar Dilov
 
Trends and practical applications of AI/ML in Fin Tech industry - Milos Kosan...
Trends and practical applications of AI/ML in Fin Tech industry - Milos Kosan...Trends and practical applications of AI/ML in Fin Tech industry - Milos Kosan...
Trends and practical applications of AI/ML in Fin Tech industry - Milos Kosan...
 
Recommender systems for personalized financial advice from concept to product...
Recommender systems for personalized financial advice from concept to product...Recommender systems for personalized financial advice from concept to product...
Recommender systems for personalized financial advice from concept to product...
 
Advanced tools in real time analytics and AI in customer support - Milan Sima...
Advanced tools in real time analytics and AI in customer support - Milan Sima...Advanced tools in real time analytics and AI in customer support - Milan Sima...
Advanced tools in real time analytics and AI in customer support - Milan Sima...
 
Complex AI forecasting methods for investments portfolio optimization - Pawel...
Complex AI forecasting methods for investments portfolio optimization - Pawel...Complex AI forecasting methods for investments portfolio optimization - Pawel...
Complex AI forecasting methods for investments portfolio optimization - Pawel...
 
From Zero to ML Hero for Underdogs - Amir Tabakovic
From Zero to ML Hero for Underdogs  - Amir TabakovicFrom Zero to ML Hero for Underdogs  - Amir Tabakovic
From Zero to ML Hero for Underdogs - Amir Tabakovic
 
Data and data scientists are not equal to money david hoyle
Data and data scientists are not equal to money   david hoyleData and data scientists are not equal to money   david hoyle
Data and data scientists are not equal to money david hoyle
 
When it's raining gold, bring a bucket - Andjela Culibrk
When it's raining gold, bring a bucket - Andjela CulibrkWhen it's raining gold, bring a bucket - Andjela Culibrk
When it's raining gold, bring a bucket - Andjela Culibrk
 
Reality and traps of real time data engineering - Milos Solujic
Reality and traps of real time data engineering - Milos SolujicReality and traps of real time data engineering - Milos Solujic
Reality and traps of real time data engineering - Milos Solujic
 
Sensor networks for personalized health monitoring - Vladimir Brusic
Sensor networks for personalized health monitoring - Vladimir BrusicSensor networks for personalized health monitoring - Vladimir Brusic
Sensor networks for personalized health monitoring - Vladimir Brusic
 
Improving Data Quality with Product Similarity Search
Improving Data Quality with Product Similarity SearchImproving Data Quality with Product Similarity Search
Improving Data Quality with Product Similarity Search
 
Prediction of good patterns for future sales using image recognition
Prediction of good patterns for future sales using image recognitionPrediction of good patterns for future sales using image recognition
Prediction of good patterns for future sales using image recognition
 
Using data to fight corruption: full budget transparency in local government
Using data to fight corruption: full budget transparency in local governmentUsing data to fight corruption: full budget transparency in local government
Using data to fight corruption: full budget transparency in local government
 
Geospatial Analysis and Open Data - Forest and Climate
Geospatial Analysis and Open Data - Forest and ClimateGeospatial Analysis and Open Data - Forest and Climate
Geospatial Analysis and Open Data - Forest and Climate
 
Machine Learning-Driven Injury Prediction for a Professional Sports Team
Machine Learning-Driven Injury Prediction for a Professional Sports TeamMachine Learning-Driven Injury Prediction for a Professional Sports Team
Machine Learning-Driven Injury Prediction for a Professional Sports Team
 

Recently uploaded

Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We...nirzagarg
 
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...nirzagarg
 
Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1ranjankumarbehera14
 
Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...
Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...
Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...HyderabadDolls
 
Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...gajnagarg
 
Top Call Girls in Balaghat 9332606886Call Girls Advance Cash On Delivery Ser...
Top Call Girls in Balaghat  9332606886Call Girls Advance Cash On Delivery Ser...Top Call Girls in Balaghat  9332606886Call Girls Advance Cash On Delivery Ser...
Top Call Girls in Balaghat 9332606886Call Girls Advance Cash On Delivery Ser...kumargunjan9515
 
Charbagh + Female Escorts Service in Lucknow | Starting ₹,5K To @25k with A/C...
Charbagh + Female Escorts Service in Lucknow | Starting ₹,5K To @25k with A/C...Charbagh + Female Escorts Service in Lucknow | Starting ₹,5K To @25k with A/C...
Charbagh + Female Escorts Service in Lucknow | Starting ₹,5K To @25k with A/C...HyderabadDolls
 
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...gajnagarg
 
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteedamy56318795
 
Sealdah % High Class Call Girls Kolkata - 450+ Call Girl Cash Payment 8005736...
Sealdah % High Class Call Girls Kolkata - 450+ Call Girl Cash Payment 8005736...Sealdah % High Class Call Girls Kolkata - 450+ Call Girl Cash Payment 8005736...
Sealdah % High Class Call Girls Kolkata - 450+ Call Girl Cash Payment 8005736...HyderabadDolls
 
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book nowVadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book nowgargpaaro
 
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...gajnagarg
 
Gartner's Data Analytics Maturity Model.pptx
Gartner's Data Analytics Maturity Model.pptxGartner's Data Analytics Maturity Model.pptx
Gartner's Data Analytics Maturity Model.pptxchadhar227
 
High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...
High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...
High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...kumargunjan9515
 
7. Epi of Chronic respiratory diseases.ppt
7. Epi of Chronic respiratory diseases.ppt7. Epi of Chronic respiratory diseases.ppt
7. Epi of Chronic respiratory diseases.pptibrahimabdi22
 
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...Elaine Werffeli
 
Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...
Reconciling Conflicting Data Curation Actions: Transparency Through Argument...Bertram Ludäscher
 
Aspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - AlmoraAspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - AlmoraGovindSinghDasila
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Valters Lauzums
 

Recently uploaded (20)

Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We...
 
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
 
Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1
 
Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...
Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...
Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...
 
Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...
 
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get CytotecAbortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get Cytotec
 
Top Call Girls in Balaghat 9332606886Call Girls Advance Cash On Delivery Ser...
Top Call Girls in Balaghat  9332606886Call Girls Advance Cash On Delivery Ser...Top Call Girls in Balaghat  9332606886Call Girls Advance Cash On Delivery Ser...
Top Call Girls in Balaghat 9332606886Call Girls Advance Cash On Delivery Ser...
 
Charbagh + Female Escorts Service in Lucknow | Starting ₹,5K To @25k with A/C...
Charbagh + Female Escorts Service in Lucknow | Starting ₹,5K To @25k with A/C...Charbagh + Female Escorts Service in Lucknow | Starting ₹,5K To @25k with A/C...
Charbagh + Female Escorts Service in Lucknow | Starting ₹,5K To @25k with A/C...
 
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
 
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
 
Sealdah % High Class Call Girls Kolkata - 450+ Call Girl Cash Payment 8005736...
Sealdah % High Class Call Girls Kolkata - 450+ Call Girl Cash Payment 8005736...Sealdah % High Class Call Girls Kolkata - 450+ Call Girl Cash Payment 8005736...
Sealdah % High Class Call Girls Kolkata - 450+ Call Girl Cash Payment 8005736...
 
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book nowVadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
 
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
 
Gartner's Data Analytics Maturity Model.pptx
Gartner's Data Analytics Maturity Model.pptxGartner's Data Analytics Maturity Model.pptx
Gartner's Data Analytics Maturity Model.pptx
 
High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...
High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...
High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...
 
7. Epi of Chronic respiratory diseases.ppt
7. Epi of Chronic respiratory diseases.ppt7. Epi of Chronic respiratory diseases.ppt
7. Epi of Chronic respiratory diseases.ppt
 
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
 
Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...
Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
 
Aspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - AlmoraAspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - Almora
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 

The price is right - Tomislav Krizan

  • 2. THE PRICE IS RIGHT USING MACHINE TO MAXIMIZE COMPANY PROFIT
  • 3. Agenda • About me!? • Dynamic Deal Scoring • How do we do it? • Project outcome… • Q&A
  • 4. Am I relevant ? 198 4
  • 5. Dynamic Deal Scoring (a.k.a. The Price is Right)
  • 6. Motivation • For every product, we should be able to find the optimal price that a customer is willing to pay • We would factor in highly specific insights that would influence the price • Customer has ~750k of custom products – manual practices for setting prices make it virtually impossible to see the pricing patterns • Dynamic deal scoring integrated into the core commercial process will help organization to price smarter, streamline the approval process, and win more deals
  • 7. Fact finding mission • Sales reps often argue that higher discounts are necessary to win deals • FALSE - research across companies consistently shows the opposite to be true: successful deals almost always have lower average discounts than deals that were lost • A pricing infrastructure can be difficult and costly to create • TRUE - It requires investing appropriately, empowering the right people, articulating clear targets and goals, and managing risk, but….
  • 8. Dynamic Deal Scoring • is certainly not new, having been pioneered by airlines in the ‘70s and now widely used by hotels, airlines, and car rental and tour operators • it’s not only being used in online environments. Traditional bricks and mortar companies are also revolutionizing how they monetize, finding new ways to tap into customers’ willingness to pay • can be located within a broader move towards customization and personalization with the emergence of data
  • 9. Dynamic Deal Scoring • On average, a 1% price increase translates into an 8.7% increase in operating profits (assuming no loss of volume, of course) • 30% of all pricing decisions companies make every year fail to deliver the best price!!! – a lot of lost revenue • CAUTION! Dynamic Deal Scoring when used blindly or in isolation , i.e. without human oversight and a clear strategy, can at worst destroy reputation and erode consumer trust
  • 10. How do we do it?
  • 12. Hard work and long nights … • Hypotheses • Apply experiments • Read measurement • Deduce next steps • We used CRISP methodology
  • 13. Six steps to build the model Data prepStep ▪ A piece of R code takes the invoice data and: – Filters out data that should not be considered in the model – Creates synthetic variables based upon the existing data – Combines invoices into deals (there are multiple invoices associated with each deal) ▪ A piece of R code calculates the margin cutoffs for A, B, C, D, and F deals within each node ▪ An tool shows the distribution of grades across various dimensions including Industry, and Product Group. Where there exists a strong skew towards A grades or F grades, the tool will be used to adjust margin cutoffs to reduce the uneven distribution ▪ The DW team provides invoice data with margins adjusted to match the P&L and additional variables mapped in from sources outside the ERP ▪ The DDS model embedded within SalesForce Detail Input data DDS tree building Scoring Adjustments Output to tool 1 2 3 4 5 6 ▪ Building the tree involves two sub- steps: – Choosing appropriate variables based on business logic and predictive power – Using the regular method to grow the tree within the bounds of best practices. All deals will be sorted into nodes of similar business characteristics and margin 3a 3b
  • 14.
  • 15.
  • 16. Data prep Data prep flow This flow filters data, applies sales adjustments, and applies cost adjustments X Sales adjustments Cost adjustments X X Filters Combined invoice file = Sales + cost file by invoice The output is a file with the sales and cost for each invoice line. This file is mapped into the R data prep code
  • 17. Data prep Synthetic variables ▪ Top Customer: This variables has 7 values; the 6 largest customers and “other” ▪ Annual customer spend: The spend for the top customer for 2018 ▪ Product Super Group: Assigned based on product group ▪ No of items in platform: sums up number of unique items within a platform ▪ Deal size: Sum of invoice sales for that deal (as defined below) ▪ Spend per customer per item: % of a customer’s annual sales represented by that item ▪ Platform: binary yes/no; is that item part of a platform ▪ Make vs Buy: binary make/buy ▪ No items in quote: “Quote” is same Sales Rep, same Customer, same Order Date Filters ▪ Intercompany sales ▪ Tooling and engineering charges ▪ Returns ▪ Invoices with sales > $10M or < -$10M ▪ Deals with margin > 100% or < 0% ▪ MOV/MOQ’s Combining invoices into deals ▪ Deals are defined as the same customer, same item, same invoiced price; all invoices fitting this criteria are combined
  • 18. DDS tree building Choosing Variables DDS Tree 3a 3b ▪ Before running the tree code, it is necessary to select final list of variables to be used in tree ▪ The selection criteria should be a combination of the relative predictive power and the business logic of the variables ▪ The tree should not branch on something that shouldn't be prescriptive, even though it is descriptive of today’s behavior (e.g., month of year) ▪ The variable should be capturable as an input during quotation process ▪ With the list of variables finalized, manually select the branches of the first two or three levels of the tree ▪ The remaining levels can be built automatically (allow the code to select the most logical branching), but throughout the process, apply best practices to guide and adjust the tree ▪ The “N” of terminal nodes should be no less than 50 and the P-value of each branch should be below 0.05 ▪ Best practice is for the R-square of the tree as a whole to be greater than 30%.
  • 19. Validate against Best Practice  Proposed modelBest practice 4220+ 175-10+ 31%130%+ Number of deal parameters analyzed Number of deal parameters found predictive and used for deal scoring Predictive power of the scoring algorithm (R2) Price realization uplift expected 2-3%2-7%1
  • 21.
  • 23. Project outcome… • Project engagement: 8 weeks over 3 month period • Project cost: 90% of cost was pure R’n’R – traveling and accommodation cost due client world wide presence • 3 for 3 : project was fully paid of by correct and timely pricing within 3 months of use in production and measured above product price baseline • now in Revenue share mode 