SlideShare una empresa de Scribd logo
1 de 27
Descargar para leer sin conexión
Orly Amrany
General Manager, Wix
When the question ‘why?’ is not relevant
The Unexpected Facts of Life
Hi,
I’m Orly Amrany
General Manager, Head of Premium Services @ Wix
Question #01
• Assume you have 3 Million Subscription (Monthly/Yearly)
• Each recurring charge is done on it’s purchase date
• Re-try upon failure is done every 7 days
• Success rate of recurring charge is ~90%
• Which day do we have the best changes to charge ?
24th or 25th?
85.25%
81.94%
84.14%
79.80%
82.79%
85.67%
85.13%
83.24%
81.59%
86.80%
83.55%
85.48%
86.49%
86.96%
79.00%
80.00%
81.00%
82.00%
83.00%
84.00%
85.00%
86.00%
87.00%
AU BR CA ES FR GB US
24th Vs. 25th, initial recurring
85.25%
81.94%
84.14%
79.80%
82.79%
85.67%
85.13%
83.24%
81.59%
86.80%
83.55%
85.48%
86.49%
86.96%
79.00%
80.00%
81.00%
82.00%
83.00%
84.00%
85.00%
86.00%
87.00%
AU BR CA ES FR GB US
24th Vs. 25th, initial recurring
+0.5%increase in approval rate
85.25%
81.94%
84.14%
79.80%
82.79%
85.67%
85.13%
83.24%
81.59%
86.80%
83.55%
85.48%
86.49%
86.96%
79.00%
80.00%
81.00%
82.00%
83.00%
84.00%
85.00%
86.00%
87.00%
AU BR CA ES FR GB US
24th Vs. 25th, initial recurring
+0.5%increase in approval rate
+15ksaved subscriptions
85.25%
81.94%
84.14%
79.80%
82.79%
85.67%
85.13%
83.24%
81.59%
86.80%
83.55%
85.48%
86.49%
86.96%
79.00%
80.00%
81.00%
82.00%
83.00%
84.00%
85.00%
86.00%
87.00%
AU BR CA ES FR GB US
24th Vs. 25th, initial recurring
+0.5%increase in approval rate
+15ksaved subscriptions
+1.5M
And the winner is…
The 24th!
You’ve won 1,500,000
million dollars
Question: Why checking
the 24th vs. 25th?
Question: Why checking
the 24th vs. 25th?
Answer: Because we could
• We had data of million of transactions
• We actually checked all days of the month
• A lot of other assumptions failed..(15th Vs 16th)
• Should we AB test? (NO)
On the 24th there is more changes for charges to succeed
We gained +1.5M USD with a simple change!
When you have tones of data, you can find out a lot of interesting
and unexpected facts
You should do it as soon as possible: Time is money
Make all recurring charges on the 24th ? (NO) Improve re-try logic (Which Tool)
So what did we learn?
So what did we learn?
Don’t ask yourself
‘why?’
Ask yourself
‘why didn’t I check this before?’
Some more fun examples
Question #02
• Same data
• Which day do we have the best changes to charge?
Weekdays or
weekends?
And the winner is…
Weekday!
4.41%
-1.85%
6.36%
2.42%
5.38%
8.00%
-0.59%
1.18%
5.67%
-4.84%
6.39%
0.45%
2.97%
5.94%
-6.67%
0.10%
-0.62%
5.21%
7.62%
1.50%
2.59%
3.22%
-5.88%
3.41%
0.66%
11.80%
6.81%
-0.35%
8.05%
7.64%
2.39%
-10.00%
-5.00%
0.00%
5.00%
10.00%
15.00%
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
Approval rate difference - weekdays vs. weekends
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
4.41%
-1.85%
6.36%
2.42%
5.38%
8.00%
-0.59%
1.18%
5.67%
-4.84%
6.39%
0.45%
2.97%
5.94%
-6.67%
0.10%
-0.62%
5.21%
7.62%
1.50%
2.59%
3.22%
-5.88%
3.41%
0.66%
11.80%
6.81%
-0.35%
8.05%
7.64%
2.39%
-10.00%
-5.00%
0.00%
5.00%
10.00%
15.00%
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
Approval rate difference - weekdays vs. weekends
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
+1.3%increase in approval rate
• Same data
• Which hour of the day would be the best? (in Brazil for example)
Time or Day?
And the answer is…
8am – 10pm
20.00%
25.00%
30.00%
35.00%
40.00%
45.00%
50.00%
55.00%
60.00%
65.00%
70.00%
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Approval Time, Recurring/UTC time
all
Thanks

Más contenido relacionado

La actualidad más candente

Women in Engineering 2013
Women in Engineering 2013Women in Engineering 2013
Women in Engineering 2013
Weber Shandwick Scotland
 
Tugas tip(rekapitulasi nilai)
Tugas tip(rekapitulasi nilai)Tugas tip(rekapitulasi nilai)
Tugas tip(rekapitulasi nilai)
Go Bernadus
 
Comparative statistics of the 2nd questionaire
Comparative statistics of the 2nd questionaireComparative statistics of the 2nd questionaire
Comparative statistics of the 2nd questionaire
Haris Evaggelou
 
Statistics 2 nd questionnaire 1st time
Statistics 2 nd questionnaire 1st timeStatistics 2 nd questionnaire 1st time
Statistics 2 nd questionnaire 1st time
Haris Evaggelou
 

La actualidad más candente (11)

Results of the questionnaire 1
Results of the questionnaire 1Results of the questionnaire 1
Results of the questionnaire 1
 
Women in Engineering 2013
Women in Engineering 2013Women in Engineering 2013
Women in Engineering 2013
 
ITAM US 2017 ITAM Review 2017 Salary Survey
ITAM US 2017 ITAM Review 2017 Salary SurveyITAM US 2017 ITAM Review 2017 Salary Survey
ITAM US 2017 ITAM Review 2017 Salary Survey
 
Tugas tip(rekapitulasi nilai)
Tugas tip(rekapitulasi nilai)Tugas tip(rekapitulasi nilai)
Tugas tip(rekapitulasi nilai)
 
Statistics 2 nd questionnaire
Statistics 2 nd questionnaireStatistics 2 nd questionnaire
Statistics 2 nd questionnaire
 
NormShield Supply Chain Risk Management Infographic
NormShield Supply Chain Risk Management InfographicNormShield Supply Chain Risk Management Infographic
NormShield Supply Chain Risk Management Infographic
 
Measures of Success - Webinar
Measures of Success - WebinarMeasures of Success - Webinar
Measures of Success - Webinar
 
Comparative statistics of the 2nd questionaire
Comparative statistics of the 2nd questionaireComparative statistics of the 2nd questionaire
Comparative statistics of the 2nd questionaire
 
Statistics 2 nd questionnaire 1st time
Statistics 2 nd questionnaire 1st timeStatistics 2 nd questionnaire 1st time
Statistics 2 nd questionnaire 1st time
 
STATISTICAL ANALYSIS- 1st QUESTIONNAIRE
STATISTICAL ANALYSIS- 1st QUESTIONNAIRESTATISTICAL ANALYSIS- 1st QUESTIONNAIRE
STATISTICAL ANALYSIS- 1st QUESTIONNAIRE
 
NPS
NPS NPS
NPS
 

Similar a Unexpected facts of life by Orly Amrany last - Nov 2015

Washington D.C. Internship portfolio, work samples
Washington D.C. Internship portfolio, work samplesWashington D.C. Internship portfolio, work samples
Washington D.C. Internship portfolio, work samples
Satu Hermunen
 
C3 comp redesign 6-3-13 (2)
C3 comp redesign  6-3-13 (2)C3 comp redesign  6-3-13 (2)
C3 comp redesign 6-3-13 (2)
Mark Wolkove
 

Similar a Unexpected facts of life by Orly Amrany last - Nov 2015 (20)

Steve Zeigler & Jersey Mike\'s Subs
Steve Zeigler & Jersey Mike\'s SubsSteve Zeigler & Jersey Mike\'s Subs
Steve Zeigler & Jersey Mike\'s Subs
 
Holiday Feature Competitive Benchmarking
Holiday Feature Competitive BenchmarkingHoliday Feature Competitive Benchmarking
Holiday Feature Competitive Benchmarking
 
Washington D.C. Internship portfolio, work samples
Washington D.C. Internship portfolio, work samplesWashington D.C. Internship portfolio, work samples
Washington D.C. Internship portfolio, work samples
 
Using E-Marketing Metrics To Your Advantage - Emsa 2009
Using E-Marketing Metrics To Your Advantage - Emsa 2009Using E-Marketing Metrics To Your Advantage - Emsa 2009
Using E-Marketing Metrics To Your Advantage - Emsa 2009
 
June Meeting
June MeetingJune Meeting
June Meeting
 
General survey report for general audience
General survey report for general audienceGeneral survey report for general audience
General survey report for general audience
 
C3 comp redesign 6-3-13 (2)
C3 comp redesign  6-3-13 (2)C3 comp redesign  6-3-13 (2)
C3 comp redesign 6-3-13 (2)
 
RQ Retail Management: Taking Numbers from Good to Great
RQ Retail Management: Taking Numbers from Good to GreatRQ Retail Management: Taking Numbers from Good to Great
RQ Retail Management: Taking Numbers from Good to Great
 
Fitbit Go-To Market Plan
Fitbit Go-To Market PlanFitbit Go-To Market Plan
Fitbit Go-To Market Plan
 
Malcolm Gunn - Capacity management a journey from the unknown v5 (2)
Malcolm Gunn - Capacity management a journey from the unknown v5 (2)Malcolm Gunn - Capacity management a journey from the unknown v5 (2)
Malcolm Gunn - Capacity management a journey from the unknown v5 (2)
 
What is the best way to measure progress on an Agile project?
What is the best way to measure progress on an Agile project?What is the best way to measure progress on an Agile project?
What is the best way to measure progress on an Agile project?
 
Friendly and Fresh
Friendly and FreshFriendly and Fresh
Friendly and Fresh
 
LSC Digital Prospecting
LSC Digital ProspectingLSC Digital Prospecting
LSC Digital Prospecting
 
RR - Technicals 1.pdf
RR - Technicals 1.pdfRR - Technicals 1.pdf
RR - Technicals 1.pdf
 
Fractions decimals percents
Fractions decimals percentsFractions decimals percents
Fractions decimals percents
 
Digiral Store Assistant
Digiral Store AssistantDigiral Store Assistant
Digiral Store Assistant
 
Robin Hanson PM Summit SFO 2009
Robin Hanson PM Summit SFO 2009Robin Hanson PM Summit SFO 2009
Robin Hanson PM Summit SFO 2009
 
Work_Sample
Work_SampleWork_Sample
Work_Sample
 
Silver Spenders: How to advertise to over 50s from PPC Hero's #HeroConf London
Silver Spenders: How to advertise to over 50s from PPC Hero's #HeroConf LondonSilver Spenders: How to advertise to over 50s from PPC Hero's #HeroConf London
Silver Spenders: How to advertise to over 50s from PPC Hero's #HeroConf London
 
Pricing strategies 2017 nz
Pricing strategies 2017 nzPricing strategies 2017 nz
Pricing strategies 2017 nz
 

Último

Al Mizhar Dubai Escorts +971561403006 Escorts Service In Al Mizhar
Al Mizhar Dubai Escorts +971561403006 Escorts Service In Al MizharAl Mizhar Dubai Escorts +971561403006 Escorts Service In Al Mizhar
Al Mizhar Dubai Escorts +971561403006 Escorts Service In Al Mizhar
allensay1
 
Call Girls Kengeri Satellite Town Just Call 👗 7737669865 👗 Top Class Call Gir...
Call Girls Kengeri Satellite Town Just Call 👗 7737669865 👗 Top Class Call Gir...Call Girls Kengeri Satellite Town Just Call 👗 7737669865 👗 Top Class Call Gir...
Call Girls Kengeri Satellite Town Just Call 👗 7737669865 👗 Top Class Call Gir...
amitlee9823
 
Call Now ☎️🔝 9332606886🔝 Call Girls ❤ Service In Bhilwara Female Escorts Serv...
Call Now ☎️🔝 9332606886🔝 Call Girls ❤ Service In Bhilwara Female Escorts Serv...Call Now ☎️🔝 9332606886🔝 Call Girls ❤ Service In Bhilwara Female Escorts Serv...
Call Now ☎️🔝 9332606886🔝 Call Girls ❤ Service In Bhilwara Female Escorts Serv...
Anamikakaur10
 
Call Girls in Delhi, Escort Service Available 24x7 in Delhi 959961-/-3876
Call Girls in Delhi, Escort Service Available 24x7 in Delhi 959961-/-3876Call Girls in Delhi, Escort Service Available 24x7 in Delhi 959961-/-3876
Call Girls in Delhi, Escort Service Available 24x7 in Delhi 959961-/-3876
dlhescort
 
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service BangaloreCall Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
amitlee9823
 
Russian Call Girls In Rajiv Chowk Gurgaon ❤️8448577510 ⊹Best Escorts Service ...
Russian Call Girls In Rajiv Chowk Gurgaon ❤️8448577510 ⊹Best Escorts Service ...Russian Call Girls In Rajiv Chowk Gurgaon ❤️8448577510 ⊹Best Escorts Service ...
Russian Call Girls In Rajiv Chowk Gurgaon ❤️8448577510 ⊹Best Escorts Service ...
lizamodels9
 
Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...
Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...
Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...
daisycvs
 
FULL ENJOY Call Girls In Majnu Ka Tilla, Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Majnu Ka Tilla, Delhi Contact Us 8377877756FULL ENJOY Call Girls In Majnu Ka Tilla, Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Majnu Ka Tilla, Delhi Contact Us 8377877756
dollysharma2066
 
Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...
Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...
Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...
lizamodels9
 

Último (20)

Cracking the Cultural Competence Code.pptx
Cracking the Cultural Competence Code.pptxCracking the Cultural Competence Code.pptx
Cracking the Cultural Competence Code.pptx
 
Al Mizhar Dubai Escorts +971561403006 Escorts Service In Al Mizhar
Al Mizhar Dubai Escorts +971561403006 Escorts Service In Al MizharAl Mizhar Dubai Escorts +971561403006 Escorts Service In Al Mizhar
Al Mizhar Dubai Escorts +971561403006 Escorts Service In Al Mizhar
 
Call Girls Kengeri Satellite Town Just Call 👗 7737669865 👗 Top Class Call Gir...
Call Girls Kengeri Satellite Town Just Call 👗 7737669865 👗 Top Class Call Gir...Call Girls Kengeri Satellite Town Just Call 👗 7737669865 👗 Top Class Call Gir...
Call Girls Kengeri Satellite Town Just Call 👗 7737669865 👗 Top Class Call Gir...
 
Call Now ☎️🔝 9332606886🔝 Call Girls ❤ Service In Bhilwara Female Escorts Serv...
Call Now ☎️🔝 9332606886🔝 Call Girls ❤ Service In Bhilwara Female Escorts Serv...Call Now ☎️🔝 9332606886🔝 Call Girls ❤ Service In Bhilwara Female Escorts Serv...
Call Now ☎️🔝 9332606886🔝 Call Girls ❤ Service In Bhilwara Female Escorts Serv...
 
Call Girls in Delhi, Escort Service Available 24x7 in Delhi 959961-/-3876
Call Girls in Delhi, Escort Service Available 24x7 in Delhi 959961-/-3876Call Girls in Delhi, Escort Service Available 24x7 in Delhi 959961-/-3876
Call Girls in Delhi, Escort Service Available 24x7 in Delhi 959961-/-3876
 
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service BangaloreCall Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
 
(Anamika) VIP Call Girls Napur Call Now 8617697112 Napur Escorts 24x7
(Anamika) VIP Call Girls Napur Call Now 8617697112 Napur Escorts 24x7(Anamika) VIP Call Girls Napur Call Now 8617697112 Napur Escorts 24x7
(Anamika) VIP Call Girls Napur Call Now 8617697112 Napur Escorts 24x7
 
Call Girls Service In Old Town Dubai ((0551707352)) Old Town Dubai Call Girl ...
Call Girls Service In Old Town Dubai ((0551707352)) Old Town Dubai Call Girl ...Call Girls Service In Old Town Dubai ((0551707352)) Old Town Dubai Call Girl ...
Call Girls Service In Old Town Dubai ((0551707352)) Old Town Dubai Call Girl ...
 
The Path to Product Excellence: Avoiding Common Pitfalls and Enhancing Commun...
The Path to Product Excellence: Avoiding Common Pitfalls and Enhancing Commun...The Path to Product Excellence: Avoiding Common Pitfalls and Enhancing Commun...
The Path to Product Excellence: Avoiding Common Pitfalls and Enhancing Commun...
 
PHX May 2024 Corporate Presentation Final
PHX May 2024 Corporate Presentation FinalPHX May 2024 Corporate Presentation Final
PHX May 2024 Corporate Presentation Final
 
👉Chandigarh Call Girls 👉9878799926👉Just Call👉Chandigarh Call Girl In Chandiga...
👉Chandigarh Call Girls 👉9878799926👉Just Call👉Chandigarh Call Girl In Chandiga...👉Chandigarh Call Girls 👉9878799926👉Just Call👉Chandigarh Call Girl In Chandiga...
👉Chandigarh Call Girls 👉9878799926👉Just Call👉Chandigarh Call Girl In Chandiga...
 
SEO Case Study: How I Increased SEO Traffic & Ranking by 50-60% in 6 Months
SEO Case Study: How I Increased SEO Traffic & Ranking by 50-60%  in 6 MonthsSEO Case Study: How I Increased SEO Traffic & Ranking by 50-60%  in 6 Months
SEO Case Study: How I Increased SEO Traffic & Ranking by 50-60% in 6 Months
 
Eluru Call Girls Service ☎ ️93326-06886 ❤️‍🔥 Enjoy 24/7 Escort Service
Eluru Call Girls Service ☎ ️93326-06886 ❤️‍🔥 Enjoy 24/7 Escort ServiceEluru Call Girls Service ☎ ️93326-06886 ❤️‍🔥 Enjoy 24/7 Escort Service
Eluru Call Girls Service ☎ ️93326-06886 ❤️‍🔥 Enjoy 24/7 Escort Service
 
Russian Call Girls In Rajiv Chowk Gurgaon ❤️8448577510 ⊹Best Escorts Service ...
Russian Call Girls In Rajiv Chowk Gurgaon ❤️8448577510 ⊹Best Escorts Service ...Russian Call Girls In Rajiv Chowk Gurgaon ❤️8448577510 ⊹Best Escorts Service ...
Russian Call Girls In Rajiv Chowk Gurgaon ❤️8448577510 ⊹Best Escorts Service ...
 
Lundin Gold - Q1 2024 Conference Call Presentation (Revised)
Lundin Gold - Q1 2024 Conference Call Presentation (Revised)Lundin Gold - Q1 2024 Conference Call Presentation (Revised)
Lundin Gold - Q1 2024 Conference Call Presentation (Revised)
 
Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...
Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...
Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...
 
FULL ENJOY Call Girls In Majnu Ka Tilla, Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Majnu Ka Tilla, Delhi Contact Us 8377877756FULL ENJOY Call Girls In Majnu Ka Tilla, Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Majnu Ka Tilla, Delhi Contact Us 8377877756
 
Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...
Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...
Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...
 
Value Proposition canvas- Customer needs and pains
Value Proposition canvas- Customer needs and painsValue Proposition canvas- Customer needs and pains
Value Proposition canvas- Customer needs and pains
 
Organizational Transformation Lead with Culture
Organizational Transformation Lead with CultureOrganizational Transformation Lead with Culture
Organizational Transformation Lead with Culture
 

Unexpected facts of life by Orly Amrany last - Nov 2015