SlideShare una empresa de Scribd logo
1 de 29
Descargar para leer sin conexión
Using data to drive
product decisions
Arpit Dhariwal
Product Manager, SlideShare-LinkedIn
Intuition-driven Data-driven
Make best-guesses
Rely on previous experiences
Study what others are doing
Use best practices, principles and patterns
Might use data for trend-watching
Don’t have time to test details
Aesthetics are integral
Rely on our gut
Creative, visionary
Every choice is tested
Takes others experience with a grain of salt
Everything is a logic problem
Rely on data for decision-making
Aesthetics are secondary
No detail is too small to test
Never trust your gut
Cold, calculating
* From Joshua Porter’s “Metrics-Driven Design” presentation at UX London
Decision Spectrum Applies to all - product, design or business
* From Joshua Porter’s “Metrics-Driven Design” presentation at UX London
Notoriously data-driven?Data-driven
Some of our competitors have great aestheticsIntution-driven
Intuition-driven Data-driven
Create a balance We at SlideShare try to balance data and intuition
Balance helps Even without a great visual design, users still prefer us to other platforms
Here’s how
we used data (and some intuition)
to increase uploads on SlideShare
Uploads Flow
1 Newsfeed 2 Uploads Page
3 File Selector opens4 File is published
Reduce number of steps in the upload
flow to improve conversion
Remeber our Goal Increase number of Uploads
Proposed Uploads Flow
2 File Selector opens3 File is published
Project “Quick Upload”
1 Newsfeed
Conversion Funnel
Upload CTA clicks in
top nav
Reach Upload page and
click on CTA
Select File File Published
Existing Uploads Flow
100% 63% 52% 45%
Conversion Funnel Test the results
Upload CTA clicks in
top nav
Reach Upload page and
click on CTA
Select File File Published
Existing Uploads Flow
100% 63% 52% 45%
Upload CTA clicks in
top nav
Select File File Published
Project Quick Upload
100% 49% 37%
Give context to users, that’ll prompt
them to upload
(essentially adding one more step)
#2
Project Quick Upload
2 Modal Upload Window
3 File Selector opens4 File is published
Iteration #2
1 Newsfeed
Conversion Funnel
Upload CTA clicks in
top nav
Reach Upload page and
click on CTA
Select File File Published
Existing Uploads Flow
100% 63% 52% 45%
Conversion Funnel Test the results
Upload CTA clicks in
top nav
Reach Upload page and
click on CTA
Select File File Published
Existing Uploads Flow
100% 63% 52% 45%
Upload CTA clicks in
top nav
Select File File Published
Project Quick Upload with modal
upload window
100% 52% 46%
Upload CTA clicks on
the modal
62%
We wanted more uploads,
and not create a new flow that gave par results
Project Quick Upload Iteration #3
Introduced a panel which had the Quick Upload CTA along with the context
Project Quick Upload Iteration #3
Introduced a panel which had the Quick Upload CTA along with the context
Conversion Funnel Test the results
Upload CTA clicks in
top nav
Reach Upload page and
click on CTA
Select File File Published
Existing Uploads Flow
100% 63% 52% 45%
Select File File Published
Project Quick Upload with new upload panel
59% 51%
Upload CTA clicks on
the panel
100%
+ Additional upload because of
two upload buttons
Conversion Funnel Test the results
Upload CTA clicks in
top nav
Reach Upload page and
click on CTA
Select File File Published
Existing Uploads Flow
100% 63% 52% 45%
Select File File Published
Project Quick Upload with new upload panel
59% 51%
Upload CTA clicks on
the panel
100%
+ Additional upload because of
two upload buttons
Not the best visual design in the world
But we are not complaining, we have increased uploads by a significant number!
“Radical innovation requires both evidence and intuition:
evidence to become informed, and intuition to inspire us in
imagining and creating new and better possibilities.”
Jane Fulton Suri, IDEO
Cheat-sheet for data
awesomeness
Define actionable metrics
1Before starting any test/project, state metrics that you want to
impact. Keep a track of those metrics throughout the project
Socialize data
2Make sure your entire team has access and goes through
key metrics
Iterate, iterate and iterate
3Keep iterating over your baseline design by focusing on
actionable metrics
Avoid the local maxima problem
4Don’t get caught up in over optimization
Data Ergonomics
5Ensure easy consumption of data for everyone
That’s all folks!

Más contenido relacionado

La actualidad más candente

Gil Irizarry, Constant Contact presentation from MassTLC seminar on taking yo...
Gil Irizarry, Constant Contact presentation from MassTLC seminar on taking yo...Gil Irizarry, Constant Contact presentation from MassTLC seminar on taking yo...
Gil Irizarry, Constant Contact presentation from MassTLC seminar on taking yo...
MassTLC
 
LeanCx: Commissioning for Performance, Productivity and Profit
LeanCx: Commissioning for Performance, Productivity and ProfitLeanCx: Commissioning for Performance, Productivity and Profit
LeanCx: Commissioning for Performance, Productivity and Profit
Murray Guy
 

La actualidad más candente (20)

The Devops Handbook
The Devops HandbookThe Devops Handbook
The Devops Handbook
 
Shift Left Testing: Going Beyond Agile
Shift Left Testing: Going Beyond AgileShift Left Testing: Going Beyond Agile
Shift Left Testing: Going Beyond Agile
 
Effective Agile Metrics, Cuneyt Gul
Effective Agile Metrics, Cuneyt GulEffective Agile Metrics, Cuneyt Gul
Effective Agile Metrics, Cuneyt Gul
 
Metrics - You are what you measure (DevOps Perth)
Metrics - You are what you measure (DevOps Perth)Metrics - You are what you measure (DevOps Perth)
Metrics - You are what you measure (DevOps Perth)
 
Nf final chef-lisa-metrics-2015-ss
Nf final chef-lisa-metrics-2015-ssNf final chef-lisa-metrics-2015-ss
Nf final chef-lisa-metrics-2015-ss
 
DevOps Tactical Adoption Theory - DevOpsDays istanbul 2016
DevOps Tactical Adoption Theory  - DevOpsDays istanbul 2016DevOps Tactical Adoption Theory  - DevOpsDays istanbul 2016
DevOps Tactical Adoption Theory - DevOpsDays istanbul 2016
 
Lean Software Development Is for Everyone
Lean Software Development Is for EveryoneLean Software Development Is for Everyone
Lean Software Development Is for Everyone
 
Gil Irizarry, Constant Contact presentation from MassTLC seminar on taking yo...
Gil Irizarry, Constant Contact presentation from MassTLC seminar on taking yo...Gil Irizarry, Constant Contact presentation from MassTLC seminar on taking yo...
Gil Irizarry, Constant Contact presentation from MassTLC seminar on taking yo...
 
Agile + Benefits + Transition Nov 2009
Agile + Benefits + Transition   Nov 2009Agile + Benefits + Transition   Nov 2009
Agile + Benefits + Transition Nov 2009
 
LeanCx: Commissioning for Performance, Productivity and Profit
LeanCx: Commissioning for Performance, Productivity and ProfitLeanCx: Commissioning for Performance, Productivity and Profit
LeanCx: Commissioning for Performance, Productivity and Profit
 
Key Findings from the 2017 State of DevOps Report 06.08.2017
Key Findings from the 2017 State of DevOps Report 06.08.2017Key Findings from the 2017 State of DevOps Report 06.08.2017
Key Findings from the 2017 State of DevOps Report 06.08.2017
 
DevOpsGuys - How to get started with DevOps - Redgate Webinar April 2017
DevOpsGuys - How to get started with DevOps - Redgate Webinar April 2017DevOpsGuys - How to get started with DevOps - Redgate Webinar April 2017
DevOpsGuys - How to get started with DevOps - Redgate Webinar April 2017
 
Agile Transformation: People, Process and Tools to Make Your Transformation S...
Agile Transformation: People, Process and Tools to Make Your Transformation S...Agile Transformation: People, Process and Tools to Make Your Transformation S...
Agile Transformation: People, Process and Tools to Make Your Transformation S...
 
Testing in a DevOps team
Testing in a DevOps teamTesting in a DevOps team
Testing in a DevOps team
 
Dev ops
Dev opsDev ops
Dev ops
 
How to choose tools for DevOps and Continuous Delivery - Unicom DevOps Summit...
How to choose tools for DevOps and Continuous Delivery - Unicom DevOps Summit...How to choose tools for DevOps and Continuous Delivery - Unicom DevOps Summit...
How to choose tools for DevOps and Continuous Delivery - Unicom DevOps Summit...
 
Agile and Web Development
Agile and Web DevelopmentAgile and Web Development
Agile and Web Development
 
Devops1
Devops1Devops1
Devops1
 
Continuous Delivery: Making DevOps Awesome
Continuous Delivery: Making DevOps AwesomeContinuous Delivery: Making DevOps Awesome
Continuous Delivery: Making DevOps Awesome
 
CESAR.thon: a Testing Marathon Framework
CESAR.thon: a Testing Marathon FrameworkCESAR.thon: a Testing Marathon Framework
CESAR.thon: a Testing Marathon Framework
 

Similar a Using data to drive product decision

Building Better Collaboration Between Development and Testing in a DevOps World
Building Better Collaboration Between Development and Testing in a DevOps WorldBuilding Better Collaboration Between Development and Testing in a DevOps World
Building Better Collaboration Between Development and Testing in a DevOps World
QASymphony
 

Similar a Using data to drive product decision (20)

Agile Methods: Fact or Fiction
Agile Methods: Fact or FictionAgile Methods: Fact or Fiction
Agile Methods: Fact or Fiction
 
Strategic Business Process
Strategic Business ProcessStrategic Business Process
Strategic Business Process
 
Next Gen Continuous Delivery: Connecting Business Initiatives to the IT Roadmap
Next Gen Continuous Delivery: Connecting Business Initiatives to the IT RoadmapNext Gen Continuous Delivery: Connecting Business Initiatives to the IT Roadmap
Next Gen Continuous Delivery: Connecting Business Initiatives to the IT Roadmap
 
Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive Experimentation
 
Why Agile? Why Now? IPMA Forum 2009
Why Agile? Why Now?   IPMA Forum 2009Why Agile? Why Now?   IPMA Forum 2009
Why Agile? Why Now? IPMA Forum 2009
 
How to use your data science team: Becoming a data-driven organization
How to use your data science team: Becoming a data-driven organizationHow to use your data science team: Becoming a data-driven organization
How to use your data science team: Becoming a data-driven organization
 
Accelerate - Book Review
Accelerate - Book ReviewAccelerate - Book Review
Accelerate - Book Review
 
Starting Your Modern DataOps Journey
Starting Your Modern DataOps JourneyStarting Your Modern DataOps Journey
Starting Your Modern DataOps Journey
 
Sprint with Agile, Deliver With DevOps
Sprint with Agile, Deliver With DevOpsSprint with Agile, Deliver With DevOps
Sprint with Agile, Deliver With DevOps
 
Building an Automated Database Deployment Pipeline
Building an Automated Database Deployment PipelineBuilding an Automated Database Deployment Pipeline
Building an Automated Database Deployment Pipeline
 
Test Automation using UiPath Test Suite - Developer Circle Part-1.pdf
Test Automation using UiPath Test Suite - Developer Circle Part-1.pdfTest Automation using UiPath Test Suite - Developer Circle Part-1.pdf
Test Automation using UiPath Test Suite - Developer Circle Part-1.pdf
 
Agile Executive Briefing - Situational Assessment + 50k Ft View
Agile Executive Briefing - Situational Assessment + 50k Ft ViewAgile Executive Briefing - Situational Assessment + 50k Ft View
Agile Executive Briefing - Situational Assessment + 50k Ft View
 
Building Better Collaboration Between Development and Testing in a DevOps World
Building Better Collaboration Between Development and Testing in a DevOps WorldBuilding Better Collaboration Between Development and Testing in a DevOps World
Building Better Collaboration Between Development and Testing in a DevOps World
 
An Engaging First Impression - Growth at Atlassian
An Engaging First Impression - Growth at AtlassianAn Engaging First Impression - Growth at Atlassian
An Engaging First Impression - Growth at Atlassian
 
6 Guidelines for A/B Testing
6 Guidelines for A/B Testing6 Guidelines for A/B Testing
6 Guidelines for A/B Testing
 
HPE ALM Octane | DevOps | Agile
HPE ALM Octane | DevOps | AgileHPE ALM Octane | DevOps | Agile
HPE ALM Octane | DevOps | Agile
 
[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So
[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So
[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So
 
Web Performance Analysis - TCF Pro 2009
Web Performance Analysis - TCF Pro 2009Web Performance Analysis - TCF Pro 2009
Web Performance Analysis - TCF Pro 2009
 
Building an automated database deployment pipeline
Building an automated database deployment pipelineBuilding an automated database deployment pipeline
Building an automated database deployment pipeline
 
Characterizing the Software Process: A Maturity Framework
Characterizing the Software Process:  A Maturity FrameworkCharacterizing the Software Process:  A Maturity Framework
Characterizing the Software Process: A Maturity Framework
 

Más de Arpit Dhariwal (7)

Product management 101
Product management 101Product management 101
Product management 101
 
How To Build The Future - Notes from Peter Thiel's Zero to One
How To Build The Future - Notes from Peter Thiel's Zero to OneHow To Build The Future - Notes from Peter Thiel's Zero to One
How To Build The Future - Notes from Peter Thiel's Zero to One
 
story of product demos
story of product demosstory of product demos
story of product demos
 
Content Marketing - NASSCOM Marketing Masterclass
Content Marketing - NASSCOM Marketing MasterclassContent Marketing - NASSCOM Marketing Masterclass
Content Marketing - NASSCOM Marketing Masterclass
 
10 Years Ago
10 Years Ago10 Years Ago
10 Years Ago
 
Things I Carry
Things I CarryThings I Carry
Things I Carry
 
Basics Of Online Advertising
Basics Of Online AdvertisingBasics Of Online Advertising
Basics Of Online Advertising
 

Último

Último (20)

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 

Using data to drive product decision

  • 1. Using data to drive product decisions Arpit Dhariwal Product Manager, SlideShare-LinkedIn
  • 2. Intuition-driven Data-driven Make best-guesses Rely on previous experiences Study what others are doing Use best practices, principles and patterns Might use data for trend-watching Don’t have time to test details Aesthetics are integral Rely on our gut Creative, visionary Every choice is tested Takes others experience with a grain of salt Everything is a logic problem Rely on data for decision-making Aesthetics are secondary No detail is too small to test Never trust your gut Cold, calculating * From Joshua Porter’s “Metrics-Driven Design” presentation at UX London Decision Spectrum Applies to all - product, design or business
  • 3. * From Joshua Porter’s “Metrics-Driven Design” presentation at UX London Notoriously data-driven?Data-driven
  • 4. Some of our competitors have great aestheticsIntution-driven
  • 5. Intuition-driven Data-driven Create a balance We at SlideShare try to balance data and intuition
  • 6. Balance helps Even without a great visual design, users still prefer us to other platforms
  • 7. Here’s how we used data (and some intuition) to increase uploads on SlideShare
  • 8. Uploads Flow 1 Newsfeed 2 Uploads Page 3 File Selector opens4 File is published
  • 9. Reduce number of steps in the upload flow to improve conversion Remeber our Goal Increase number of Uploads
  • 10. Proposed Uploads Flow 2 File Selector opens3 File is published Project “Quick Upload” 1 Newsfeed
  • 11. Conversion Funnel Upload CTA clicks in top nav Reach Upload page and click on CTA Select File File Published Existing Uploads Flow 100% 63% 52% 45%
  • 12. Conversion Funnel Test the results Upload CTA clicks in top nav Reach Upload page and click on CTA Select File File Published Existing Uploads Flow 100% 63% 52% 45% Upload CTA clicks in top nav Select File File Published Project Quick Upload 100% 49% 37%
  • 13. Give context to users, that’ll prompt them to upload (essentially adding one more step) #2
  • 14. Project Quick Upload 2 Modal Upload Window 3 File Selector opens4 File is published Iteration #2 1 Newsfeed
  • 15. Conversion Funnel Upload CTA clicks in top nav Reach Upload page and click on CTA Select File File Published Existing Uploads Flow 100% 63% 52% 45%
  • 16. Conversion Funnel Test the results Upload CTA clicks in top nav Reach Upload page and click on CTA Select File File Published Existing Uploads Flow 100% 63% 52% 45% Upload CTA clicks in top nav Select File File Published Project Quick Upload with modal upload window 100% 52% 46% Upload CTA clicks on the modal 62%
  • 17. We wanted more uploads, and not create a new flow that gave par results
  • 18. Project Quick Upload Iteration #3 Introduced a panel which had the Quick Upload CTA along with the context
  • 19. Project Quick Upload Iteration #3 Introduced a panel which had the Quick Upload CTA along with the context
  • 20. Conversion Funnel Test the results Upload CTA clicks in top nav Reach Upload page and click on CTA Select File File Published Existing Uploads Flow 100% 63% 52% 45% Select File File Published Project Quick Upload with new upload panel 59% 51% Upload CTA clicks on the panel 100% + Additional upload because of two upload buttons
  • 21. Conversion Funnel Test the results Upload CTA clicks in top nav Reach Upload page and click on CTA Select File File Published Existing Uploads Flow 100% 63% 52% 45% Select File File Published Project Quick Upload with new upload panel 59% 51% Upload CTA clicks on the panel 100% + Additional upload because of two upload buttons Not the best visual design in the world But we are not complaining, we have increased uploads by a significant number!
  • 22. “Radical innovation requires both evidence and intuition: evidence to become informed, and intuition to inspire us in imagining and creating new and better possibilities.” Jane Fulton Suri, IDEO
  • 24. Define actionable metrics 1Before starting any test/project, state metrics that you want to impact. Keep a track of those metrics throughout the project
  • 25. Socialize data 2Make sure your entire team has access and goes through key metrics
  • 26. Iterate, iterate and iterate 3Keep iterating over your baseline design by focusing on actionable metrics
  • 27. Avoid the local maxima problem 4Don’t get caught up in over optimization
  • 28. Data Ergonomics 5Ensure easy consumption of data for everyone