SlideShare una empresa de Scribd logo
1 de 24
Experiment Your Way Out of Beta!
 Or be stuck in a perpetual cycle of ignorance & low revenue




                                       Rick Perreault

                                       Co-Founder & CEO
                                       Unbounce.com

                                       Find me on twitter
                                       @rickperreault


                           Slide #1 of 24
What is an experiment?



   "scientific procedure undertaken to make a
 discovery, test a hypothesis, or demonstrate a
                   known fact."

Important because they test your assumptions &
           get you closer to the truth

Iʼm going to show you 3 types of experiments that
        you should use to get out of beta
How do I start an experiment?
How do I start an experiment?
                                I heard about
                                  you from...
      I would definitely
          pay if...                            I tell my
                                              friends...




                   I hate you
                   because...    I love you
                                 because...

 Customer feedback will give you insights & help
              ask good questions
How do I start an experiment?




 Surveys quick & easy way to get lots of customer
                    feedback
How do I start an experiment?


                 www.survey.io




            Step 1: fill out these 5 form fields
How do I start an experiment?


                     www.survey.io
                         How did you discover sample app?
             How would you feel if you could no longer use sample app?
What would you likely use as an alternative if sample app were no longer available?

-> What is the primary benefit that you have received from
                       sample app?
-> Have you recommended sample app to anyone? (If Yes,
           please explain how you describe it)
       What type of person do you think would benefit most from sample app?
            How can we improve sample app to better meet your needs?
Would it be okay if we followed up by email to request a clarification to one or more of
                                   your responses?


  Step 2: email these 8 questions your customers,
                        done!
Experiment Type #1
Experiment #1




     I love surveys! Not only for discovery, test
                 hypothesis as well
Experiment #1




                     My Hypothesis:

Customers that pay us the most & stay with us the longest
have a different product wish list than those who pay us the
              least (but make the most noise)

                     My Test Method:

   Survey our customers asking them to priorities feature
   request & segment to track responses by pricing tiers
Experiment #1




         Customers paying...

   $25 per          $125 + per
   month want       month want
   features A, B,   features F, G,
   C                H
Experiment #1



                  Action Item

 Use a survey to learn what your customers find
        most import (to get out of Beta)

If you have different customer types (Free, Paid,
              Paid Tiers), segment



I used
Experiment Type #2
Experiment #2




                     A/B Test
                         Version A (control)

                50%
                Traffic

100%
Traffic                               Version B (test group)


                            50%
                            Traffic




    Running two or more variations to determine
            which one converts better
Experiment #2

   Test ad copy, email (subject/body), website & landing pages elements,
                                  example:


                                   1. Value Proposition (your headline)
                                   2. Image/Video of product or context of use
                                   3. Core Benefits
                                   4. Request for data (form size)
                                   5. Call-to-action (CTA)
                                   6. Trust elements (Testimonials)
                                   7. Secondary CTAs (social sharing)




   Your conversion rate WILL improve if you test
Experiment #2


Version A (control)   (Variant - new headline)   (Variant - new headline + smaller page)




Conversion 10%
                      Conversion 14%
                                                 Conversion 17.5%
Experiment #2



                   Action Item

Use Survey.io question #4 & #5 results to develop
 new ways of describing your startup and test it
        against what you currently have.


                I used
Experiment Type #3
Experiment #3




                “Fake It” Test

                Developing features are
                expensive so you should test
                interest in the feature before
                you spend time developing it.
Experiment #3



                    I Wanted to Know:

   Would customers be interested in benchmarking their
       conversion against their industry average?

    Nothing says ʻinterestedʼ like clicking a “Buy Button”

                     My Test Method:

    Fake Landing page describing the feature with CTA
                       tracking
Experiment #3



                 Landing Page



Link from App




                                CTA, buy for $5/mo
Experiment #3



                      Landing Page




    15% Clicked Buy
Experiment #3



                   Action Item


     I havenʼt done many ʻfake itʼ
             experiments

Best advice read “The Lean Startup”

   This action doesnʼt require any
        software or dev time
Thank You!


Any questions, find
  me on twitter
  @rickperreault

Más contenido relacionado

Más de Dealmaker Media

Más de Dealmaker Media (20)

GROWtalks - Level Up your Engagement - Insider tips from a mobile games leade...
GROWtalks - Level Up your Engagement - Insider tips from a mobile games leade...GROWtalks - Level Up your Engagement - Insider tips from a mobile games leade...
GROWtalks - Level Up your Engagement - Insider tips from a mobile games leade...
 
GROWtalks - Designing with Data to Drive New Users - Stew Langille
GROWtalks - Designing with Data to Drive New Users - Stew LangilleGROWtalks - Designing with Data to Drive New Users - Stew Langille
GROWtalks - Designing with Data to Drive New Users - Stew Langille
 
GROWtalks - Content that Converts: Win Leads and Influence People - Lisa Manf...
GROWtalks - Content that Converts: Win Leads and Influence People - Lisa Manf...GROWtalks - Content that Converts: Win Leads and Influence People - Lisa Manf...
GROWtalks - Content that Converts: Win Leads and Influence People - Lisa Manf...
 
GROWtalks - Create a Dead Simple Process for Building Great Product - Michael...
GROWtalks - Create a Dead Simple Process for Building Great Product - Michael...GROWtalks - Create a Dead Simple Process for Building Great Product - Michael...
GROWtalks - Create a Dead Simple Process for Building Great Product - Michael...
 
Resource Code: Innovating the VC Firm with Platform & Community | Rob Hayes, ...
Resource Code: Innovating the VC Firm with Platform & Community | Rob Hayes, ...Resource Code: Innovating the VC Firm with Platform & Community | Rob Hayes, ...
Resource Code: Innovating the VC Firm with Platform & Community | Rob Hayes, ...
 
Innovation Spotlight: Anti-Robot | Jonathan Tippett (Industrialus Design), Da...
Innovation Spotlight: Anti-Robot | Jonathan Tippett (Industrialus Design), Da...Innovation Spotlight: Anti-Robot | Jonathan Tippett (Industrialus Design), Da...
Innovation Spotlight: Anti-Robot | Jonathan Tippett (Industrialus Design), Da...
 
The Age of Context: How it Will Change your Life & Work | Robert Scoble, Rack...
The Age of Context: How it Will Change your Life & Work | Robert Scoble, Rack...The Age of Context: How it Will Change your Life & Work | Robert Scoble, Rack...
The Age of Context: How it Will Change your Life & Work | Robert Scoble, Rack...
 
Thinking Big - No, Bigger | Pablos Holman
Thinking Big - No, Bigger | Pablos HolmanThinking Big - No, Bigger | Pablos Holman
Thinking Big - No, Bigger | Pablos Holman
 
Lead by Design: Bringing Design Culture into the Industrial Internet Age | Gr...
Lead by Design: Bringing Design Culture into the Industrial Internet Age | Gr...Lead by Design: Bringing Design Culture into the Industrial Internet Age | Gr...
Lead by Design: Bringing Design Culture into the Industrial Internet Age | Gr...
 
The Intersection of Design and Entrepreneurial Thinking | Munjal Shah, Charle...
The Intersection of Design and Entrepreneurial Thinking | Munjal Shah, Charle...The Intersection of Design and Entrepreneurial Thinking | Munjal Shah, Charle...
The Intersection of Design and Entrepreneurial Thinking | Munjal Shah, Charle...
 
Innovation Spotlight: InteraXon | Ariel Garten, InteraXon
Innovation Spotlight: InteraXon | Ariel Garten, InteraXonInnovation Spotlight: InteraXon | Ariel Garten, InteraXon
Innovation Spotlight: InteraXon | Ariel Garten, InteraXon
 
3 Growth Hacks: The Secrets to Driving Massive User Growth | Josh Elman, Grey...
3 Growth Hacks: The Secrets to Driving Massive User Growth | Josh Elman, Grey...3 Growth Hacks: The Secrets to Driving Massive User Growth | Josh Elman, Grey...
3 Growth Hacks: The Secrets to Driving Massive User Growth | Josh Elman, Grey...
 
Get Some REST: Building Great APIs for Great Apps | Allen Pike, Steamclock So...
Get Some REST: Building Great APIs for Great Apps | Allen Pike, Steamclock So...Get Some REST: Building Great APIs for Great Apps | Allen Pike, Steamclock So...
Get Some REST: Building Great APIs for Great Apps | Allen Pike, Steamclock So...
 
UX Design for Developers | Oleg Gutsol, 500px
UX Design for Developers | Oleg Gutsol, 500pxUX Design for Developers | Oleg Gutsol, 500px
UX Design for Developers | Oleg Gutsol, 500px
 
Big Picture CRO (Conversion Rate Optimization) | Rand Fishkin, Moz
Big Picture CRO (Conversion Rate Optimization) | Rand Fishkin, MozBig Picture CRO (Conversion Rate Optimization) | Rand Fishkin, Moz
Big Picture CRO (Conversion Rate Optimization) | Rand Fishkin, Moz
 
Quality Over Quantity - Mobile Users Mater | Jarah Euston, Flurry
Quality Over Quantity - Mobile Users Mater | Jarah Euston, FlurryQuality Over Quantity - Mobile Users Mater | Jarah Euston, Flurry
Quality Over Quantity - Mobile Users Mater | Jarah Euston, Flurry
 
GROWtalks - UX + Lean = Awesome
GROWtalks - UX + Lean = AwesomeGROWtalks - UX + Lean = Awesome
GROWtalks - UX + Lean = Awesome
 
GROWtalks - 10 Metrics You Need to be Tracking - Neil Patel KISSmetrics
GROWtalks - 10 Metrics You Need to be Tracking - Neil Patel KISSmetricsGROWtalks - 10 Metrics You Need to be Tracking - Neil Patel KISSmetrics
GROWtalks - 10 Metrics You Need to be Tracking - Neil Patel KISSmetrics
 
GROWtalks - Couples Counseling for Software Development - Joe Stump Sprint.ly
GROWtalks - Couples Counseling for Software Development - Joe Stump Sprint.lyGROWtalks - Couples Counseling for Software Development - Joe Stump Sprint.ly
GROWtalks - Couples Counseling for Software Development - Joe Stump Sprint.ly
 
GROWtalks - Better Insights for Faster Growth - Sean Ellis Qualaroo
GROWtalks - Better Insights for Faster Growth - Sean Ellis QualarooGROWtalks - Better Insights for Faster Growth - Sean Ellis Qualaroo
GROWtalks - Better Insights for Faster Growth - Sean Ellis Qualaroo
 

Último

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Último (20)

DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 

GROWtalks - How to Experiment Your Way Out of Beta - Rick Perreault Unbounce

  • 1. Experiment Your Way Out of Beta! Or be stuck in a perpetual cycle of ignorance & low revenue Rick Perreault Co-Founder & CEO Unbounce.com Find me on twitter @rickperreault Slide #1 of 24
  • 2. What is an experiment? "scientific procedure undertaken to make a discovery, test a hypothesis, or demonstrate a known fact." Important because they test your assumptions & get you closer to the truth Iʼm going to show you 3 types of experiments that you should use to get out of beta
  • 3. How do I start an experiment?
  • 4. How do I start an experiment? I heard about you from... I would definitely pay if... I tell my friends... I hate you because... I love you because... Customer feedback will give you insights & help ask good questions
  • 5. How do I start an experiment? Surveys quick & easy way to get lots of customer feedback
  • 6. How do I start an experiment? www.survey.io Step 1: fill out these 5 form fields
  • 7. How do I start an experiment? www.survey.io How did you discover sample app? How would you feel if you could no longer use sample app? What would you likely use as an alternative if sample app were no longer available? -> What is the primary benefit that you have received from sample app? -> Have you recommended sample app to anyone? (If Yes, please explain how you describe it) What type of person do you think would benefit most from sample app? How can we improve sample app to better meet your needs? Would it be okay if we followed up by email to request a clarification to one or more of your responses? Step 2: email these 8 questions your customers, done!
  • 9. Experiment #1 I love surveys! Not only for discovery, test hypothesis as well
  • 10. Experiment #1 My Hypothesis: Customers that pay us the most & stay with us the longest have a different product wish list than those who pay us the least (but make the most noise) My Test Method: Survey our customers asking them to priorities feature request & segment to track responses by pricing tiers
  • 11. Experiment #1 Customers paying... $25 per $125 + per month want month want features A, B, features F, G, C H
  • 12. Experiment #1 Action Item Use a survey to learn what your customers find most import (to get out of Beta) If you have different customer types (Free, Paid, Paid Tiers), segment I used
  • 14. Experiment #2 A/B Test Version A (control) 50% Traffic 100% Traffic Version B (test group) 50% Traffic Running two or more variations to determine which one converts better
  • 15. Experiment #2 Test ad copy, email (subject/body), website & landing pages elements, example: 1. Value Proposition (your headline) 2. Image/Video of product or context of use 3. Core Benefits 4. Request for data (form size) 5. Call-to-action (CTA) 6. Trust elements (Testimonials) 7. Secondary CTAs (social sharing) Your conversion rate WILL improve if you test
  • 16. Experiment #2 Version A (control) (Variant - new headline) (Variant - new headline + smaller page) Conversion 10% Conversion 14% Conversion 17.5%
  • 17. Experiment #2 Action Item Use Survey.io question #4 & #5 results to develop new ways of describing your startup and test it against what you currently have. I used
  • 19. Experiment #3 “Fake It” Test Developing features are expensive so you should test interest in the feature before you spend time developing it.
  • 20. Experiment #3 I Wanted to Know: Would customers be interested in benchmarking their conversion against their industry average? Nothing says ʻinterestedʼ like clicking a “Buy Button” My Test Method: Fake Landing page describing the feature with CTA tracking
  • 21. Experiment #3 Landing Page Link from App CTA, buy for $5/mo
  • 22. Experiment #3 Landing Page 15% Clicked Buy
  • 23. Experiment #3 Action Item I havenʼt done many ʻfake itʼ experiments Best advice read “The Lean Startup” This action doesnʼt require any software or dev time
  • 24. Thank You! Any questions, find me on twitter @rickperreault