SlideShare una empresa de Scribd logo
1 de 30
How to Measure the
                    Metrics that Determine
                        Real Progress
                           by Trevor Owens




                                             leanstartupmachine
Sunday, October 2, 2011
About Me

                          5 failed startups (vanity metric)

                            Web design agency

                            Imported electric scooters from China

                          Now working on Lean Startup Machine

                            P/M fit in 6 months


                                                              leanstartupmachine
Sunday, October 2, 2011
Lean Startup Machine

                          Metrics-Driven Startup Competition

                            Our winner is the team with the most
                            validated learning

                            Penultimate Goal: remove all subjectivity

                            Ultimate Goal: predict future success



                                                               leanstartupmachine
Sunday, October 2, 2011
WHY DO STARTUPS FAIL?




Sunday, October 2, 2011
Lean Startups Big Idea #1


                          The vast majority of startups fail NOT because
                           they couldnʼt build a product, but because no
                                     one wanted the product.


                           One of Steve Blankʼs (many) Big Ideas from The Four Steps to the
                                                      Epiphany




                                           Thanks to Brant Cooper & Patrick Vlaskovits for this content


Sunday, October 2, 2011
WHY DO STARTUPS SUCCEED?




Sunday, October 2, 2011
Lean Startups Big Idea #2


                            “The vast majority of successful [startups]
                          abandoned their initial plans and learned what
                            would and would not work in the market.”
                                 -Clayton Christensen, The Innovatorʼs Dilemma




                                        Thanks to Brant Cooper & Patrick Vlaskovits for this content


Sunday, October 2, 2011
Agenda

                          Introductions

                          Vanity vs. Good Metrics

                          Funnel & Cohort Metrics

                          Welcome to Innovation Accounting

                          Qualitative vs. Quantitative Metrics


                                                                 leanstartupmachine
Sunday, October 2, 2011
Introduce the Person
                               Next to You



Sunday, October 2, 2011
Why do you want to
                          learn about metrics?



Sunday, October 2, 2011
Vanity Metrics

                          Google Analytics

                            There will always be something up and to
                            the right

                          Anything you read on TechCrunch

                            They make your competitors feel bad and
                            they don’t tell you anything about the
                            company

                                                            leanstartupmachine
Sunday, October 2, 2011
Vanity Metrics pt. 2

                          From TechCrunch:

                            “mDialog Raises $5 Million from
                            BlackBerry Partners”

                            “GroupMe Is Now Sending One Million
                            Texts Every Day”

                            “Google Plus hit 10M users in 2 weeks”


                                                              leanstartupmachine
Sunday, October 2, 2011
What Metrics Matter?


                          Facebook Example

                            150,000 users, little revenue

                            Many superior competitors

                            What would indicate their future success?



                                                             leanstartupmachine
Sunday, October 2, 2011
What Metrics Matter?
                                 pt. 2
                          Facebook Example

                            75% of users visit one or more times per
                            day

                            Within one month of launching on a new
                            campus, can acquire 90% of the student
                            body


                                                             leanstartupmachine
Sunday, October 2, 2011
What Metrics Matter?
                                 pt. 3
                           Value Hypothesis

                             How do we know we’re adding more
                             value to our customers lives?

                           Growth Hypothesis

                             Through what engine will we acquire
                             new customers?


                                                           leanstartupmachine
Sunday, October 2, 2011
What Metrics Matter?
                                 pt. 4

                             Good Metrics (Three A’s)

                               Are Actionable

                               Can be Audited

                               Are Accessible



                                                        leanstartupmachine
Sunday, October 2, 2011
Assignment 1
                          Groups of 4 (10 minutes)

                            Research metrics on:

                              Google Plus

                              Groupon

                              Twitter

                              Explain which are vanity and
                              which are predictive
                                                      leanstartupmachine
Sunday, October 2, 2011
Tools
                          Funnel Metrics - AARRR

                            Acquisition - user visits

                            Activation - user registers

                            Retention - user comes back

                            Referral - friend of user signs up

                            Revenue - user pays for something

                                                                 leanstartupmachine
Sunday, October 2, 2011
Tools pt. 2
                          Split Testing

                            Which performs better, A or B?

                            Wrong Uses

                               Red button or blue button?

                            Right Uses

                               Do users need to try the product
                               before paying for it?

                                                             leanstartupmachine
Sunday, October 2, 2011
Tools pt. 3

                          Cohort Analysis

                            Buckets users into the month or week
                            they joined

                            NEVER look at users in aggregate

                               Fact: New users are more engaged



                                                          leanstartupmachine
Sunday, October 2, 2011
Tools pt. 4
                          Funnel Metrics - AARRR

                            Acquisition

                            Activation

                            Retention

                            Referral

                            Revenue

                                                   leanstartupmachine
Sunday, October 2, 2011
Assignment 2

                          Groups of 4 (10 minutes)

                            Give an example of using split-
                            testing or cohort analysis to get
                            actionable metrics on:

                              Acquisition, Activation

                              Retention, Referral, Revenue


                                                        leanstartupmachine
Sunday, October 2, 2011
Innovation Accounting:
                            Tying It Together
                            The ultimate measure of progress in any
                            startup is rate of validated learning.

                            Innovation Accounting determines whether
                            your experiments are productive or not.

                            1. Set the baseline MVP

                            2.Optimize the MVP

                            3.Pivot or Persevere

                                                             leanstartupmachine
Sunday, October 2, 2011
Baseline MVP

                          What’s an MVP?

                            An experiment that starts with a
                            falsifiable hypothesis

                            Your first MVP may not be a product

                            Concierge MVPs Kick Ass



                                                               leanstartupmachine
Sunday, October 2, 2011
Optimization

                          Qualitative Metrics

                            Data expressed in people, words, &
                            feelings around actions

                            Small, detailed data set

                          Quantitative Metrics

                            Data expressed around actions

                            Large data set
                                                             leanstartupmachine
Sunday, October 2, 2011
Pivot or Persevere

                          What is a pivot?

                            Change in strategy based on learning from
                            market feedback

                          When do you pivot?

                            When each additional experiment leads to
                            less progress

                                                             leanstartupmachine
Sunday, October 2, 2011
Votizen Case Study




Sunday, October 2, 2011
Top 10 Ways
                          Entrepreneurs Pivot a
                          Lean Startup (Forbes)


Sunday, October 2, 2011
When’s It Enough?
                          Product Market Fit

                            At least 40% of users saying they
                            would be “very disappointed” without
                            your product.

                            Arbitrary, but defined after comparing
                            results across nearly 100 startups.

                            Those that struggle for traction are
                            always under 40%.

                                                           leanstartupmachine
Sunday, October 2, 2011
Thank You
                          Recommended Software

                            Unbounce

                            KISS Metrics

                            Survey.io

                            Wufoo

                            LinkShiftr

                                                 leanstartupmachine
Sunday, October 2, 2011

Más contenido relacionado

Destacado

What is Google App Engine
What is Google App EngineWhat is Google App Engine
What is Google App Engine
Chris Schalk
 
Validating Non Functional Requirements
Validating Non Functional RequirementsValidating Non Functional Requirements
Validating Non Functional Requirements
Reuben Korngold
 
What is a service level agreement week7
What is a service level agreement week7What is a service level agreement week7
What is a service level agreement week7
hapy
 
Software Requirements
 Software Requirements Software Requirements
Software Requirements
Zaman Khan
 

Destacado (20)

Innovation accounting at BackupAgent v2
Innovation accounting at BackupAgent v2Innovation accounting at BackupAgent v2
Innovation accounting at BackupAgent v2
 
Growth hacking workshop @ University of Amsterdam
Growth hacking workshop @ University of Amsterdam Growth hacking workshop @ University of Amsterdam
Growth hacking workshop @ University of Amsterdam
 
The Experience Design Collection
The Experience Design CollectionThe Experience Design Collection
The Experience Design Collection
 
Sketchnotes: Lean Startup Day, Dec 3, 2012
Sketchnotes: Lean Startup Day, Dec 3, 2012Sketchnotes: Lean Startup Day, Dec 3, 2012
Sketchnotes: Lean Startup Day, Dec 3, 2012
 
Cloud Computing
Cloud  ComputingCloud  Computing
Cloud Computing
 
Jitterbit Harmony Spring’15 cloud integration platform
Jitterbit Harmony Spring’15 cloud integration platformJitterbit Harmony Spring’15 cloud integration platform
Jitterbit Harmony Spring’15 cloud integration platform
 
Cloud computing
Cloud computingCloud computing
Cloud computing
 
What is Google App Engine
What is Google App EngineWhat is Google App Engine
What is Google App Engine
 
SISO Presentation: Cloud Ontology
SISO Presentation: Cloud OntologySISO Presentation: Cloud Ontology
SISO Presentation: Cloud Ontology
 
Accounting for non functional and project requirements - cosmic and ifpug dev...
Accounting for non functional and project requirements - cosmic and ifpug dev...Accounting for non functional and project requirements - cosmic and ifpug dev...
Accounting for non functional and project requirements - cosmic and ifpug dev...
 
AS400 webservices - the adapter create cloud apps in a couple of days
AS400 webservices - the adapter create cloud apps in a couple of daysAS400 webservices - the adapter create cloud apps in a couple of days
AS400 webservices - the adapter create cloud apps in a couple of days
 
Harmony concepts and design guide
Harmony concepts and design guideHarmony concepts and design guide
Harmony concepts and design guide
 
Validating Non Functional Requirements
Validating Non Functional RequirementsValidating Non Functional Requirements
Validating Non Functional Requirements
 
Non functional requirements - checklist
Non functional requirements - checklistNon functional requirements - checklist
Non functional requirements - checklist
 
Sla Agreement
Sla AgreementSla Agreement
Sla Agreement
 
Introduction to Google App Engine
Introduction to Google App EngineIntroduction to Google App Engine
Introduction to Google App Engine
 
What is a service level agreement week7
What is a service level agreement week7What is a service level agreement week7
What is a service level agreement week7
 
Software Requirements
 Software Requirements Software Requirements
Software Requirements
 
How do Software Architects consider Non-Functional Requirements - An explorat...
How do Software Architects consider Non-Functional Requirements - An explorat...How do Software Architects consider Non-Functional Requirements - An explorat...
How do Software Architects consider Non-Functional Requirements - An explorat...
 
Digital Metrics: What to Measure, How, and Why
Digital Metrics: What to Measure, How, and WhyDigital Metrics: What to Measure, How, and Why
Digital Metrics: What to Measure, How, and Why
 

Similar a How to Measure the Metrics that Determine Real Progress

Optimizing for change: Taking risks safely & e-commerce
Optimizing for change: Taking risks safely & e-commerceOptimizing for change: Taking risks safely & e-commerce
Optimizing for change: Taking risks safely & e-commerce
Kellan
 
Optimizing for change: Taking risks safely & e-commerce
Optimizing for change: Taking risks safely & e-commerceOptimizing for change: Taking risks safely & e-commerce
Optimizing for change: Taking risks safely & e-commerce
Kellan
 
LISA 2011 Keynote: The DevOps Transformation
LISA 2011 Keynote: The DevOps TransformationLISA 2011 Keynote: The DevOps Transformation
LISA 2011 Keynote: The DevOps Transformation
benrockwood
 
Scott Brinker - Hacking Marketing
Scott Brinker - Hacking MarketingScott Brinker - Hacking Marketing
Scott Brinker - Hacking Marketing
INBOUND
 
Altimetersocialanalytics081011final 110810105257-phpapp01
Altimetersocialanalytics081011final 110810105257-phpapp01Altimetersocialanalytics081011final 110810105257-phpapp01
Altimetersocialanalytics081011final 110810105257-phpapp01
onlinekash
 

Similar a How to Measure the Metrics that Determine Real Progress (19)

FollowFridays, Session 2: The Power of Customer Data and Metrics
FollowFridays, Session 2: The Power of Customer Data and MetricsFollowFridays, Session 2: The Power of Customer Data and Metrics
FollowFridays, Session 2: The Power of Customer Data and Metrics
 
Future Building
Future BuildingFuture Building
Future Building
 
Tea-time with Testers March 2011 Year 1 Issue II
Tea-time with Testers March 2011  Year 1  Issue IITea-time with Testers March 2011  Year 1  Issue II
Tea-time with Testers March 2011 Year 1 Issue II
 
Optimizing for change: Taking risks safely & e-commerce
Optimizing for change: Taking risks safely & e-commerceOptimizing for change: Taking risks safely & e-commerce
Optimizing for change: Taking risks safely & e-commerce
 
RDA Virtual Research Environments Workshop
RDA Virtual Research Environments WorkshopRDA Virtual Research Environments Workshop
RDA Virtual Research Environments Workshop
 
Sentiment analysis using nlp
Sentiment analysis using nlpSentiment analysis using nlp
Sentiment analysis using nlp
 
wendi_ppt
wendi_pptwendi_ppt
wendi_ppt
 
MDW Boulder April '11 | Matt Howell_New Teams and Process for Making Digital ...
MDW Boulder April '11 | Matt Howell_New Teams and Process for Making Digital ...MDW Boulder April '11 | Matt Howell_New Teams and Process for Making Digital ...
MDW Boulder April '11 | Matt Howell_New Teams and Process for Making Digital ...
 
Optimizing for change: Taking risks safely & e-commerce
Optimizing for change: Taking risks safely & e-commerceOptimizing for change: Taking risks safely & e-commerce
Optimizing for change: Taking risks safely & e-commerce
 
2011: The Role of Interpretation in Insight
2011: The Role of Interpretation in Insight2011: The Role of Interpretation in Insight
2011: The Role of Interpretation in Insight
 
LISA 2011 Keynote: The DevOps Transformation
LISA 2011 Keynote: The DevOps TransformationLISA 2011 Keynote: The DevOps Transformation
LISA 2011 Keynote: The DevOps Transformation
 
Dollars and Dates are Killing Agile
Dollars and Dates are Killing AgileDollars and Dates are Killing Agile
Dollars and Dates are Killing Agile
 
Scott Brinker - Hacking Marketing
Scott Brinker - Hacking MarketingScott Brinker - Hacking Marketing
Scott Brinker - Hacking Marketing
 
AIIM Ottawa June 15/11 - Information Governance and Microsoft SharePoint
AIIM Ottawa June 15/11 - Information Governance and Microsoft SharePointAIIM Ottawa June 15/11 - Information Governance and Microsoft SharePoint
AIIM Ottawa June 15/11 - Information Governance and Microsoft SharePoint
 
Altimetersocialanalytics081011final 110810105257-phpapp01
Altimetersocialanalytics081011final 110810105257-phpapp01Altimetersocialanalytics081011final 110810105257-phpapp01
Altimetersocialanalytics081011final 110810105257-phpapp01
 
Altimetersocialanalytics081011final 110810105257-phpapp01
Altimetersocialanalytics081011final 110810105257-phpapp01Altimetersocialanalytics081011final 110810105257-phpapp01
Altimetersocialanalytics081011final 110810105257-phpapp01
 
A Framework for Social Analytics
A Framework for Social AnalyticsA Framework for Social Analytics
A Framework for Social Analytics
 
Altimetersocialanalytics081011final 110810105257 Phpapp01
Altimetersocialanalytics081011final 110810105257 Phpapp01Altimetersocialanalytics081011final 110810105257 Phpapp01
Altimetersocialanalytics081011final 110810105257 Phpapp01
 
Summit slide loop ny
Summit slide loop nySummit slide loop ny
Summit slide loop ny
 

Más de Lean Startup Machine

I want my bike back - #LsmBoulder 1st Place
I want my bike back - #LsmBoulder 1st PlaceI want my bike back - #LsmBoulder 1st Place
I want my bike back - #LsmBoulder 1st Place
Lean Startup Machine
 
How to build_a_successful_mvp_lean-302
How to build_a_successful_mvp_lean-302How to build_a_successful_mvp_lean-302
How to build_a_successful_mvp_lean-302
Lean Startup Machine
 
Partyfly- Lean Startup Machine NYC
Partyfly- Lean Startup Machine NYCPartyfly- Lean Startup Machine NYC
Partyfly- Lean Startup Machine NYC
Lean Startup Machine
 
Intersail- Lean Startup Machine NYC
Intersail- Lean Startup Machine NYCIntersail- Lean Startup Machine NYC
Intersail- Lean Startup Machine NYC
Lean Startup Machine
 
Getogether- Lean Startup Machine NYC
Getogether- Lean Startup Machine NYCGetogether- Lean Startup Machine NYC
Getogether- Lean Startup Machine NYC
Lean Startup Machine
 
Fleamarket.com- Lean Startup Machine NYC
Fleamarket.com- Lean Startup Machine NYCFleamarket.com- Lean Startup Machine NYC
Fleamarket.com- Lean Startup Machine NYC
Lean Startup Machine
 
Finalobelts- Lean Startup Machine NYC
Finalobelts- Lean Startup Machine NYCFinalobelts- Lean Startup Machine NYC
Finalobelts- Lean Startup Machine NYC
Lean Startup Machine
 

Más de Lean Startup Machine (20)

I want my bike back - #LsmBoulder 1st Place
I want my bike back - #LsmBoulder 1st PlaceI want my bike back - #LsmBoulder 1st Place
I want my bike back - #LsmBoulder 1st Place
 
About Lean Startup Machine
About Lean Startup MachineAbout Lean Startup Machine
About Lean Startup Machine
 
How to build_a_successful_mvp_lean-302
How to build_a_successful_mvp_lean-302How to build_a_successful_mvp_lean-302
How to build_a_successful_mvp_lean-302
 
Startup Metrics for Founders (LEAN 121)
Startup Metrics for Founders (LEAN 121)Startup Metrics for Founders (LEAN 121)
Startup Metrics for Founders (LEAN 121)
 
Partyfly- Lean Startup Machine NYC
Partyfly- Lean Startup Machine NYCPartyfly- Lean Startup Machine NYC
Partyfly- Lean Startup Machine NYC
 
Vjockey- Lean Startup Machine NYC
Vjockey- Lean Startup Machine NYCVjockey- Lean Startup Machine NYC
Vjockey- Lean Startup Machine NYC
 
Intersail- Lean Startup Machine NYC
Intersail- Lean Startup Machine NYCIntersail- Lean Startup Machine NYC
Intersail- Lean Startup Machine NYC
 
Getogether- Lean Startup Machine NYC
Getogether- Lean Startup Machine NYCGetogether- Lean Startup Machine NYC
Getogether- Lean Startup Machine NYC
 
Hashpix- Lean Startup Machine NYC
Hashpix- Lean Startup Machine NYCHashpix- Lean Startup Machine NYC
Hashpix- Lean Startup Machine NYC
 
Finalpresentation
FinalpresentationFinalpresentation
Finalpresentation
 
Fleamarket.com- Lean Startup Machine NYC
Fleamarket.com- Lean Startup Machine NYCFleamarket.com- Lean Startup Machine NYC
Fleamarket.com- Lean Startup Machine NYC
 
Finalobelts- Lean Startup Machine NYC
Finalobelts- Lean Startup Machine NYCFinalobelts- Lean Startup Machine NYC
Finalobelts- Lean Startup Machine NYC
 
Sahara - #LsmPakistan
Sahara - #LsmPakistanSahara - #LsmPakistan
Sahara - #LsmPakistan
 
ScriptOn - #LsmPakistan
ScriptOn - #LsmPakistanScriptOn - #LsmPakistan
ScriptOn - #LsmPakistan
 
Meri Taaleem - #LsmPakistan
Meri Taaleem - #LsmPakistanMeri Taaleem - #LsmPakistan
Meri Taaleem - #LsmPakistan
 
#LsmNYC Team - Tripo
#LsmNYC Team - Tripo#LsmNYC Team - Tripo
#LsmNYC Team - Tripo
 
#LsmNYC Team - Team Awesome
#LsmNYC Team - Team Awesome#LsmNYC Team - Team Awesome
#LsmNYC Team - Team Awesome
 
#LsmNYC Team - Smart Books
#LsmNYC Team - Smart Books#LsmNYC Team - Smart Books
#LsmNYC Team - Smart Books
 
#LsmNYC Team - SeniorSupport
#LsmNYC Team - SeniorSupport#LsmNYC Team - SeniorSupport
#LsmNYC Team - SeniorSupport
 
#LsmNYC Team - Roundtable
#LsmNYC Team - Roundtable#LsmNYC Team - Roundtable
#LsmNYC Team - Roundtable
 

Último

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Último (20)

Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 

How to Measure the Metrics that Determine Real Progress

  • 1. How to Measure the Metrics that Determine Real Progress by Trevor Owens leanstartupmachine Sunday, October 2, 2011
  • 2. About Me 5 failed startups (vanity metric) Web design agency Imported electric scooters from China Now working on Lean Startup Machine P/M fit in 6 months leanstartupmachine Sunday, October 2, 2011
  • 3. Lean Startup Machine Metrics-Driven Startup Competition Our winner is the team with the most validated learning Penultimate Goal: remove all subjectivity Ultimate Goal: predict future success leanstartupmachine Sunday, October 2, 2011
  • 4. WHY DO STARTUPS FAIL? Sunday, October 2, 2011
  • 5. Lean Startups Big Idea #1 The vast majority of startups fail NOT because they couldnʼt build a product, but because no one wanted the product. One of Steve Blankʼs (many) Big Ideas from The Four Steps to the Epiphany Thanks to Brant Cooper & Patrick Vlaskovits for this content Sunday, October 2, 2011
  • 6. WHY DO STARTUPS SUCCEED? Sunday, October 2, 2011
  • 7. Lean Startups Big Idea #2 “The vast majority of successful [startups] abandoned their initial plans and learned what would and would not work in the market.” -Clayton Christensen, The Innovatorʼs Dilemma Thanks to Brant Cooper & Patrick Vlaskovits for this content Sunday, October 2, 2011
  • 8. Agenda Introductions Vanity vs. Good Metrics Funnel & Cohort Metrics Welcome to Innovation Accounting Qualitative vs. Quantitative Metrics leanstartupmachine Sunday, October 2, 2011
  • 9. Introduce the Person Next to You Sunday, October 2, 2011
  • 10. Why do you want to learn about metrics? Sunday, October 2, 2011
  • 11. Vanity Metrics Google Analytics There will always be something up and to the right Anything you read on TechCrunch They make your competitors feel bad and they don’t tell you anything about the company leanstartupmachine Sunday, October 2, 2011
  • 12. Vanity Metrics pt. 2 From TechCrunch: “mDialog Raises $5 Million from BlackBerry Partners” “GroupMe Is Now Sending One Million Texts Every Day” “Google Plus hit 10M users in 2 weeks” leanstartupmachine Sunday, October 2, 2011
  • 13. What Metrics Matter? Facebook Example 150,000 users, little revenue Many superior competitors What would indicate their future success? leanstartupmachine Sunday, October 2, 2011
  • 14. What Metrics Matter? pt. 2 Facebook Example 75% of users visit one or more times per day Within one month of launching on a new campus, can acquire 90% of the student body leanstartupmachine Sunday, October 2, 2011
  • 15. What Metrics Matter? pt. 3 Value Hypothesis How do we know we’re adding more value to our customers lives? Growth Hypothesis Through what engine will we acquire new customers? leanstartupmachine Sunday, October 2, 2011
  • 16. What Metrics Matter? pt. 4 Good Metrics (Three A’s) Are Actionable Can be Audited Are Accessible leanstartupmachine Sunday, October 2, 2011
  • 17. Assignment 1 Groups of 4 (10 minutes) Research metrics on: Google Plus Groupon Twitter Explain which are vanity and which are predictive leanstartupmachine Sunday, October 2, 2011
  • 18. Tools Funnel Metrics - AARRR Acquisition - user visits Activation - user registers Retention - user comes back Referral - friend of user signs up Revenue - user pays for something leanstartupmachine Sunday, October 2, 2011
  • 19. Tools pt. 2 Split Testing Which performs better, A or B? Wrong Uses Red button or blue button? Right Uses Do users need to try the product before paying for it? leanstartupmachine Sunday, October 2, 2011
  • 20. Tools pt. 3 Cohort Analysis Buckets users into the month or week they joined NEVER look at users in aggregate Fact: New users are more engaged leanstartupmachine Sunday, October 2, 2011
  • 21. Tools pt. 4 Funnel Metrics - AARRR Acquisition Activation Retention Referral Revenue leanstartupmachine Sunday, October 2, 2011
  • 22. Assignment 2 Groups of 4 (10 minutes) Give an example of using split- testing or cohort analysis to get actionable metrics on: Acquisition, Activation Retention, Referral, Revenue leanstartupmachine Sunday, October 2, 2011
  • 23. Innovation Accounting: Tying It Together The ultimate measure of progress in any startup is rate of validated learning. Innovation Accounting determines whether your experiments are productive or not. 1. Set the baseline MVP 2.Optimize the MVP 3.Pivot or Persevere leanstartupmachine Sunday, October 2, 2011
  • 24. Baseline MVP What’s an MVP? An experiment that starts with a falsifiable hypothesis Your first MVP may not be a product Concierge MVPs Kick Ass leanstartupmachine Sunday, October 2, 2011
  • 25. Optimization Qualitative Metrics Data expressed in people, words, & feelings around actions Small, detailed data set Quantitative Metrics Data expressed around actions Large data set leanstartupmachine Sunday, October 2, 2011
  • 26. Pivot or Persevere What is a pivot? Change in strategy based on learning from market feedback When do you pivot? When each additional experiment leads to less progress leanstartupmachine Sunday, October 2, 2011
  • 27. Votizen Case Study Sunday, October 2, 2011
  • 28. Top 10 Ways Entrepreneurs Pivot a Lean Startup (Forbes) Sunday, October 2, 2011
  • 29. When’s It Enough? Product Market Fit At least 40% of users saying they would be “very disappointed” without your product. Arbitrary, but defined after comparing results across nearly 100 startups. Those that struggle for traction are always under 40%. leanstartupmachine Sunday, October 2, 2011
  • 30. Thank You Recommended Software Unbounce KISS Metrics Survey.io Wufoo LinkShiftr leanstartupmachine Sunday, October 2, 2011