SlideShare una empresa de Scribd logo
1 de 17
Measurements and Metrics




MOBILE ANALYTICS
VALIDATED LEARNING LOOP

                                • Analytics and Metrics Process =
                                  Build + Measure + Learn
                                • Best summarized by Eric Ries’s
                                  Validated Learning Loop in Lean
                                  Startup methodology




                                        Not just code. Also alignment of
                                        measurement and business
                                        strategy



              REFERENCE: Lean Startup by Eric Ries
OUTCOMES

• Analytics don’t end with
  measurement
• Must translate data into desirable
  outcomes




 Test, measure, and take action




                           REFERENCE: Lean Startup by Eric Ries
BUSINESS REQUIREMENTS
• FUNDAMENTAL QUESTION: WHAT DEFINES
  SUCCESS?
• All analysis start with a question
• Understand what metrics and data are needed to make
  better decisions and perform better
• Analyze mobile app architecture
   – Any constraints that may inhibit measurements
   – How to leverage technology
PRODUCT USAGE METRICS


                               AARRR!
• What do you need to do to
  build your product and
  learn about your users?
• Dave McClure’s AARRR
  model provides 5 useful
  metrics to learning about
  your product and how it is
  used



          Reference: dave McClure, 500 startups. Picture courtesy of walt Disney pictures
THE AARRR MODEL




            Reference: dave McClure, 500 startups
FUNNEL ANALYSIS
• A funnel of steps that a user go through before meeting a
  goal, for example
   –   Steps leading to contacting the company
   –   Steps leading to purchasing the product
   –   Steps leading to purchasing in-app modules/features
   –   Steps leading to purchasing merchandise or tokens (for games(
• Funnel analysis = understanding conversions
• A step in a funnel = a page view (web) = a screen or action
  (mobile app)
WEB VS MOBILE

                 WEB                                 MOBILE APP

 Session tracking done primarily thru       Session tracking done primarily thru
        cookies and Javascript                             UDID

Human user interface is keyboard and        Human user interface is gestural and
          mouse based                                 touch-based
Web measurement model is centered
                                             Measurement model is less about
around page views, referrals, search,
                                                  referrals and search
            and visits
                                                Unique visitors are measured
Unique visitors are tied to individual or
                                            differently because of gateway IPs of
          server IP addresses
                                                           carriers
SOLUTIONS
• Flurry – http://flurry.com/
• Localytics – http://localytics.com/
• Webtrends –
  http://webtrends.com/products/analytics/mobile/
• AppClix – http://www.appclix.com/
• Kontagent – http://kontagent.com/
• Bango – http://bango.com/
• Apsalar – http://apsalar.com/
• Claritics – http://claritics.com/
• Others that we may have missed…
MOBILE METRICS CATEGORIES

•   Application
•   Content
•   User Behavior
•   People/Location
•   Technical
COMMON MOBILE METRICS 1

• Applications                • Content
  – #Downloads                  –   Screens
  – Conversions                 –   Visits, unique visits
    (Monetization)              –   In-app
  – Engagement/loyalty          –   Ads
    (over time)                 –   Links
  – User acquisition            –   Other events
  – User retention
  – Cohort analysis
    (retention, engagement,
     monetization)
COMMON MOBILE METRICS 2

• User Behavior                 • People/Location
  – Screen flow (useful for       –   Users
    navigation and usability)     –   Social identity
  – Exits (how users are          –   Countries/Regions
    exiting an app)               –   Languages
  – Sessions                      –   Marketplaces
    (length, frequency, type
    of users)                     –   Carriers
                                  –   Age
COMMON MOBILE METRICS 3

• Technical
  – Errors
  – Devices
  – Operating systems
  – App Versions
  – Connections
REPORT TERMINOLOGY

 • Common report terminology
 • Example: Breakdown of OS versions used to run the app
                                              FILTER: Time Duration
DIMENSION: OS Version




                                                         METRIC: Session


                          Reference: Localytics report
STRATEGIES
• Define a few funnels to understand how user
  usage drives towards a goal like
  registration, purchase
• If possible apply some of the advanced tracking
  and reporting features in the analytics tool to
  provide deeper insights
   – Filters (at the log and report levels)
   – Funnel analysis
   – Profiling
• Keep refining how metrics are tracked
EVENT TAGGING

• Data collection
• Mapping: Actions » Events » Metrics
• Need to define events to tag so that we can
  measure the metrics
• Example:
  – Start Time = Time when a player starts playing a
    game
  – End Time = Time when a player ends a game
  – Defines the names for both events
Questions?




                        Picture: Sean Dreilinger -
http://www.flickr.com/photos/seandreilinger/2326448445/in/photostream/

Más contenido relacionado

Destacado

Прориси
ПрорисиПрориси
Прориси
belyavsky
 
Brand Management Pptsam1
Brand Management Pptsam1Brand Management Pptsam1
Brand Management Pptsam1
samarpankole
 
Siberian dream
Siberian dreamSiberian dream
Siberian dream
filipj2000
 
81765 karaagopyan
81765 karaagopyan81765 karaagopyan
81765 karaagopyan
filipj2000
 
Istanbul 100 years_ago
Istanbul 100 years_agoIstanbul 100 years_ago
Istanbul 100 years_ago
filipj2000
 

Destacado (16)

Прориси
ПрорисиПрориси
Прориси
 
13강 기업교육론 20110603
13강 기업교육론 2011060313강 기업교육론 20110603
13강 기업교육론 20110603
 
Collective action under autocracies
Collective action under autocraciesCollective action under autocracies
Collective action under autocracies
 
Introduction to Steens Furniture
Introduction to Steens FurnitureIntroduction to Steens Furniture
Introduction to Steens Furniture
 
STEM Powers Jets
STEM Powers JetsSTEM Powers Jets
STEM Powers Jets
 
Mexico by john2
Mexico by john2  Mexico by john2
Mexico by john2
 
Creativity
CreativityCreativity
Creativity
 
Brand Management Pptsam1
Brand Management Pptsam1Brand Management Pptsam1
Brand Management Pptsam1
 
Shanxi china
Shanxi  chinaShanxi  china
Shanxi china
 
Summarizing ppoint
Summarizing ppointSummarizing ppoint
Summarizing ppoint
 
Brand Management Pptsam1
Brand Management Pptsam1Brand Management Pptsam1
Brand Management Pptsam1
 
Siberian dream
Siberian dreamSiberian dream
Siberian dream
 
National 2
National 2National 2
National 2
 
81765 karaagopyan
81765 karaagopyan81765 karaagopyan
81765 karaagopyan
 
Twitter for Business
Twitter for BusinessTwitter for Business
Twitter for Business
 
Istanbul 100 years_ago
Istanbul 100 years_agoIstanbul 100 years_ago
Istanbul 100 years_ago
 

Similar a Mobile Analytics

SoftWatch Overview_short (1)
SoftWatch Overview_short (1)SoftWatch Overview_short (1)
SoftWatch Overview_short (1)
Dror Leshem
 
SoftWatch Overview_short (1)
SoftWatch Overview_short (1)SoftWatch Overview_short (1)
SoftWatch Overview_short (1)
Moshe Kozlovski
 
Session 9-10 - UI/UX design for iOS 7 application
Session 9-10 - UI/UX design for iOS 7 applicationSession 9-10 - UI/UX design for iOS 7 application
Session 9-10 - UI/UX design for iOS 7 application
Vu Tran Lam
 
Harnessing Big Data_UCLA
Harnessing Big Data_UCLAHarnessing Big Data_UCLA
Harnessing Big Data_UCLA
Paul Barsch
 

Similar a Mobile Analytics (20)

Understanding Mobile Apps for Events: From Strategy to Selection
Understanding Mobile Apps for Events: From Strategy to SelectionUnderstanding Mobile Apps for Events: From Strategy to Selection
Understanding Mobile Apps for Events: From Strategy to Selection
 
CIS13: How Enterprises Go Mobile: An Introduction to MobileIT
CIS13: How Enterprises Go Mobile: An Introduction to MobileITCIS13: How Enterprises Go Mobile: An Introduction to MobileIT
CIS13: How Enterprises Go Mobile: An Introduction to MobileIT
 
Using analytics in ux design my view
Using analytics in ux design   my viewUsing analytics in ux design   my view
Using analytics in ux design my view
 
Boost the ROI of your digital presence
Boost the ROI of your digital presenceBoost the ROI of your digital presence
Boost the ROI of your digital presence
 
The Human Customer: B2B's Great Migration to Customer Experience in Digital
The Human Customer: B2B's Great Migration to Customer Experience in DigitalThe Human Customer: B2B's Great Migration to Customer Experience in Digital
The Human Customer: B2B's Great Migration to Customer Experience in Digital
 
Supersede overview presentation
Supersede overview presentationSupersede overview presentation
Supersede overview presentation
 
SoftWatch Overview_short (1)
SoftWatch Overview_short (1)SoftWatch Overview_short (1)
SoftWatch Overview_short (1)
 
SoftWatch Overview_short (1)
SoftWatch Overview_short (1)SoftWatch Overview_short (1)
SoftWatch Overview_short (1)
 
The Shortest Path to Value for Business Mobile Apps
The Shortest Path to Value for Business Mobile Apps The Shortest Path to Value for Business Mobile Apps
The Shortest Path to Value for Business Mobile Apps
 
Decision Matrix for IoT Product Development
Decision Matrix for IoT Product DevelopmentDecision Matrix for IoT Product Development
Decision Matrix for IoT Product Development
 
Session 9-10 - UI/UX design for iOS 7 application
Session 9-10 - UI/UX design for iOS 7 applicationSession 9-10 - UI/UX design for iOS 7 application
Session 9-10 - UI/UX design for iOS 7 application
 
Matthias Bettag - Challenges for each the multi-channel, multi-device and mul...
Matthias Bettag - Challenges for each the multi-channel, multi-device and mul...Matthias Bettag - Challenges for each the multi-channel, multi-device and mul...
Matthias Bettag - Challenges for each the multi-channel, multi-device and mul...
 
Dell mobility Application Services
Dell mobility Application Services Dell mobility Application Services
Dell mobility Application Services
 
Mobile testing practices
Mobile testing practicesMobile testing practices
Mobile testing practices
 
Application Insights and Jupyter Notebook(Opensource) combo to analyze large ...
Application Insights and Jupyter Notebook(Opensource) combo to analyze large ...Application Insights and Jupyter Notebook(Opensource) combo to analyze large ...
Application Insights and Jupyter Notebook(Opensource) combo to analyze large ...
 
Harnessing Big Data_UCLA
Harnessing Big Data_UCLAHarnessing Big Data_UCLA
Harnessing Big Data_UCLA
 
Getting Started with Product Analytics - A 101 Implementation Guide for Begin...
Getting Started with Product Analytics - A 101 Implementation Guide for Begin...Getting Started with Product Analytics - A 101 Implementation Guide for Begin...
Getting Started with Product Analytics - A 101 Implementation Guide for Begin...
 
Best Practices for Mobility
Best Practices for Mobility Best Practices for Mobility
Best Practices for Mobility
 
Chris Munns, DevOps @ Amazon: Microservices, 2 Pizza Teams, & 50 Million Depl...
Chris Munns, DevOps @ Amazon: Microservices, 2 Pizza Teams, & 50 Million Depl...Chris Munns, DevOps @ Amazon: Microservices, 2 Pizza Teams, & 50 Million Depl...
Chris Munns, DevOps @ Amazon: Microservices, 2 Pizza Teams, & 50 Million Depl...
 
App testing and publishing
App testing and publishingApp testing and publishing
App testing and publishing
 

Más de Samuel Chow

UI Design - Lessons Learned, Principles, and Best Practices
UI Design - Lessons Learned, Principles, and Best PracticesUI Design - Lessons Learned, Principles, and Best Practices
UI Design - Lessons Learned, Principles, and Best Practices
Samuel Chow
 

Más de Samuel Chow (8)

Docker primer and tips
Docker primer and tipsDocker primer and tips
Docker primer and tips
 
Terraforming your Infrastructure on GCP
Terraforming your Infrastructure on GCPTerraforming your Infrastructure on GCP
Terraforming your Infrastructure on GCP
 
GCPLA Meetup Workshop - Migration from a Legacy Infrastructure to the Cloud
GCPLA Meetup Workshop - Migration from a Legacy Infrastructure to the CloudGCPLA Meetup Workshop - Migration from a Legacy Infrastructure to the Cloud
GCPLA Meetup Workshop - Migration from a Legacy Infrastructure to the Cloud
 
Docker, Kubernetes, and Google Cloud
Docker, Kubernetes, and Google CloudDocker, Kubernetes, and Google Cloud
Docker, Kubernetes, and Google Cloud
 
UI Design - Lessons Learned, Principles, and Best Practices
UI Design - Lessons Learned, Principles, and Best PracticesUI Design - Lessons Learned, Principles, and Best Practices
UI Design - Lessons Learned, Principles, and Best Practices
 
iOS Release Management
iOS Release ManagementiOS Release Management
iOS Release Management
 
Frisbee Thrower Prototype
Frisbee Thrower PrototypeFrisbee Thrower Prototype
Frisbee Thrower Prototype
 
Frisbee Thrower Concepts (Part 1)
Frisbee Thrower Concepts (Part 1)Frisbee Thrower Concepts (Part 1)
Frisbee Thrower Concepts (Part 1)
 

Último

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Último (20)

Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 

Mobile Analytics

  • 2. VALIDATED LEARNING LOOP • Analytics and Metrics Process = Build + Measure + Learn • Best summarized by Eric Ries’s Validated Learning Loop in Lean Startup methodology Not just code. Also alignment of measurement and business strategy REFERENCE: Lean Startup by Eric Ries
  • 3. OUTCOMES • Analytics don’t end with measurement • Must translate data into desirable outcomes Test, measure, and take action REFERENCE: Lean Startup by Eric Ries
  • 4. BUSINESS REQUIREMENTS • FUNDAMENTAL QUESTION: WHAT DEFINES SUCCESS? • All analysis start with a question • Understand what metrics and data are needed to make better decisions and perform better • Analyze mobile app architecture – Any constraints that may inhibit measurements – How to leverage technology
  • 5. PRODUCT USAGE METRICS AARRR! • What do you need to do to build your product and learn about your users? • Dave McClure’s AARRR model provides 5 useful metrics to learning about your product and how it is used Reference: dave McClure, 500 startups. Picture courtesy of walt Disney pictures
  • 6. THE AARRR MODEL Reference: dave McClure, 500 startups
  • 7. FUNNEL ANALYSIS • A funnel of steps that a user go through before meeting a goal, for example – Steps leading to contacting the company – Steps leading to purchasing the product – Steps leading to purchasing in-app modules/features – Steps leading to purchasing merchandise or tokens (for games( • Funnel analysis = understanding conversions • A step in a funnel = a page view (web) = a screen or action (mobile app)
  • 8. WEB VS MOBILE WEB MOBILE APP Session tracking done primarily thru Session tracking done primarily thru cookies and Javascript UDID Human user interface is keyboard and Human user interface is gestural and mouse based touch-based Web measurement model is centered Measurement model is less about around page views, referrals, search, referrals and search and visits Unique visitors are measured Unique visitors are tied to individual or differently because of gateway IPs of server IP addresses carriers
  • 9. SOLUTIONS • Flurry – http://flurry.com/ • Localytics – http://localytics.com/ • Webtrends – http://webtrends.com/products/analytics/mobile/ • AppClix – http://www.appclix.com/ • Kontagent – http://kontagent.com/ • Bango – http://bango.com/ • Apsalar – http://apsalar.com/ • Claritics – http://claritics.com/ • Others that we may have missed…
  • 10. MOBILE METRICS CATEGORIES • Application • Content • User Behavior • People/Location • Technical
  • 11. COMMON MOBILE METRICS 1 • Applications • Content – #Downloads – Screens – Conversions – Visits, unique visits (Monetization) – In-app – Engagement/loyalty – Ads (over time) – Links – User acquisition – Other events – User retention – Cohort analysis (retention, engagement, monetization)
  • 12. COMMON MOBILE METRICS 2 • User Behavior • People/Location – Screen flow (useful for – Users navigation and usability) – Social identity – Exits (how users are – Countries/Regions exiting an app) – Languages – Sessions – Marketplaces (length, frequency, type of users) – Carriers – Age
  • 13. COMMON MOBILE METRICS 3 • Technical – Errors – Devices – Operating systems – App Versions – Connections
  • 14. REPORT TERMINOLOGY • Common report terminology • Example: Breakdown of OS versions used to run the app FILTER: Time Duration DIMENSION: OS Version METRIC: Session Reference: Localytics report
  • 15. STRATEGIES • Define a few funnels to understand how user usage drives towards a goal like registration, purchase • If possible apply some of the advanced tracking and reporting features in the analytics tool to provide deeper insights – Filters (at the log and report levels) – Funnel analysis – Profiling • Keep refining how metrics are tracked
  • 16. EVENT TAGGING • Data collection • Mapping: Actions » Events » Metrics • Need to define events to tag so that we can measure the metrics • Example: – Start Time = Time when a player starts playing a game – End Time = Time when a player ends a game – Defines the names for both events
  • 17. Questions? Picture: Sean Dreilinger - http://www.flickr.com/photos/seandreilinger/2326448445/in/photostream/