SlideShare una empresa de Scribd logo
1 de 18
Descargar para leer sin conexión
7 Tips for Optimizing Mobile App
Experience Metrics

Rob Kwok, Co-Founder & CTO
“
©2016 Copyright Apteligent
Our busiest branch in 2014 is the 7:01 from Reading
to Paddington – over 167,000 of our customers use
our Mobile Banking app between 7am and 8am on their
commute to work every day.
Ross McEwan
CEO
Royal Bank of
Scotland
Mobile is About Delivering Great Micro-Moments
Delivering the best user experience regardless of location, motion, proximity, time, and speed –
at all times, under all conditions
“
©2016 Copyright Apteligent
It took one day to lose a star and 6 months to get it back.
Mobile PM
Major News
Service
There’s No Margin for Error on Mobile
Getting mobile wrong is hazardous for your business.
•  30% of consumers indicate that they will consider leaving a brand due "
to a poor app experience 
•  51% of consumers believe mobile should be easier than web
•  70% of millennials will critique an app based on their experience 

Source: Apteligent Data
©2016 Copyright Apteligent
Typical Bad User Experiences on Mobile Apps
Transaction
Failure
 Slow apps
Crashes
Network"
Services Error
©2016 Copyright Apteligent
User-Centered Metrics are Critical for Reputation, Retention, and
Monetization
It took one day to lose
a star and 6 months to
get it back
Mobile PM
Major News
Service
 “ •  Slow load times
•  Crashes
•  Freezes
•  Failed transactions
•  Sluggish response
”
©2016 Copyright Apteligent
The “Hierarchy of Abandonment”
Think About Customer Experience from Your User’s Perspective


•  The app crashes or freezes
•  Broken features
•  App takes forever to load
•  Waiting constantly
•  App drains my battery
•  App kills my data plan
FAILURE
FRUSTRATION
ANNOYANCE
©2016 Copyright Apteligent
Prioritize Crashes by Number of Affected Users
Avoid Failure – Tip #1: Fix the Top 10 Crashes Every Sprint
•  The best apps have crash rates of less than 0.25%
•  75% of apps across iOS & Android platforms do not meet this standard1

data.apteligent.com
1Source: https://data.apteligent.com/ios/benchmarks/global
https://data.apteligent.com/android/benchmarks/global
©2016 Copyright Apteligent
Prioritize Crashes Failing Your Most Critical Users
Avoid Failure – Tip #2: Fix Crashes in Critical Userflows
1.  Identify the three most important
User Flows in your app
•  e.g., Login, New Account Registration,
In-App Purchase
2.  Fix the top crashes affecting critical
User Flows each sprint
3.  Maintain a crash rate < 0.25% in
your most critical User Flows
©2016 Copyright Apteligent
How do your apps stack up to competitors and your users’ expectations?
Prevent Frustration – Tip #3: App Should Load in Less Than 2 Seconds
… Just to be Average
•  50% of consumers consider app load time
a major source of frustration
-  25% would leave a brand for unacceptable load
times
•  46% of iOS apps and 53% of Android
apps globally, across all categories, take
more than 2 seconds to load2
0	
  
10	
  
20	
  
30	
  
40	
  
50	
  
200	
   300	
   400	
   500	
   600	
   700	
   800	
   900	
   1000	
   2000	
  >2000	
  
%	
  of	
  iOS	
  Apps	
  Load	
  Time	
  (mS)	
  
0	
  
10	
  
20	
  
30	
  
40	
  
50	
  
60	
  
200	
   300	
   400	
   500	
   600	
   700	
   800	
   900	
   1000	
   2000	
   >2000	
  
%	
  of	
  Android	
  Apps	
  with	
  Load	
  Time	
  (mS)	
  
2Source: data.apteligent.com
©2016 Copyright Apteligent
Suggested Metrics for High Performance Apps
Prevent Frustration – Tip #4: Interactions Should Take < 1 Seconds
Userflow User Expectation Time
App load (time to availability of first
user-interaction)
App is “working” 1.0 s
Login (not including data entry) App is “working” 1.0 s
Registration (not including data entry) App is “working” 1.0 s
Search App is “working” 1.0 s
Screen transitions Immediate 0.1 s
Browse Immediate 0.1 s
Add to shopping cart Immediate 0.1 s
Check-out App is “working” 1.0 s
Locate (e.g. locate store) App is “working” 1.0 s
Barcode scan App is “working” 1.0 s
Human computer interaction
research shows if a user expects3: 
•  an operation to be instantaneous, then
it should take no more than 0.1 second
•  the app to be “working” then the operation
should take no more than
1.0 seconds
3Powers of 10: Time Scales in User Experience, Jakob Nielsen
©2016 Copyright Apteligent
Monitor the latency of network calls that cause the user to wait
Prevent Frustration – Tip #5: Monitor Important Network Calls
1.  Monitor the three most important Userflows in your app
2.  Time how long they take to complete
3.  Identify network calls that each Userflow depends on
4.  Monitor the latency and error rate of each call
-  Latency < 1 second
-  Error Rate < 0.25%
©2016 Copyright Apteligent
Ensure Your Users Don’t Uninstall Your App
Avert Annoyance: Tip #6: Measure Data and Battery Usage
•  Request Volume
- Monitor increased network calls due to new SDKs
•  Data Received and Sent
- Monitor the amount of data your app sends and
receives with each new version and with the addition
of new SDKs
•  Don’t be a “Battery Killer”
- Monitor battery drain
©2016 Copyright Apteligent
Stay On Top of Every OS Release, Every App Release
Tip #7: Monitor Your Performance Metrics – Over Time and Per Release
•  Track your app metrics release over
release, across internal infrastructure
changes (internal API and back-end
services), and across major ecosystems
events (e.g., OS version releases). 
•  A historical view of 30 to 90 days will
enable you to fill in the critical “why” to
the changes you measure (both positive
and negative), in the “what” of your key
business KPIs.
©2016 Copyright Apteligent 14
Key Metrics and their Targets
To Sum Up: Your Critical Mobile Metrics
•  Avoid Failures
-  Overall Crash Rate < 0.25%
-  Crash Rate of Critical Userflows (e.g., “Login”) < 0.25%
•  Prevent Frustration
-  App Load Time < 2 seconds (to meet the industry, < 1 second to excel)
-  Critical Userflows < 1 second
-  Userflow Dependent APIs: < 1 second latency, < 0.25% error rate
•  Avert Annoyance
-  Monitor Request Volume, Data Sent/Received, and Battery Impact
©2016 Copyright Apteligent 15
Measure metrics from the Customer’s perspective
Final Considerations
•  At a bare minimum monitor for app “Failures” like crashes, hangs and exceptions. 
•  Monitor the time it takes to access the visible and important user flows (how customers
typically journey through your app). Address “Frustration” and “Annoyance” issues. 
•  App load time is key user flow because it has a direct connection to your business result
though your abandonment KPI.
•  To set app metric targets, recognize the insights of human perception research, and set
metrics to meet or exceed your users’ built-in timing expectations. 
•  Track both the duration of the user flow and the latency and error rates of the underlying
network calls over time and between app releases.
©2016 Copyright Apteligent
Build better, Acquire More, Engage Deeper, Monetize Faster
Great Mobile Teams Have Both Vision And Visibility
Apteligent delivers user-centered metrics – helping mobile
teams prioritize app issues, focus on new feature
development, and deliver the best possible user experience.
	
  
The “why” behind the “what”
©2016 Copyright Apteligent
Build Better, Acquire More, Engage Deeper, Monetize Faster
Apteligent: Real. Enterprise. Mobility
Apteligent provides tools that empower mobile developers and product managers to
troubleshoot, prioritize, and resolve issues that damage their users’ app experience. 
•  Developers get detailed, real-time information to find and resolve crashes, freezes, and
issues in key user flows.
•  Product managers and KPI owners get global mobile industry and competitive insight to
better plan and focus their mobile initiatives, as well as real-time visibility to app metrics that
enable rapid issue detection, prioritization, and release-over-release app improvement.
©2016 Copyright Apteligent
Thank You!
www.apteligent.com
@robkwok

Más contenido relacionado

La actualidad más candente

Intro To Mobile Analytics
Intro To Mobile AnalyticsIntro To Mobile Analytics
Intro To Mobile AnalyticsTapmint
 
AWS August Webinar Series - Analyze Mobile App Data and Build Predictive Appl...
AWS August Webinar Series - Analyze Mobile App Data and Build Predictive Appl...AWS August Webinar Series - Analyze Mobile App Data and Build Predictive Appl...
AWS August Webinar Series - Analyze Mobile App Data and Build Predictive Appl...Amazon Web Services
 
Appknox Enterprise Offerings
Appknox Enterprise OfferingsAppknox Enterprise Offerings
Appknox Enterprise OfferingsAppknox
 
How Urban Outfitters Supercharged Their Sales and Mobile Initiatives with Cri...
How Urban Outfitters Supercharged Their Sales and Mobile Initiatives with Cri...How Urban Outfitters Supercharged Their Sales and Mobile Initiatives with Cri...
How Urban Outfitters Supercharged Their Sales and Mobile Initiatives with Cri...CrittercismAPM
 
Mobile App Tracking - How it Works
Mobile App Tracking - How it WorksMobile App Tracking - How it Works
Mobile App Tracking - How it WorksMobileAppTracking
 
Practical Tips for Ops: End User Monitoring
Practical Tips for Ops: End User MonitoringPractical Tips for Ops: End User Monitoring
Practical Tips for Ops: End User MonitoringDynatrace
 
Making the Business Case: How App Performance Impacts Return on Investment
Making the Business Case: How App Performance Impacts Return on InvestmentMaking the Business Case: How App Performance Impacts Return on Investment
Making the Business Case: How App Performance Impacts Return on Investmentkwicr
 
Mo Z Zapp
Mo Z ZappMo Z Zapp
Mo Z Zappjakesb
 
Digital media analytics: web, mobile analytics - Ahmad Abdullah - Google
Digital media analytics: web, mobile analytics - Ahmad Abdullah - GoogleDigital media analytics: web, mobile analytics - Ahmad Abdullah - Google
Digital media analytics: web, mobile analytics - Ahmad Abdullah - GoogleJigserv Digital
 
Disrupt for Digital Transformation
Disrupt for Digital Transformation Disrupt for Digital Transformation
Disrupt for Digital Transformation JoAnna Cheshire
 
Mobile App Analytics. Why, How, What's new - Mar 2019
Mobile App Analytics. Why, How, What's new - Mar 2019Mobile App Analytics. Why, How, What's new - Mar 2019
Mobile App Analytics. Why, How, What's new - Mar 2019Dmitry Klymenko
 
Yandex Metrica for Apps – Understanding your app stats
Yandex Metrica for Apps – Understanding your app statsYandex Metrica for Apps – Understanding your app stats
Yandex Metrica for Apps – Understanding your app statsalexandrok
 
UX & FinTech: 3 Ideas to Focus On
UX & FinTech: 3 Ideas to Focus OnUX & FinTech: 3 Ideas to Focus On
UX & FinTech: 3 Ideas to Focus OnCode & Pepper
 
Do's & Don'ts of Stellar Push & In-App Marketing Campaigns
Do's & Don'ts of Stellar Push & In-App Marketing CampaignsDo's & Don'ts of Stellar Push & In-App Marketing Campaigns
Do's & Don'ts of Stellar Push & In-App Marketing CampaignsLocalytics
 
Designing Mobile Apps for the Enterprise
Designing Mobile Apps for the EnterpriseDesigning Mobile Apps for the Enterprise
Designing Mobile Apps for the EnterpriseChristian Santiago
 

La actualidad más candente (20)

The Four Sources of Mobile App ROI
The Four Sources of Mobile App ROIThe Four Sources of Mobile App ROI
The Four Sources of Mobile App ROI
 
Intro To Mobile Analytics
Intro To Mobile AnalyticsIntro To Mobile Analytics
Intro To Mobile Analytics
 
AWS August Webinar Series - Analyze Mobile App Data and Build Predictive Appl...
AWS August Webinar Series - Analyze Mobile App Data and Build Predictive Appl...AWS August Webinar Series - Analyze Mobile App Data and Build Predictive Appl...
AWS August Webinar Series - Analyze Mobile App Data and Build Predictive Appl...
 
Appknox Enterprise Offerings
Appknox Enterprise OfferingsAppknox Enterprise Offerings
Appknox Enterprise Offerings
 
How Urban Outfitters Supercharged Their Sales and Mobile Initiatives with Cri...
How Urban Outfitters Supercharged Their Sales and Mobile Initiatives with Cri...How Urban Outfitters Supercharged Their Sales and Mobile Initiatives with Cri...
How Urban Outfitters Supercharged Their Sales and Mobile Initiatives with Cri...
 
Mobile App Tracking - How it Works
Mobile App Tracking - How it WorksMobile App Tracking - How it Works
Mobile App Tracking - How it Works
 
Practical Tips for Ops: End User Monitoring
Practical Tips for Ops: End User MonitoringPractical Tips for Ops: End User Monitoring
Practical Tips for Ops: End User Monitoring
 
Making the Business Case: How App Performance Impacts Return on Investment
Making the Business Case: How App Performance Impacts Return on InvestmentMaking the Business Case: How App Performance Impacts Return on Investment
Making the Business Case: How App Performance Impacts Return on Investment
 
Mo Z Zapp
Mo Z ZappMo Z Zapp
Mo Z Zapp
 
Digital media analytics: web, mobile analytics - Ahmad Abdullah - Google
Digital media analytics: web, mobile analytics - Ahmad Abdullah - GoogleDigital media analytics: web, mobile analytics - Ahmad Abdullah - Google
Digital media analytics: web, mobile analytics - Ahmad Abdullah - Google
 
Adoption_Show
Adoption_ShowAdoption_Show
Adoption_Show
 
Disrupt for Digital Transformation
Disrupt for Digital Transformation Disrupt for Digital Transformation
Disrupt for Digital Transformation
 
Mobile Analytics 101
Mobile Analytics 101Mobile Analytics 101
Mobile Analytics 101
 
Mobile App Analytics. Why, How, What's new - Mar 2019
Mobile App Analytics. Why, How, What's new - Mar 2019Mobile App Analytics. Why, How, What's new - Mar 2019
Mobile App Analytics. Why, How, What's new - Mar 2019
 
Understanding your app stats
Understanding your app statsUnderstanding your app stats
Understanding your app stats
 
Yandex Metrica for Apps – Understanding your app stats
Yandex Metrica for Apps – Understanding your app statsYandex Metrica for Apps – Understanding your app stats
Yandex Metrica for Apps – Understanding your app stats
 
Apps vs-mobile-theme-2
Apps vs-mobile-theme-2Apps vs-mobile-theme-2
Apps vs-mobile-theme-2
 
UX & FinTech: 3 Ideas to Focus On
UX & FinTech: 3 Ideas to Focus OnUX & FinTech: 3 Ideas to Focus On
UX & FinTech: 3 Ideas to Focus On
 
Do's & Don'ts of Stellar Push & In-App Marketing Campaigns
Do's & Don'ts of Stellar Push & In-App Marketing CampaignsDo's & Don'ts of Stellar Push & In-App Marketing Campaigns
Do's & Don'ts of Stellar Push & In-App Marketing Campaigns
 
Designing Mobile Apps for the Enterprise
Designing Mobile Apps for the EnterpriseDesigning Mobile Apps for the Enterprise
Designing Mobile Apps for the Enterprise
 

Similar a 7 Tips for Optimizing Mobile App Metrics

Thriving in the Mobile App Economy: Mobility Market Overview & Strategy
Thriving in the Mobile App Economy: Mobility Market Overview & StrategyThriving in the Mobile App Economy: Mobility Market Overview & Strategy
Thriving in the Mobile App Economy: Mobility Market Overview & StrategyCA Technologies
 
"Mobile Apps, beyond downloads, what’s next?" by Philippe Dumont
"Mobile Apps, beyond downloads, what’s next?" by Philippe Dumont"Mobile Apps, beyond downloads, what’s next?" by Philippe Dumont
"Mobile Apps, beyond downloads, what’s next?" by Philippe DumontTheFamily
 
APM Talk
APM TalkAPM Talk
APM TalkMongoDB
 
Mobile App User Experience Myths, Debunked
Mobile App User Experience Myths, DebunkedMobile App User Experience Myths, Debunked
Mobile App User Experience Myths, DebunkedApteligent
 
Entreprise mobility approach within digital transformation
Entreprise mobility approach within digital transformationEntreprise mobility approach within digital transformation
Entreprise mobility approach within digital transformationmoldovaictsummit2016
 
CA Mobile Application Analytics - Julio 2015
CA Mobile Application Analytics - Julio 2015CA Mobile Application Analytics - Julio 2015
CA Mobile Application Analytics - Julio 2015Fernando Bianchi
 
[TTT Meetup] Enhance mobile app testing with performance-centric strategies (...
[TTT Meetup] Enhance mobile app testing with performance-centric strategies (...[TTT Meetup] Enhance mobile app testing with performance-centric strategies (...
[TTT Meetup] Enhance mobile app testing with performance-centric strategies (...NITHIN S.S
 
How to optimize app performance and reduce app crashes.pdf
How to optimize app performance and reduce app crashes.pdfHow to optimize app performance and reduce app crashes.pdf
How to optimize app performance and reduce app crashes.pdfSparity1
 
How to improve your application performance
How to improve your application performanceHow to improve your application performance
How to improve your application performanceAndolasoft Inc
 
11 Mobile App Retention Strategies for 2016
11 Mobile App Retention Strategies for 201611 Mobile App Retention Strategies for 2016
11 Mobile App Retention Strategies for 2016TechAhead
 
Progressive Web App
Progressive Web AppProgressive Web App
Progressive Web AppSubodh Garg
 
Strategies to improve the ROI on your enterprise application
Strategies to improve the ROI on your enterprise applicationStrategies to improve the ROI on your enterprise application
Strategies to improve the ROI on your enterprise applicationPixel Crayons
 
Take Control of Application Performance
Take Control of Application PerformanceTake Control of Application Performance
Take Control of Application PerformanceRiverbed Technology
 
APM for Enterprise WhitePaper from New Relic
APM for Enterprise WhitePaper from New RelicAPM for Enterprise WhitePaper from New Relic
APM for Enterprise WhitePaper from New RelicNew Relic
 
5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing StrategySOASTA
 
Do You Really Need an App for that by Garry Partington
Do You Really Need an App for that by Garry Partington   Do You Really Need an App for that by Garry Partington
Do You Really Need an App for that by Garry Partington DigitalMarketingShow
 
CA Technologies Survive and Thrive in the Application Economy- August 2014
CA Technologies   Survive and Thrive in the Application Economy- August 2014CA Technologies   Survive and Thrive in the Application Economy- August 2014
CA Technologies Survive and Thrive in the Application Economy- August 2014JAX Chamber IT Council
 

Similar a 7 Tips for Optimizing Mobile App Metrics (20)

CA Mobile App Analytics
CA Mobile App Analytics CA Mobile App Analytics
CA Mobile App Analytics
 
Thriving in the Mobile App Economy: Mobility Market Overview & Strategy
Thriving in the Mobile App Economy: Mobility Market Overview & StrategyThriving in the Mobile App Economy: Mobility Market Overview & Strategy
Thriving in the Mobile App Economy: Mobility Market Overview & Strategy
 
"Mobile Apps, beyond downloads, what’s next?" by Philippe Dumont
"Mobile Apps, beyond downloads, what’s next?" by Philippe Dumont"Mobile Apps, beyond downloads, what’s next?" by Philippe Dumont
"Mobile Apps, beyond downloads, what’s next?" by Philippe Dumont
 
APM Talk
APM TalkAPM Talk
APM Talk
 
Mobile App User Experience Myths, Debunked
Mobile App User Experience Myths, DebunkedMobile App User Experience Myths, Debunked
Mobile App User Experience Myths, Debunked
 
Entreprise mobility approach within digital transformation
Entreprise mobility approach within digital transformationEntreprise mobility approach within digital transformation
Entreprise mobility approach within digital transformation
 
CA Mobile Application Analytics - Julio 2015
CA Mobile Application Analytics - Julio 2015CA Mobile Application Analytics - Julio 2015
CA Mobile Application Analytics - Julio 2015
 
[TTT Meetup] Enhance mobile app testing with performance-centric strategies (...
[TTT Meetup] Enhance mobile app testing with performance-centric strategies (...[TTT Meetup] Enhance mobile app testing with performance-centric strategies (...
[TTT Meetup] Enhance mobile app testing with performance-centric strategies (...
 
How to optimize app performance and reduce app crashes.pdf
How to optimize app performance and reduce app crashes.pdfHow to optimize app performance and reduce app crashes.pdf
How to optimize app performance and reduce app crashes.pdf
 
How to improve your application performance
How to improve your application performanceHow to improve your application performance
How to improve your application performance
 
11 Mobile App Retention Strategies for 2016
11 Mobile App Retention Strategies for 201611 Mobile App Retention Strategies for 2016
11 Mobile App Retention Strategies for 2016
 
Progressive Web App
Progressive Web AppProgressive Web App
Progressive Web App
 
Strategies to improve the ROI on your enterprise application
Strategies to improve the ROI on your enterprise applicationStrategies to improve the ROI on your enterprise application
Strategies to improve the ROI on your enterprise application
 
12 top app testing tools
12 top app testing tools12 top app testing tools
12 top app testing tools
 
10 Tips to Guard Your Network during March Madness
10 Tips to Guard Your Network during March Madness10 Tips to Guard Your Network during March Madness
10 Tips to Guard Your Network during March Madness
 
Take Control of Application Performance
Take Control of Application PerformanceTake Control of Application Performance
Take Control of Application Performance
 
APM for Enterprise WhitePaper from New Relic
APM for Enterprise WhitePaper from New RelicAPM for Enterprise WhitePaper from New Relic
APM for Enterprise WhitePaper from New Relic
 
5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy
 
Do You Really Need an App for that by Garry Partington
Do You Really Need an App for that by Garry Partington   Do You Really Need an App for that by Garry Partington
Do You Really Need an App for that by Garry Partington
 
CA Technologies Survive and Thrive in the Application Economy- August 2014
CA Technologies   Survive and Thrive in the Application Economy- August 2014CA Technologies   Survive and Thrive in the Application Economy- August 2014
CA Technologies Survive and Thrive in the Application Economy- August 2014
 

Más de Apteligent

Harnessing Data to Reduce User Churn
Harnessing Data to Reduce User ChurnHarnessing Data to Reduce User Churn
Harnessing Data to Reduce User ChurnApteligent
 
Apteligent - Choosing the Right SDKs to Optimize App Performance
Apteligent - Choosing the Right SDKs to Optimize App PerformanceApteligent - Choosing the Right SDKs to Optimize App Performance
Apteligent - Choosing the Right SDKs to Optimize App PerformanceApteligent
 
Apteligent Data Report Google IO Edition
Apteligent Data Report Google IO EditionApteligent Data Report Google IO Edition
Apteligent Data Report Google IO EditionApteligent
 
Apteligent Data Report iOS 9.3 Edition
Apteligent Data Report iOS 9.3 EditionApteligent Data Report iOS 9.3 Edition
Apteligent Data Report iOS 9.3 EditionApteligent
 
50 Beautifully Designed Apple Watch Apps
50 Beautifully Designed Apple Watch Apps50 Beautifully Designed Apple Watch Apps
50 Beautifully Designed Apple Watch AppsApteligent
 
State of Mobile Benchmark Report - MWC 2015 Edition
State of Mobile Benchmark Report -  MWC 2015 EditionState of Mobile Benchmark Report -  MWC 2015 Edition
State of Mobile Benchmark Report - MWC 2015 EditionApteligent
 
Accenture Digital: iOS 8 What You Need to Know
Accenture Digital: iOS 8 What You Need to KnowAccenture Digital: iOS 8 What You Need to Know
Accenture Digital: iOS 8 What You Need to KnowApteligent
 
Apple Edition: iOS Mobile Experience Report
Apple Edition: iOS Mobile Experience ReportApple Edition: iOS Mobile Experience Report
Apple Edition: iOS Mobile Experience ReportApteligent
 
50 Connected Devices - How Mobile and the Internet of Things Will Affect You
50 Connected Devices - How Mobile and the Internet of Things Will Affect You50 Connected Devices - How Mobile and the Internet of Things Will Affect You
50 Connected Devices - How Mobile and the Internet of Things Will Affect YouApteligent
 
Samsung Android Crash & Performance Analysis
Samsung Android Crash & Performance AnalysisSamsung Android Crash & Performance Analysis
Samsung Android Crash & Performance AnalysisApteligent
 
testCloud & Crittercism: How to Continuously Ensure Mobile App Quality
testCloud & Crittercism: How to Continuously Ensure Mobile App QualitytestCloud & Crittercism: How to Continuously Ensure Mobile App Quality
testCloud & Crittercism: How to Continuously Ensure Mobile App QualityApteligent
 
WEBINAR: HOW URBAN OUTFITTERS MADE A 7X IMPROVEMENT IN THEIR MOBILE APP PERFO...
WEBINAR: HOW URBAN OUTFITTERS MADE A 7X IMPROVEMENT IN THEIR MOBILE APP PERFO...WEBINAR: HOW URBAN OUTFITTERS MADE A 7X IMPROVEMENT IN THEIR MOBILE APP PERFO...
WEBINAR: HOW URBAN OUTFITTERS MADE A 7X IMPROVEMENT IN THEIR MOBILE APP PERFO...Apteligent
 
Getting to Mobile First: 5 Numbers to Consider!
Getting to Mobile First: 5 Numbers to Consider!Getting to Mobile First: 5 Numbers to Consider!
Getting to Mobile First: 5 Numbers to Consider!Apteligent
 
Crittercism Droidcon Berlin 2012
Crittercism Droidcon Berlin 2012Crittercism Droidcon Berlin 2012
Crittercism Droidcon Berlin 2012Apteligent
 

Más de Apteligent (15)

Harnessing Data to Reduce User Churn
Harnessing Data to Reduce User ChurnHarnessing Data to Reduce User Churn
Harnessing Data to Reduce User Churn
 
Apteligent - Choosing the Right SDKs to Optimize App Performance
Apteligent - Choosing the Right SDKs to Optimize App PerformanceApteligent - Choosing the Right SDKs to Optimize App Performance
Apteligent - Choosing the Right SDKs to Optimize App Performance
 
Apteligent Data Report Google IO Edition
Apteligent Data Report Google IO EditionApteligent Data Report Google IO Edition
Apteligent Data Report Google IO Edition
 
Apteligent Data Report iOS 9.3 Edition
Apteligent Data Report iOS 9.3 EditionApteligent Data Report iOS 9.3 Edition
Apteligent Data Report iOS 9.3 Edition
 
50 Beautifully Designed Apple Watch Apps
50 Beautifully Designed Apple Watch Apps50 Beautifully Designed Apple Watch Apps
50 Beautifully Designed Apple Watch Apps
 
State of Mobile Benchmark Report - MWC 2015 Edition
State of Mobile Benchmark Report -  MWC 2015 EditionState of Mobile Benchmark Report -  MWC 2015 Edition
State of Mobile Benchmark Report - MWC 2015 Edition
 
Accenture Digital: iOS 8 What You Need to Know
Accenture Digital: iOS 8 What You Need to KnowAccenture Digital: iOS 8 What You Need to Know
Accenture Digital: iOS 8 What You Need to Know
 
Apple Edition: iOS Mobile Experience Report
Apple Edition: iOS Mobile Experience ReportApple Edition: iOS Mobile Experience Report
Apple Edition: iOS Mobile Experience Report
 
50 Connected Devices - How Mobile and the Internet of Things Will Affect You
50 Connected Devices - How Mobile and the Internet of Things Will Affect You50 Connected Devices - How Mobile and the Internet of Things Will Affect You
50 Connected Devices - How Mobile and the Internet of Things Will Affect You
 
Mobile DevOps
Mobile DevOpsMobile DevOps
Mobile DevOps
 
Samsung Android Crash & Performance Analysis
Samsung Android Crash & Performance AnalysisSamsung Android Crash & Performance Analysis
Samsung Android Crash & Performance Analysis
 
testCloud & Crittercism: How to Continuously Ensure Mobile App Quality
testCloud & Crittercism: How to Continuously Ensure Mobile App QualitytestCloud & Crittercism: How to Continuously Ensure Mobile App Quality
testCloud & Crittercism: How to Continuously Ensure Mobile App Quality
 
WEBINAR: HOW URBAN OUTFITTERS MADE A 7X IMPROVEMENT IN THEIR MOBILE APP PERFO...
WEBINAR: HOW URBAN OUTFITTERS MADE A 7X IMPROVEMENT IN THEIR MOBILE APP PERFO...WEBINAR: HOW URBAN OUTFITTERS MADE A 7X IMPROVEMENT IN THEIR MOBILE APP PERFO...
WEBINAR: HOW URBAN OUTFITTERS MADE A 7X IMPROVEMENT IN THEIR MOBILE APP PERFO...
 
Getting to Mobile First: 5 Numbers to Consider!
Getting to Mobile First: 5 Numbers to Consider!Getting to Mobile First: 5 Numbers to Consider!
Getting to Mobile First: 5 Numbers to Consider!
 
Crittercism Droidcon Berlin 2012
Crittercism Droidcon Berlin 2012Crittercism Droidcon Berlin 2012
Crittercism Droidcon Berlin 2012
 

Último

BDSM⚡Call Girls in Sector 71 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 71 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 71 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 71 Noida Escorts >༒8448380779 Escort ServiceDelhi Call girls
 
Powerful Love Spells in Arkansas, AR (310) 882-6330 Bring Back Lost Lover
Powerful Love Spells in Arkansas, AR (310) 882-6330 Bring Back Lost LoverPowerful Love Spells in Arkansas, AR (310) 882-6330 Bring Back Lost Lover
Powerful Love Spells in Arkansas, AR (310) 882-6330 Bring Back Lost LoverPsychicRuben LoveSpells
 
CALL ON ➥8923113531 🔝Call Girls Saharaganj Lucknow best sexual service
CALL ON ➥8923113531 🔝Call Girls Saharaganj Lucknow best sexual serviceCALL ON ➥8923113531 🔝Call Girls Saharaganj Lucknow best sexual service
CALL ON ➥8923113531 🔝Call Girls Saharaganj Lucknow best sexual serviceanilsa9823
 
Call US Pooja 9892124323 ✓Call Girls In Mira Road ( Mumbai ) secure service,
Call US Pooja 9892124323 ✓Call Girls In Mira Road ( Mumbai ) secure service,Call US Pooja 9892124323 ✓Call Girls In Mira Road ( Mumbai ) secure service,
Call US Pooja 9892124323 ✓Call Girls In Mira Road ( Mumbai ) secure service,Pooja Nehwal
 
CALL ON ➥8923113531 🔝Call Girls Gomti Nagar Lucknow best Night Fun service
CALL ON ➥8923113531 🔝Call Girls Gomti Nagar Lucknow best Night Fun serviceCALL ON ➥8923113531 🔝Call Girls Gomti Nagar Lucknow best Night Fun service
CALL ON ➥8923113531 🔝Call Girls Gomti Nagar Lucknow best Night Fun serviceanilsa9823
 
FULL ENJOY - 9999218229 Call Girls in {Mahipalpur}| Delhi NCR
FULL ENJOY - 9999218229 Call Girls in {Mahipalpur}| Delhi NCRFULL ENJOY - 9999218229 Call Girls in {Mahipalpur}| Delhi NCR
FULL ENJOY - 9999218229 Call Girls in {Mahipalpur}| Delhi NCRnishacall1
 
9892124323 | Book Call Girls in Juhu and escort services 24x7
9892124323 | Book Call Girls in Juhu and escort services 24x79892124323 | Book Call Girls in Juhu and escort services 24x7
9892124323 | Book Call Girls in Juhu and escort services 24x7Pooja Nehwal
 

Último (7)

BDSM⚡Call Girls in Sector 71 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 71 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 71 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 71 Noida Escorts >༒8448380779 Escort Service
 
Powerful Love Spells in Arkansas, AR (310) 882-6330 Bring Back Lost Lover
Powerful Love Spells in Arkansas, AR (310) 882-6330 Bring Back Lost LoverPowerful Love Spells in Arkansas, AR (310) 882-6330 Bring Back Lost Lover
Powerful Love Spells in Arkansas, AR (310) 882-6330 Bring Back Lost Lover
 
CALL ON ➥8923113531 🔝Call Girls Saharaganj Lucknow best sexual service
CALL ON ➥8923113531 🔝Call Girls Saharaganj Lucknow best sexual serviceCALL ON ➥8923113531 🔝Call Girls Saharaganj Lucknow best sexual service
CALL ON ➥8923113531 🔝Call Girls Saharaganj Lucknow best sexual service
 
Call US Pooja 9892124323 ✓Call Girls In Mira Road ( Mumbai ) secure service,
Call US Pooja 9892124323 ✓Call Girls In Mira Road ( Mumbai ) secure service,Call US Pooja 9892124323 ✓Call Girls In Mira Road ( Mumbai ) secure service,
Call US Pooja 9892124323 ✓Call Girls In Mira Road ( Mumbai ) secure service,
 
CALL ON ➥8923113531 🔝Call Girls Gomti Nagar Lucknow best Night Fun service
CALL ON ➥8923113531 🔝Call Girls Gomti Nagar Lucknow best Night Fun serviceCALL ON ➥8923113531 🔝Call Girls Gomti Nagar Lucknow best Night Fun service
CALL ON ➥8923113531 🔝Call Girls Gomti Nagar Lucknow best Night Fun service
 
FULL ENJOY - 9999218229 Call Girls in {Mahipalpur}| Delhi NCR
FULL ENJOY - 9999218229 Call Girls in {Mahipalpur}| Delhi NCRFULL ENJOY - 9999218229 Call Girls in {Mahipalpur}| Delhi NCR
FULL ENJOY - 9999218229 Call Girls in {Mahipalpur}| Delhi NCR
 
9892124323 | Book Call Girls in Juhu and escort services 24x7
9892124323 | Book Call Girls in Juhu and escort services 24x79892124323 | Book Call Girls in Juhu and escort services 24x7
9892124323 | Book Call Girls in Juhu and escort services 24x7
 

7 Tips for Optimizing Mobile App Metrics

  • 1. 7 Tips for Optimizing Mobile App Experience Metrics Rob Kwok, Co-Founder & CTO
  • 2. “ ©2016 Copyright Apteligent Our busiest branch in 2014 is the 7:01 from Reading to Paddington – over 167,000 of our customers use our Mobile Banking app between 7am and 8am on their commute to work every day. Ross McEwan CEO Royal Bank of Scotland Mobile is About Delivering Great Micro-Moments Delivering the best user experience regardless of location, motion, proximity, time, and speed – at all times, under all conditions
  • 3. “ ©2016 Copyright Apteligent It took one day to lose a star and 6 months to get it back. Mobile PM Major News Service There’s No Margin for Error on Mobile Getting mobile wrong is hazardous for your business. •  30% of consumers indicate that they will consider leaving a brand due " to a poor app experience •  51% of consumers believe mobile should be easier than web •  70% of millennials will critique an app based on their experience Source: Apteligent Data
  • 4. ©2016 Copyright Apteligent Typical Bad User Experiences on Mobile Apps Transaction Failure Slow apps Crashes Network" Services Error
  • 5. ©2016 Copyright Apteligent User-Centered Metrics are Critical for Reputation, Retention, and Monetization It took one day to lose a star and 6 months to get it back Mobile PM Major News Service “ •  Slow load times •  Crashes •  Freezes •  Failed transactions •  Sluggish response ”
  • 6. ©2016 Copyright Apteligent The “Hierarchy of Abandonment” Think About Customer Experience from Your User’s Perspective •  The app crashes or freezes •  Broken features •  App takes forever to load •  Waiting constantly •  App drains my battery •  App kills my data plan FAILURE FRUSTRATION ANNOYANCE
  • 7. ©2016 Copyright Apteligent Prioritize Crashes by Number of Affected Users Avoid Failure – Tip #1: Fix the Top 10 Crashes Every Sprint •  The best apps have crash rates of less than 0.25% •  75% of apps across iOS & Android platforms do not meet this standard1 data.apteligent.com 1Source: https://data.apteligent.com/ios/benchmarks/global https://data.apteligent.com/android/benchmarks/global
  • 8. ©2016 Copyright Apteligent Prioritize Crashes Failing Your Most Critical Users Avoid Failure – Tip #2: Fix Crashes in Critical Userflows 1.  Identify the three most important User Flows in your app •  e.g., Login, New Account Registration, In-App Purchase 2.  Fix the top crashes affecting critical User Flows each sprint 3.  Maintain a crash rate < 0.25% in your most critical User Flows
  • 9. ©2016 Copyright Apteligent How do your apps stack up to competitors and your users’ expectations? Prevent Frustration – Tip #3: App Should Load in Less Than 2 Seconds … Just to be Average •  50% of consumers consider app load time a major source of frustration -  25% would leave a brand for unacceptable load times •  46% of iOS apps and 53% of Android apps globally, across all categories, take more than 2 seconds to load2 0   10   20   30   40   50   200   300   400   500   600   700   800   900   1000   2000  >2000   %  of  iOS  Apps  Load  Time  (mS)   0   10   20   30   40   50   60   200   300   400   500   600   700   800   900   1000   2000   >2000   %  of  Android  Apps  with  Load  Time  (mS)   2Source: data.apteligent.com
  • 10. ©2016 Copyright Apteligent Suggested Metrics for High Performance Apps Prevent Frustration – Tip #4: Interactions Should Take < 1 Seconds Userflow User Expectation Time App load (time to availability of first user-interaction) App is “working” 1.0 s Login (not including data entry) App is “working” 1.0 s Registration (not including data entry) App is “working” 1.0 s Search App is “working” 1.0 s Screen transitions Immediate 0.1 s Browse Immediate 0.1 s Add to shopping cart Immediate 0.1 s Check-out App is “working” 1.0 s Locate (e.g. locate store) App is “working” 1.0 s Barcode scan App is “working” 1.0 s Human computer interaction research shows if a user expects3: •  an operation to be instantaneous, then it should take no more than 0.1 second •  the app to be “working” then the operation should take no more than 1.0 seconds 3Powers of 10: Time Scales in User Experience, Jakob Nielsen
  • 11. ©2016 Copyright Apteligent Monitor the latency of network calls that cause the user to wait Prevent Frustration – Tip #5: Monitor Important Network Calls 1.  Monitor the three most important Userflows in your app 2.  Time how long they take to complete 3.  Identify network calls that each Userflow depends on 4.  Monitor the latency and error rate of each call -  Latency < 1 second -  Error Rate < 0.25%
  • 12. ©2016 Copyright Apteligent Ensure Your Users Don’t Uninstall Your App Avert Annoyance: Tip #6: Measure Data and Battery Usage •  Request Volume - Monitor increased network calls due to new SDKs •  Data Received and Sent - Monitor the amount of data your app sends and receives with each new version and with the addition of new SDKs •  Don’t be a “Battery Killer” - Monitor battery drain
  • 13. ©2016 Copyright Apteligent Stay On Top of Every OS Release, Every App Release Tip #7: Monitor Your Performance Metrics – Over Time and Per Release •  Track your app metrics release over release, across internal infrastructure changes (internal API and back-end services), and across major ecosystems events (e.g., OS version releases). •  A historical view of 30 to 90 days will enable you to fill in the critical “why” to the changes you measure (both positive and negative), in the “what” of your key business KPIs.
  • 14. ©2016 Copyright Apteligent 14 Key Metrics and their Targets To Sum Up: Your Critical Mobile Metrics •  Avoid Failures -  Overall Crash Rate < 0.25% -  Crash Rate of Critical Userflows (e.g., “Login”) < 0.25% •  Prevent Frustration -  App Load Time < 2 seconds (to meet the industry, < 1 second to excel) -  Critical Userflows < 1 second -  Userflow Dependent APIs: < 1 second latency, < 0.25% error rate •  Avert Annoyance -  Monitor Request Volume, Data Sent/Received, and Battery Impact
  • 15. ©2016 Copyright Apteligent 15 Measure metrics from the Customer’s perspective Final Considerations •  At a bare minimum monitor for app “Failures” like crashes, hangs and exceptions. •  Monitor the time it takes to access the visible and important user flows (how customers typically journey through your app). Address “Frustration” and “Annoyance” issues.  •  App load time is key user flow because it has a direct connection to your business result though your abandonment KPI. •  To set app metric targets, recognize the insights of human perception research, and set metrics to meet or exceed your users’ built-in timing expectations. •  Track both the duration of the user flow and the latency and error rates of the underlying network calls over time and between app releases.
  • 16. ©2016 Copyright Apteligent Build better, Acquire More, Engage Deeper, Monetize Faster Great Mobile Teams Have Both Vision And Visibility Apteligent delivers user-centered metrics – helping mobile teams prioritize app issues, focus on new feature development, and deliver the best possible user experience.   The “why” behind the “what”
  • 17. ©2016 Copyright Apteligent Build Better, Acquire More, Engage Deeper, Monetize Faster Apteligent: Real. Enterprise. Mobility Apteligent provides tools that empower mobile developers and product managers to troubleshoot, prioritize, and resolve issues that damage their users’ app experience. •  Developers get detailed, real-time information to find and resolve crashes, freezes, and issues in key user flows. •  Product managers and KPI owners get global mobile industry and competitive insight to better plan and focus their mobile initiatives, as well as real-time visibility to app metrics that enable rapid issue detection, prioritization, and release-over-release app improvement.
  • 18. ©2016 Copyright Apteligent Thank You! www.apteligent.com @robkwok