SlideShare una empresa de Scribd logo
1 de 17
Descargar para leer sin conexión
T4
Mobile Testing
5/8/2014 9:45:00 AM
Mobile App Testing Secrets
Presented by:
Jason Arbon
Applause
Brought to you by:
340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
Jason Arbon
Applause
Jason Arbon currently leads the labs engineering team at uTest.com and applause.com. In the
past, Jason worked on Google Chrome, ChromeOS, Google+, several Microsoft teams
including Bing and most importantly WinFS. He coauthored the book How Google Tests
Software. Jason has started several open source projects, more recently the opentipmap.com
project to codify mobile best practices. Jason is the cofounder and mobile app developer for a
personalized discovery, search, and sharing app at herecandy.com. In his free time he’s
working on a mobile app quality book, OnAppQuality.com. Free time? Wait, Jason doesn’t
actually have free time.
4/26/2014
1
On App Quality
Jason Arbon
Dir. Product, applause.com/utest.com
window on humanity
4/26/2014
2
shaped my thinking
coding eng director
Analytics
1,000,000+ apps
100,000,000+ reviews
Crowd Testing
1,000+ apps
100,000+ Testers
4/26/2014
3
author
most aim for 4 stars
...and then stop shipping.
4/26/2014
4
monsters
“agile”
“continuous
integration”
app store monster
4/26/2014
5
app quality: difficult
user expectations
reviews/stars
location/network
few best practices
fragmented tools, platforms, devices
awesome future
rich appstore data
cloud devices
cloud humans
best practices
moving to agile and CI (finally!)
finally quantify quality
4/26/2014
6
quantify/compare
4/26/2014
7
4/26/2014
8
4/26/2014
9
window on humanity
competitive info
where winning
what to focus on
4/26/2014
10
devices in the cloud
humans in the cloud
4/26/2014
11
agile doesn’t mean stars
Correlation between number
of days since release and star
rating
x-axis: star rating
y-axis: number of days since
release
Pearson correlation: -0.31
(threshold for weak/medium
correlation is 0.3)
top 1k apps (>10k reviews)
agile doesn’t mean stars
Correlation between number
of versions and star rating
x-axis: star rating
y-axis: number of versions
Pearson correlation: -0.28
(threshold for weak/medium
correlation is 0.3)
top 1k apps (>10k reviews)
4/26/2014
12
open tip map
encoding best practices
programmatic access
data triggered tips
open
4/26/2014
13
window on humanity
contact
jasona@utest.com
@jarbon
jarbon@gmail.com
best practices for book
tips
4/26/2014
14
far future: no backlog
4/26/2014
15
app-differencing
monkey-bots compare every build with the last
screenshots of differences sent to developers
and testers in real time
Analytics brought to you by...
Matthew, Heidi and Jason Stredwick and Joe

Más contenido relacionado

Destacado

Destacado (16)

The Golden Rules for Managing Large Testing Initiatives
The Golden Rules for Managing Large Testing InitiativesThe Golden Rules for Managing Large Testing Initiatives
The Golden Rules for Managing Large Testing Initiatives
 
Exploratory Testing Explained
Exploratory Testing ExplainedExploratory Testing Explained
Exploratory Testing Explained
 
Well Begun Is Half Done: Creating Dynamic and Living Team Charters
Well Begun Is Half Done: Creating Dynamic and Living Team ChartersWell Begun Is Half Done: Creating Dynamic and Living Team Charters
Well Begun Is Half Done: Creating Dynamic and Living Team Charters
 
Cloud-Based, Automated Mobile App Testing for the Enterprise
Cloud-Based, Automated Mobile App Testing for the EnterpriseCloud-Based, Automated Mobile App Testing for the Enterprise
Cloud-Based, Automated Mobile App Testing for the Enterprise
 
Tk
TkTk
Tk
 
Strategies for Mobile Web Application Testing
Strategies for Mobile Web Application TestingStrategies for Mobile Web Application Testing
Strategies for Mobile Web Application Testing
 
Getting the Most Value from Feedback Systems: Daily, Every Sprint, and Every ...
Getting the Most Value from Feedback Systems: Daily, Every Sprint, and Every ...Getting the Most Value from Feedback Systems: Daily, Every Sprint, and Every ...
Getting the Most Value from Feedback Systems: Daily, Every Sprint, and Every ...
 
Things That Go Bump: Product Risk Assessment in Agile
Things That Go Bump: Product Risk Assessment in AgileThings That Go Bump: Product Risk Assessment in Agile
Things That Go Bump: Product Risk Assessment in Agile
 
Architecture vs. Design vs. Agile: What’s the Answer?
Architecture vs. Design vs. Agile: What’s the Answer?Architecture vs. Design vs. Agile: What’s the Answer?
Architecture vs. Design vs. Agile: What’s the Answer?
 
How Metrics Programs Can Destroy Your Soul
How Metrics Programs Can Destroy Your SoulHow Metrics Programs Can Destroy Your Soul
How Metrics Programs Can Destroy Your Soul
 
Continuous Delivery in a Legacy Shop—One Step at a Time
Continuous Delivery in a Legacy Shop—One Step at a TimeContinuous Delivery in a Legacy Shop—One Step at a Time
Continuous Delivery in a Legacy Shop—One Step at a Time
 
Testers and Testing: A Product Owner’s Perspective
Testers and Testing: A Product Owner’s PerspectiveTesters and Testing: A Product Owner’s Perspective
Testers and Testing: A Product Owner’s Perspective
 
Agile and DevOps Transformations in Large Organizations
Agile and DevOps Transformations in Large OrganizationsAgile and DevOps Transformations in Large Organizations
Agile and DevOps Transformations in Large Organizations
 
Next-Generation Performance Testing with Lifecycle Monitoring
Next-Generation Performance Testing with Lifecycle MonitoringNext-Generation Performance Testing with Lifecycle Monitoring
Next-Generation Performance Testing with Lifecycle Monitoring
 
Advance ALM and DevOps Practices with Continuous Improvement
Advance ALM and DevOps Practices with Continuous ImprovementAdvance ALM and DevOps Practices with Continuous Improvement
Advance ALM and DevOps Practices with Continuous Improvement
 
Project Management Tips to Improve Test Planning
Project Management Tips to Improve Test PlanningProject Management Tips to Improve Test Planning
Project Management Tips to Improve Test Planning
 

Similar a Mobile App Testing Secrets

DaveParizekResumeJune2015
DaveParizekResumeJune2015DaveParizekResumeJune2015
DaveParizekResumeJune2015
Dave Parizek
 
Ashish_Android_Resume
Ashish_Android_ResumeAshish_Android_Resume
Ashish_Android_Resume
Ashish Bangar
 
UrvashiShrivastavaResumeLatest2017
UrvashiShrivastavaResumeLatest2017UrvashiShrivastavaResumeLatest2017
UrvashiShrivastavaResumeLatest2017
Urvashi Shrivastava
 

Similar a Mobile App Testing Secrets (20)

Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
 
Build Smarter Mobile Apps with Real-Time Relevance
Build Smarter Mobile Apps with Real-Time RelevanceBuild Smarter Mobile Apps with Real-Time Relevance
Build Smarter Mobile Apps with Real-Time Relevance
 
A Look into the Future: App Testing and Quality in 2025
A Look into the Future: App Testing and Quality in 2025A Look into the Future: App Testing and Quality in 2025
A Look into the Future: App Testing and Quality in 2025
 
Real-Time Contextual and Social Relevance in Mobile
Real-Time Contextual and Social Relevance in MobileReal-Time Contextual and Social Relevance in Mobile
Real-Time Contextual and Social Relevance in Mobile
 
Innovation: From the Tester’s Viewpoint
Innovation: From the Tester’s Viewpoint Innovation: From the Tester’s Viewpoint
Innovation: From the Tester’s Viewpoint
 
Agile Tools for Mobile
Agile Tools for MobileAgile Tools for Mobile
Agile Tools for Mobile
 
Lean Startup Machine - Mobile App Development
Lean Startup Machine - Mobile App DevelopmentLean Startup Machine - Mobile App Development
Lean Startup Machine - Mobile App Development
 
Mobile and IoT Win! Now What?
Mobile and IoT Win! Now What?Mobile and IoT Win! Now What?
Mobile and IoT Win! Now What?
 
Uber’s Fascinating World of Inter-App Communications
Uber’s Fascinating World of Inter-App CommunicationsUber’s Fascinating World of Inter-App Communications
Uber’s Fascinating World of Inter-App Communications
 
Appsplash'16 session(1) "Introduction to mobile application"
Appsplash'16 session(1) "Introduction to mobile application"Appsplash'16 session(1) "Introduction to mobile application"
Appsplash'16 session(1) "Introduction to mobile application"
 
App Store Optimization - SMX Munich - Emily Grossman
App Store Optimization - SMX Munich - Emily GrossmanApp Store Optimization - SMX Munich - Emily Grossman
App Store Optimization - SMX Munich - Emily Grossman
 
App Store Optimization - SMX Munich - Emily Grossman
App Store Optimization - SMX Munich - Emily GrossmanApp Store Optimization - SMX Munich - Emily Grossman
App Store Optimization - SMX Munich - Emily Grossman
 
Mobile Testing Trends and Innovations
Mobile Testing Trends and InnovationsMobile Testing Trends and Innovations
Mobile Testing Trends and Innovations
 
DaveParizekResumeJune2015
DaveParizekResumeJune2015DaveParizekResumeJune2015
DaveParizekResumeJune2015
 
Agile Mobile Strategies on a Shoestring Budget
Agile Mobile Strategies on a Shoestring BudgetAgile Mobile Strategies on a Shoestring Budget
Agile Mobile Strategies on a Shoestring Budget
 
Tap into mobile app testing@TDT Iasi Sept2013
Tap into mobile app testing@TDT Iasi Sept2013Tap into mobile app testing@TDT Iasi Sept2013
Tap into mobile app testing@TDT Iasi Sept2013
 
AI and Machine Learning for Testers
AI and Machine Learning for TestersAI and Machine Learning for Testers
AI and Machine Learning for Testers
 
Live 2014 Survey Results: Open Source Development and Application Security Su...
Live 2014 Survey Results: Open Source Development and Application Security Su...Live 2014 Survey Results: Open Source Development and Application Security Su...
Live 2014 Survey Results: Open Source Development and Application Security Su...
 
Ashish_Android_Resume
Ashish_Android_ResumeAshish_Android_Resume
Ashish_Android_Resume
 
UrvashiShrivastavaResumeLatest2017
UrvashiShrivastavaResumeLatest2017UrvashiShrivastavaResumeLatest2017
UrvashiShrivastavaResumeLatest2017
 

Más de TechWell

Más de TechWell (20)

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
 
Ma 15
Ma 15Ma 15
Ma 15
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
 
Scale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development TodayScale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development Today
 

Último

Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Peter Udo Diehl
 

Último (20)

IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024
 
What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024
 
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
 
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
 
Where to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdfWhere to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdf
 
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfThe Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
 
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
 
Buy Epson EcoTank L3210 Colour Printer Online.pdf
Buy Epson EcoTank L3210 Colour Printer Online.pdfBuy Epson EcoTank L3210 Colour Printer Online.pdf
Buy Epson EcoTank L3210 Colour Printer Online.pdf
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1
 
A Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System StrategyA Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System Strategy
 
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
 
PLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsPLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. Startups
 
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
 
Agentic RAG What it is its types applications and implementation.pdf
Agentic RAG What it is its types applications and implementation.pdfAgentic RAG What it is its types applications and implementation.pdf
Agentic RAG What it is its types applications and implementation.pdf
 
IESVE for Early Stage Design and Planning
IESVE for Early Stage Design and PlanningIESVE for Early Stage Design and Planning
IESVE for Early Stage Design and Planning
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024
 
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdfSimplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
 
AI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekAI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří Karpíšek
 
The UX of Automation by AJ King, Senior UX Researcher, Ocado
The UX of Automation by AJ King, Senior UX Researcher, OcadoThe UX of Automation by AJ King, Senior UX Researcher, Ocado
The UX of Automation by AJ King, Senior UX Researcher, Ocado
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
 

Mobile App Testing Secrets