SlideShare una empresa de Scribd logo
1 de 52
© Stephen Janaway 2015
MOBILE TESTING,
THAT’S JUST A
SMALLER
SCREEN, RIGHT?
STEPHEN JANAWAY
© Stephen Janaway 2015
WHO AM I?
STEPHEN JANAWAY
www.stephenjanaway.co.uk
@stephenjanaway
www.testinginthepub.com
@testinginthepub
© Stephen Janaway 2015
TODAY
• Is This Even Important Anyway?
• Isn’t Mobile Testing Just Like Any Other Sort
Of Testing?
• What I Think Is Different.
• What Makes a Great (Mobile) Tester.
© Stephen Janaway 2015
WHY
IS THIS
IMPORTANT?
© Stephen Janaway 2015
© Stephen Janaway 2015
MOBILE DEVICES ARE
MORE THAN JUST DEVICES
• Alarm Clocks
• Maps
• Link to loved ones
• Hand held shops
• Tickets
• Music Players
• Books
• Games Players
• Cameras
• ……
© Stephen Janaway 2015
MOBILE
PROJECTS OFTEN
DON’T HAVE
TESTERS…
© Stephen Janaway 2015
BUT SOON MOST
OF YOU
COULD BE
MOBILE TESTERS
ANYWAY
© Stephen Janaway 2015
© Stephen Janaway 2014
© Stephen Janaway 2015
SUBSCRIPTIONS VS. PEOPL
© Stephen Janaway 2015
A LOT IS
THE SAME
USE YOUR EXISTING SKILLS
© Stephen Janaway 2015
SIMILARITIES
• Functional testing.
• Non-functional
testing.
• Asking questions.
• Discovering
information.
• Communication.
• Understanding and
exploring the
software.
© Stephen Janaway 2015
DIFFERENCES
• Projects are quick.
• You can be closer to
design.
• Usability matters.
• You’re not sat at a
desk all day.
• Hardware influences
software more.
Testers as customer
advocates.
© Stephen Janaway 2015
PROJECTS
ARE QUICK
• CONSIDER EXPLORATORY APPROACHES
• CONSIDER CONTEXT
• DON’T EXPECT REQUIREMENTS (TO HAVE
ALL THE ANSWERS)
© Stephen Janaway 2015
GET
CLOSER TO
DESIGN
• REVIEW WIREFRAMES
• PAIR WITH UI DESIGNERS
• UNDERSTAND THE UI LANGUAGE
• USABILITY MATTERS
© Stephen Janaway 2015
USABILITY MATTERS
• Smaller screen.
• More difficult to
interact with and
typically used one
handed.
• How easy is it to use
the application? Do
user ‘just get it’?
• How is the look and
feel?
• Does the application
or device feel fast?
© Stephen Janaway 2015
USABILITY MATTERS
© Stephen Janaway 2015
GET OUT OF
THE OFFICE
• GO WHERE YOUR CUSTOMER ARE
© Stephen Janaway 2015
DON’T JUST TEST HERE…
© Stephen Janaway 2015
ON HERE, AND AT HERE…
© Stephen Janaway 2015
OUT HERE…
© Stephen Janaway 2015
IN HERE…
© Stephen Janaway 2015
USE THE
LATEST
DEVICES
• UNDERSTAND THE MARKET
• READ THE TECH BLOGS
• IT’S CONSUMER ELECTRONICS!
© Stephen Janaway 2015
© Stephen Janaway 2015
MOBILE DEVICES ARE
• Smart Phones
• Feature Phones
• Tablets
• E-readers
• Big screens, small screens, touch screens
and keypads.
© Stephen Janaway 2015
© Stephen Janaway 2015
AND NOW…
• Fitness devices.
• Smart watches.
• Wearable devices.
• Beacons.
• Household gadgets.
© Stephen Janaway 2015
MOBILE DEVICES ARE
COMPLICATED
While your application
runs, the phone is…..
• Talking to the
network.
• Working out where
you are.
• Maybe receiving
calls, texts, Facebook
and Twitter updates.
© Stephen Janaway 2015
CUSTOMER
ADVOCATES
• UNDERSTAND YOUR USERS - THERE ARE
LOTS OF THEM
• THEY ARE DIFFERENT
• THEY LIVE IN DIFFERENT PLACES
• EMOTIONAL ATTACHMENT
© Stephen Janaway 2015
?
© Stephen Janaway 2015
HOW DO YOU BECOME A
CUSTOMER ADVOCATE?
• User Persona’s.
• User Profiling.
• Industry Statistics.
• Apps Store
Reviews.
• Analytics.
• Use Your Users.
© Stephen Janaway 2015
BECOMING A
GREAT MOBILE
TESTER
© Stephen Janaway 2015
THE OBVIOUS STUFF
• Flexible.
• Great understanding
of technology.
• Employ exploratory
approaches.
• Coach the team on
how to deliver good
quality.
• Perhaps do less
actual testing?
• Give great
information in bug
reports.
© Stephen Janaway 2015
UNDERSTAND YOUR TECH
• OS updates.
• New devices.
• Using SDKs,
Android, Xcode.
• Build and deploy the
software.
• Battery life.
• OS specific
functionality.
© Stephen Janaway 2015
© Stephen Janaway 2014
DIFFERENT OS’S
© Stephen Janaway 2015
© Stephen Janaway 2014
DIFFERENT MOBILE
BROWSERS
© Stephen Janaway 2015
Source: https://developer.android.com/about/dashboards/index.html
ANDROID VERSIONS
© Stephen Janaway 2015
IOS VERSIONS
Source: https://mixpanel.com
© Stephen Janaway 2015
SCREEN SIZES
© Stephen Janaway 2015
USE REAL HARDWARE
• Can be dropped.
• Can get wet.
• Heats up!!
• Shaking.
• Tactile.
• Things are
removable.
© Stephen Janaway 2015
CHOOSE CLEVERLY
Open Device Labs
• Borrow devices,
normally for free.
• http://opendevicelab.
com
• Open Device
Labs = shared
community pools of
internet connected
devices for testing
purposes.
© Stephen Janaway 2015
USE
AUTOMATION
OR KNOW SOMEONE WHO DOES
© Stephen Janaway 2015
LEARN HOW
TO TEST WEB
SERVICES
DON’T JUST TEST THE CLIENT
© Stephen Janaway 2015
UNDERSTAND WHY APPS
GET REJECTED
More info needed
Bugs
UI Too Complicated
FraudulentName too similar
Place holder text
Inappropriate ratings
Beta/ demo
© Stephen Janaway 2015
WRITE GREAT BUG
REPORTS
Can I repeat the issue?
What steps are needed to reproduce the issue?
Is the issue repeatable on a fresh install of the application?
What data is available?
Which device and OS version was I using?
How was the device connected to a network (which
mobile operator and/ or Wifi network)?
Where was I when I saw the issue
What other applications were running?
Do I have screen shots or
a video of the issue?
Have I spoken with the developer?
© Stephen Janaway 2015
WORK MORE
CLOSELY WITH
THE USERS
HARNESS THE CROWD
© Stephen Janaway 2015
© Stephen Janaway 2014
HARNESS THE CROWD
• Usability testing.
• Internal user
groups.
• Beta test groups.
© Stephen Janaway 2015
ENGAGE USERS
THROUGH APPS STORES
© Stephen Janaway 2015
DON’T FORGET
ABOUT
SECURITY
© Stephen Janaway 2015
© Stephen Janaway 2015
© Stephen Janaway 2015
MONITOR APPS
IN LIVE
• USAGE PATTERNS
• CRASHES
• LOAD
• APP STORE RATINGS
© Stephen Janaway 2015
SO…
© Stephen Janaway 2015
SUMMARY - BUILD ON
WHAT YOU KNOW
• Customer advocate:
• Which platforms and devices will they use?
• How will they use the app or website?
• Mobile tech obsessive:
• Devices, OS versions, what’s being updated, what’s
new.
• Test using simulators, real devices, web
services and users.
• Understand the cost of automation.
• Use an exploratory approach to manual testing:
• Mobile device projects are typically short.
© Stephen Janaway 2015
EVERYONE IS
RESPONSIBLE
FOR QUALITY
IF WE DON’T FORGET THAT THEN IT’LL BE OK
© Stephen Janaway 2015
QUESTIONS
“Be proud, your work will soon
be in the hands of millions”
A NOKIA PRODUCT MANAGER
Stephen Janaway
www.stephenjanaway.co.uk
@stephenjanaway
www.testinginthepub.com

Más contenido relacionado

La actualidad más candente

Webinar: Are you ready for your peak season?
Webinar: Are you ready for your peak season?Webinar: Are you ready for your peak season?
Webinar: Are you ready for your peak season?Jennifer Finney
 
5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing StrategySOASTA
 
7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testing7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testingSOASTA
 
Scrum breakfast skillset_toolset_mindset
Scrum breakfast skillset_toolset_mindsetScrum breakfast skillset_toolset_mindset
Scrum breakfast skillset_toolset_mindsetMichael Palotas
 
Synthetic and rum webinar
Synthetic and rum webinarSynthetic and rum webinar
Synthetic and rum webinarSOASTA
 
Secrets to Realistic Load Testing
Secrets to Realistic Load TestingSecrets to Realistic Load Testing
Secrets to Realistic Load TestingSOASTA
 
SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612SOASTA
 
PyCon UK 2013 "Python Adventures in Startup Land"
PyCon UK 2013 "Python Adventures in Startup Land"PyCon UK 2013 "Python Adventures in Startup Land"
PyCon UK 2013 "Python Adventures in Startup Land"rwillmer
 
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal ReadinessTis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal ReadinessSOASTA
 
Windows Phone Dev Day Bournemouth Presentation
Windows Phone Dev Day Bournemouth PresentationWindows Phone Dev Day Bournemouth Presentation
Windows Phone Dev Day Bournemouth PresentationJames Mundy
 
Performance Warrior Tales: Cloud Load Testing the Retail Giants
Performance Warrior Tales: Cloud Load Testing the Retail Giants Performance Warrior Tales: Cloud Load Testing the Retail Giants
Performance Warrior Tales: Cloud Load Testing the Retail Giants SOASTA
 
BHack 2012 - How to protect your web applications
BHack 2012 - How to protect your web applicationsBHack 2012 - How to protect your web applications
BHack 2012 - How to protect your web applicationsMagno Logan
 
Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentModern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentSOASTA
 
Responding to the challenge of the mobile web (2012)
Responding to the challenge of the mobile web (2012)Responding to the challenge of the mobile web (2012)
Responding to the challenge of the mobile web (2012)Graham Bird
 
8 Blind Spots Often Overlooked When Testing on Mobile
8 Blind Spots Often Overlooked When Testing on Mobile8 Blind Spots Often Overlooked When Testing on Mobile
8 Blind Spots Often Overlooked When Testing on MobileNeotys
 
State of the Union - Mobile Performance
State of the Union - Mobile PerformanceState of the Union - Mobile Performance
State of the Union - Mobile PerformanceSOASTA
 
Achieving a four star site and an excellent mobile experience
Achieving a four star site and an excellent mobile experienceAchieving a four star site and an excellent mobile experience
Achieving a four star site and an excellent mobile experienceMatt Johnson
 
Widget iOS: how to use them well
Widget iOS: how to use them wellWidget iOS: how to use them well
Widget iOS: how to use them wellAlessio Roberto
 
Translating Tester-Speak Into Plain English: Simple Explanations for 8 Testin...
Translating Tester-Speak Into Plain English: Simple Explanations for 8 Testin...Translating Tester-Speak Into Plain English: Simple Explanations for 8 Testin...
Translating Tester-Speak Into Plain English: Simple Explanations for 8 Testin...Neotys
 

La actualidad más candente (20)

Webinar: Are you ready for your peak season?
Webinar: Are you ready for your peak season?Webinar: Are you ready for your peak season?
Webinar: Are you ready for your peak season?
 
5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy
 
7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testing7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testing
 
Scrum breakfast skillset_toolset_mindset
Scrum breakfast skillset_toolset_mindsetScrum breakfast skillset_toolset_mindset
Scrum breakfast skillset_toolset_mindset
 
Synthetic and rum webinar
Synthetic and rum webinarSynthetic and rum webinar
Synthetic and rum webinar
 
Secrets to Realistic Load Testing
Secrets to Realistic Load TestingSecrets to Realistic Load Testing
Secrets to Realistic Load Testing
 
Bridging Experiences with the Web
Bridging Experiences with the WebBridging Experiences with the Web
Bridging Experiences with the Web
 
SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612
 
PyCon UK 2013 "Python Adventures in Startup Land"
PyCon UK 2013 "Python Adventures in Startup Land"PyCon UK 2013 "Python Adventures in Startup Land"
PyCon UK 2013 "Python Adventures in Startup Land"
 
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal ReadinessTis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
 
Windows Phone Dev Day Bournemouth Presentation
Windows Phone Dev Day Bournemouth PresentationWindows Phone Dev Day Bournemouth Presentation
Windows Phone Dev Day Bournemouth Presentation
 
Performance Warrior Tales: Cloud Load Testing the Retail Giants
Performance Warrior Tales: Cloud Load Testing the Retail Giants Performance Warrior Tales: Cloud Load Testing the Retail Giants
Performance Warrior Tales: Cloud Load Testing the Retail Giants
 
BHack 2012 - How to protect your web applications
BHack 2012 - How to protect your web applicationsBHack 2012 - How to protect your web applications
BHack 2012 - How to protect your web applications
 
Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentModern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the Present
 
Responding to the challenge of the mobile web (2012)
Responding to the challenge of the mobile web (2012)Responding to the challenge of the mobile web (2012)
Responding to the challenge of the mobile web (2012)
 
8 Blind Spots Often Overlooked When Testing on Mobile
8 Blind Spots Often Overlooked When Testing on Mobile8 Blind Spots Often Overlooked When Testing on Mobile
8 Blind Spots Often Overlooked When Testing on Mobile
 
State of the Union - Mobile Performance
State of the Union - Mobile PerformanceState of the Union - Mobile Performance
State of the Union - Mobile Performance
 
Achieving a four star site and an excellent mobile experience
Achieving a four star site and an excellent mobile experienceAchieving a four star site and an excellent mobile experience
Achieving a four star site and an excellent mobile experience
 
Widget iOS: how to use them well
Widget iOS: how to use them wellWidget iOS: how to use them well
Widget iOS: how to use them well
 
Translating Tester-Speak Into Plain English: Simple Explanations for 8 Testin...
Translating Tester-Speak Into Plain English: Simple Explanations for 8 Testin...Translating Tester-Speak Into Plain English: Simple Explanations for 8 Testin...
Translating Tester-Speak Into Plain English: Simple Explanations for 8 Testin...
 

Destacado

Mobile computing
Mobile computingMobile computing
Mobile computingLi Zhao
 
Mobile software testing guide
Mobile software testing guideMobile software testing guide
Mobile software testing guidejananya213
 
Mobile Users Are Different
Mobile Users Are DifferentMobile Users Are Different
Mobile Users Are DifferentStephen Janaway
 
Exploratory Mobile Testing Webinar_XBOSoft_jean_annharrison
Exploratory Mobile Testing Webinar_XBOSoft_jean_annharrisonExploratory Mobile Testing Webinar_XBOSoft_jean_annharrison
Exploratory Mobile Testing Webinar_XBOSoft_jean_annharrisonXBOSoft
 
Why I Lost My Job As a Test Manager and What I Learnt As a Result
Why I Lost My Job As a Test Manager and What I Learnt As a ResultWhy I Lost My Job As a Test Manager and What I Learnt As a Result
Why I Lost My Job As a Test Manager and What I Learnt As a ResultStephen Janaway
 
Build the future of mobile apps with facebook mobile app europe berlin sept 14
Build the future of mobile apps with facebook   mobile app europe berlin sept 14Build the future of mobile apps with facebook   mobile app europe berlin sept 14
Build the future of mobile apps with facebook mobile app europe berlin sept 14Julien Lesaicherre
 

Destacado (10)

Mobile computing
Mobile computingMobile computing
Mobile computing
 
Mobile software testing guide
Mobile software testing guideMobile software testing guide
Mobile software testing guide
 
Mobile Users Are Different
Mobile Users Are DifferentMobile Users Are Different
Mobile Users Are Different
 
Exploratory Mobile Testing Webinar_XBOSoft_jean_annharrison
Exploratory Mobile Testing Webinar_XBOSoft_jean_annharrisonExploratory Mobile Testing Webinar_XBOSoft_jean_annharrison
Exploratory Mobile Testing Webinar_XBOSoft_jean_annharrison
 
Why I Lost My Job As a Test Manager and What I Learnt As a Result
Why I Lost My Job As a Test Manager and What I Learnt As a ResultWhy I Lost My Job As a Test Manager and What I Learnt As a Result
Why I Lost My Job As a Test Manager and What I Learnt As a Result
 
Testing Your Emotions
Testing Your EmotionsTesting Your Emotions
Testing Your Emotions
 
Build the future of mobile apps with facebook mobile app europe berlin sept 14
Build the future of mobile apps with facebook   mobile app europe berlin sept 14Build the future of mobile apps with facebook   mobile app europe berlin sept 14
Build the future of mobile apps with facebook mobile app europe berlin sept 14
 
Apportioning Monoliths
Apportioning MonolithsApportioning Monoliths
Apportioning Monoliths
 
Mobile Application Testing
Mobile Application TestingMobile Application Testing
Mobile Application Testing
 
The Spotify Tribe
The Spotify TribeThe Spotify Tribe
The Spotify Tribe
 

Similar a Mobile Testing, That's Just a Smaller Screen, Right

Stephen janaway mobile testing - that's just a smaller screen, right
Stephen janaway  mobile testing - that's just a smaller screen, rightStephen janaway  mobile testing - that's just a smaller screen, right
Stephen janaway mobile testing - that's just a smaller screen, rightRomania Testing
 
Top 10 Mobile and Web Perf Lessons
Top 10 Mobile and Web Perf LessonsTop 10 Mobile and Web Perf Lessons
Top 10 Mobile and Web Perf LessonsTom Chavez
 
eMarketer Webinar: The Multitasking Consumer—So Many Screens, So Little Time
eMarketer Webinar: The Multitasking Consumer—So Many Screens, So Little TimeeMarketer Webinar: The Multitasking Consumer—So Many Screens, So Little Time
eMarketer Webinar: The Multitasking Consumer—So Many Screens, So Little TimeeMarketer
 
Mobile Testing, That's Just A Smaller Screen, Right?
Mobile Testing, That's Just A Smaller Screen, Right?Mobile Testing, That's Just A Smaller Screen, Right?
Mobile Testing, That's Just A Smaller Screen, Right?Stephen Janaway
 
How data is your friend by Nick Willis
How data is your friend by Nick WillisHow data is your friend by Nick Willis
How data is your friend by Nick WillisUXPA UK
 
Mobile App Testing by Mark Wilson
Mobile App Testing by Mark WilsonMobile App Testing by Mark Wilson
Mobile App Testing by Mark Wilsonphpwgtn
 
Top 10 mobile and web perf lessons 2014 web perf-jan 2015
Top 10 mobile and web perf lessons 2014   web perf-jan 2015Top 10 mobile and web perf lessons 2014   web perf-jan 2015
Top 10 mobile and web perf lessons 2014 web perf-jan 2015Tom Chavez
 
Building a Performance A Team
Building a Performance A TeamBuilding a Performance A Team
Building a Performance A TeamSOASTA
 
Vaimo ecommerce and the mobile revolution
Vaimo   ecommerce and the mobile revolutionVaimo   ecommerce and the mobile revolution
Vaimo ecommerce and the mobile revolutionCharlie Lines
 
Ecommerce and the mobile revolution
Ecommerce and the mobile revolutionEcommerce and the mobile revolution
Ecommerce and the mobile revolutionCharlie Lines
 
7 Steps to Pragmatic Mobile Testing
7 Steps to Pragmatic Mobile Testing7 Steps to Pragmatic Mobile Testing
7 Steps to Pragmatic Mobile TestingSOASTA
 
An Introduction To Mobile Software Testing
An Introduction To Mobile Software TestingAn Introduction To Mobile Software Testing
An Introduction To Mobile Software TestingStephen Janaway
 
Top 10 mobile and web perf lessons-Toronto
Top 10 mobile and web perf lessons-TorontoTop 10 mobile and web perf lessons-Toronto
Top 10 mobile and web perf lessons-TorontoTom Chavez
 
Mobile app user insight
Mobile app user insightMobile app user insight
Mobile app user insightJudd Wheeler
 
Achieving a Winning Digital User Experience with Real World Testing
Achieving a Winning Digital User Experience with Real World TestingAchieving a Winning Digital User Experience with Real World Testing
Achieving a Winning Digital User Experience with Real World TestingPerfecto by Perforce
 
Mobile Marketing in 2014
Mobile Marketing in 2014Mobile Marketing in 2014
Mobile Marketing in 2014Helen Keegan
 
Tns consumer confident tet spending 2015
Tns consumer confident tet spending 2015Tns consumer confident tet spending 2015
Tns consumer confident tet spending 2015thaomapu
 
WTW TLE 2015 Powerpoint_Hua_Charles-final
WTW TLE 2015 Powerpoint_Hua_Charles-finalWTW TLE 2015 Powerpoint_Hua_Charles-final
WTW TLE 2015 Powerpoint_Hua_Charles-finalCharles Hua
 
How To Do Usability Testing
How To Do Usability TestingHow To Do Usability Testing
How To Do Usability TestingJane Morgan
 
eMarketer Webinar: The Multiscreen, Multitasking Consumer
eMarketer Webinar: The Multiscreen, Multitasking Consumer eMarketer Webinar: The Multiscreen, Multitasking Consumer
eMarketer Webinar: The Multiscreen, Multitasking Consumer eMarketer
 

Similar a Mobile Testing, That's Just a Smaller Screen, Right (20)

Stephen janaway mobile testing - that's just a smaller screen, right
Stephen janaway  mobile testing - that's just a smaller screen, rightStephen janaway  mobile testing - that's just a smaller screen, right
Stephen janaway mobile testing - that's just a smaller screen, right
 
Top 10 Mobile and Web Perf Lessons
Top 10 Mobile and Web Perf LessonsTop 10 Mobile and Web Perf Lessons
Top 10 Mobile and Web Perf Lessons
 
eMarketer Webinar: The Multitasking Consumer—So Many Screens, So Little Time
eMarketer Webinar: The Multitasking Consumer—So Many Screens, So Little TimeeMarketer Webinar: The Multitasking Consumer—So Many Screens, So Little Time
eMarketer Webinar: The Multitasking Consumer—So Many Screens, So Little Time
 
Mobile Testing, That's Just A Smaller Screen, Right?
Mobile Testing, That's Just A Smaller Screen, Right?Mobile Testing, That's Just A Smaller Screen, Right?
Mobile Testing, That's Just A Smaller Screen, Right?
 
How data is your friend by Nick Willis
How data is your friend by Nick WillisHow data is your friend by Nick Willis
How data is your friend by Nick Willis
 
Mobile App Testing by Mark Wilson
Mobile App Testing by Mark WilsonMobile App Testing by Mark Wilson
Mobile App Testing by Mark Wilson
 
Top 10 mobile and web perf lessons 2014 web perf-jan 2015
Top 10 mobile and web perf lessons 2014   web perf-jan 2015Top 10 mobile and web perf lessons 2014   web perf-jan 2015
Top 10 mobile and web perf lessons 2014 web perf-jan 2015
 
Building a Performance A Team
Building a Performance A TeamBuilding a Performance A Team
Building a Performance A Team
 
Vaimo ecommerce and the mobile revolution
Vaimo   ecommerce and the mobile revolutionVaimo   ecommerce and the mobile revolution
Vaimo ecommerce and the mobile revolution
 
Ecommerce and the mobile revolution
Ecommerce and the mobile revolutionEcommerce and the mobile revolution
Ecommerce and the mobile revolution
 
7 Steps to Pragmatic Mobile Testing
7 Steps to Pragmatic Mobile Testing7 Steps to Pragmatic Mobile Testing
7 Steps to Pragmatic Mobile Testing
 
An Introduction To Mobile Software Testing
An Introduction To Mobile Software TestingAn Introduction To Mobile Software Testing
An Introduction To Mobile Software Testing
 
Top 10 mobile and web perf lessons-Toronto
Top 10 mobile and web perf lessons-TorontoTop 10 mobile and web perf lessons-Toronto
Top 10 mobile and web perf lessons-Toronto
 
Mobile app user insight
Mobile app user insightMobile app user insight
Mobile app user insight
 
Achieving a Winning Digital User Experience with Real World Testing
Achieving a Winning Digital User Experience with Real World TestingAchieving a Winning Digital User Experience with Real World Testing
Achieving a Winning Digital User Experience with Real World Testing
 
Mobile Marketing in 2014
Mobile Marketing in 2014Mobile Marketing in 2014
Mobile Marketing in 2014
 
Tns consumer confident tet spending 2015
Tns consumer confident tet spending 2015Tns consumer confident tet spending 2015
Tns consumer confident tet spending 2015
 
WTW TLE 2015 Powerpoint_Hua_Charles-final
WTW TLE 2015 Powerpoint_Hua_Charles-finalWTW TLE 2015 Powerpoint_Hua_Charles-final
WTW TLE 2015 Powerpoint_Hua_Charles-final
 
How To Do Usability Testing
How To Do Usability TestingHow To Do Usability Testing
How To Do Usability Testing
 
eMarketer Webinar: The Multiscreen, Multitasking Consumer
eMarketer Webinar: The Multiscreen, Multitasking Consumer eMarketer Webinar: The Multiscreen, Multitasking Consumer
eMarketer Webinar: The Multiscreen, Multitasking Consumer
 

Último

ManageIQ - Sprint 236 Review - Slide Deck
ManageIQ - Sprint 236 Review - Slide DeckManageIQ - Sprint 236 Review - Slide Deck
ManageIQ - Sprint 236 Review - Slide DeckManageIQ
 
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...Jittipong Loespradit
 
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️Delhi Call girls
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfkalichargn70th171
 
10 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 202410 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 2024Mind IT Systems
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...Health
 
Introducing Microsoft’s new Enterprise Work Management (EWM) Solution
Introducing Microsoft’s new Enterprise Work Management (EWM) SolutionIntroducing Microsoft’s new Enterprise Work Management (EWM) Solution
Introducing Microsoft’s new Enterprise Work Management (EWM) SolutionOnePlan Solutions
 
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisamasabamasaba
 
LEVEL 5 - SESSION 1 2023 (1).pptx - PDF 123456
LEVEL 5   - SESSION 1 2023 (1).pptx - PDF 123456LEVEL 5   - SESSION 1 2023 (1).pptx - PDF 123456
LEVEL 5 - SESSION 1 2023 (1).pptx - PDF 123456KiaraTiradoMicha
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfkalichargn70th171
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...panagenda
 
The title is not connected to what is inside
The title is not connected to what is insideThe title is not connected to what is inside
The title is not connected to what is insideshinachiaurasa2
 
The Top App Development Trends Shaping the Industry in 2024-25 .pdf
The Top App Development Trends Shaping the Industry in 2024-25 .pdfThe Top App Development Trends Shaping the Industry in 2024-25 .pdf
The Top App Development Trends Shaping the Industry in 2024-25 .pdfayushiqss
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Steffen Staab
 
Exploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdfExploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdfproinshot.com
 
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...Shane Coughlan
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsArshad QA
 
AI & Machine Learning Presentation Template
AI & Machine Learning Presentation TemplateAI & Machine Learning Presentation Template
AI & Machine Learning Presentation TemplatePresentation.STUDIO
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comFatema Valibhai
 

Último (20)

ManageIQ - Sprint 236 Review - Slide Deck
ManageIQ - Sprint 236 Review - Slide DeckManageIQ - Sprint 236 Review - Slide Deck
ManageIQ - Sprint 236 Review - Slide Deck
 
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
 
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
10 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 202410 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 2024
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
 
Introducing Microsoft’s new Enterprise Work Management (EWM) Solution
Introducing Microsoft’s new Enterprise Work Management (EWM) SolutionIntroducing Microsoft’s new Enterprise Work Management (EWM) Solution
Introducing Microsoft’s new Enterprise Work Management (EWM) Solution
 
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
 
LEVEL 5 - SESSION 1 2023 (1).pptx - PDF 123456
LEVEL 5   - SESSION 1 2023 (1).pptx - PDF 123456LEVEL 5   - SESSION 1 2023 (1).pptx - PDF 123456
LEVEL 5 - SESSION 1 2023 (1).pptx - PDF 123456
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
 
The title is not connected to what is inside
The title is not connected to what is insideThe title is not connected to what is inside
The title is not connected to what is inside
 
The Top App Development Trends Shaping the Industry in 2024-25 .pdf
The Top App Development Trends Shaping the Industry in 2024-25 .pdfThe Top App Development Trends Shaping the Industry in 2024-25 .pdf
The Top App Development Trends Shaping the Industry in 2024-25 .pdf
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
 
Exploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdfExploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdf
 
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview Questions
 
AI & Machine Learning Presentation Template
AI & Machine Learning Presentation TemplateAI & Machine Learning Presentation Template
AI & Machine Learning Presentation Template
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.com
 
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 

Mobile Testing, That's Just a Smaller Screen, Right

  • 1. © Stephen Janaway 2015 MOBILE TESTING, THAT’S JUST A SMALLER SCREEN, RIGHT? STEPHEN JANAWAY
  • 2. © Stephen Janaway 2015 WHO AM I? STEPHEN JANAWAY www.stephenjanaway.co.uk @stephenjanaway www.testinginthepub.com @testinginthepub
  • 3. © Stephen Janaway 2015 TODAY • Is This Even Important Anyway? • Isn’t Mobile Testing Just Like Any Other Sort Of Testing? • What I Think Is Different. • What Makes a Great (Mobile) Tester.
  • 4. © Stephen Janaway 2015 WHY IS THIS IMPORTANT?
  • 5. © Stephen Janaway 2015 © Stephen Janaway 2015 MOBILE DEVICES ARE MORE THAN JUST DEVICES • Alarm Clocks • Maps • Link to loved ones • Hand held shops • Tickets • Music Players • Books • Games Players • Cameras • ……
  • 6. © Stephen Janaway 2015 MOBILE PROJECTS OFTEN DON’T HAVE TESTERS…
  • 7. © Stephen Janaway 2015 BUT SOON MOST OF YOU COULD BE MOBILE TESTERS ANYWAY
  • 8. © Stephen Janaway 2015 © Stephen Janaway 2014
  • 9. © Stephen Janaway 2015 SUBSCRIPTIONS VS. PEOPL
  • 10. © Stephen Janaway 2015 A LOT IS THE SAME USE YOUR EXISTING SKILLS
  • 11. © Stephen Janaway 2015 SIMILARITIES • Functional testing. • Non-functional testing. • Asking questions. • Discovering information. • Communication. • Understanding and exploring the software.
  • 12. © Stephen Janaway 2015 DIFFERENCES • Projects are quick. • You can be closer to design. • Usability matters. • You’re not sat at a desk all day. • Hardware influences software more. Testers as customer advocates.
  • 13. © Stephen Janaway 2015 PROJECTS ARE QUICK • CONSIDER EXPLORATORY APPROACHES • CONSIDER CONTEXT • DON’T EXPECT REQUIREMENTS (TO HAVE ALL THE ANSWERS)
  • 14. © Stephen Janaway 2015 GET CLOSER TO DESIGN • REVIEW WIREFRAMES • PAIR WITH UI DESIGNERS • UNDERSTAND THE UI LANGUAGE • USABILITY MATTERS
  • 15. © Stephen Janaway 2015 USABILITY MATTERS • Smaller screen. • More difficult to interact with and typically used one handed. • How easy is it to use the application? Do user ‘just get it’? • How is the look and feel? • Does the application or device feel fast?
  • 16. © Stephen Janaway 2015 USABILITY MATTERS
  • 17. © Stephen Janaway 2015 GET OUT OF THE OFFICE • GO WHERE YOUR CUSTOMER ARE
  • 18. © Stephen Janaway 2015 DON’T JUST TEST HERE…
  • 19. © Stephen Janaway 2015 ON HERE, AND AT HERE…
  • 20. © Stephen Janaway 2015 OUT HERE…
  • 21. © Stephen Janaway 2015 IN HERE…
  • 22. © Stephen Janaway 2015 USE THE LATEST DEVICES • UNDERSTAND THE MARKET • READ THE TECH BLOGS • IT’S CONSUMER ELECTRONICS!
  • 23. © Stephen Janaway 2015 © Stephen Janaway 2015 MOBILE DEVICES ARE • Smart Phones • Feature Phones • Tablets • E-readers • Big screens, small screens, touch screens and keypads.
  • 24. © Stephen Janaway 2015 © Stephen Janaway 2015 AND NOW… • Fitness devices. • Smart watches. • Wearable devices. • Beacons. • Household gadgets.
  • 25. © Stephen Janaway 2015 MOBILE DEVICES ARE COMPLICATED While your application runs, the phone is….. • Talking to the network. • Working out where you are. • Maybe receiving calls, texts, Facebook and Twitter updates.
  • 26. © Stephen Janaway 2015 CUSTOMER ADVOCATES • UNDERSTAND YOUR USERS - THERE ARE LOTS OF THEM • THEY ARE DIFFERENT • THEY LIVE IN DIFFERENT PLACES • EMOTIONAL ATTACHMENT
  • 28. © Stephen Janaway 2015 HOW DO YOU BECOME A CUSTOMER ADVOCATE? • User Persona’s. • User Profiling. • Industry Statistics. • Apps Store Reviews. • Analytics. • Use Your Users.
  • 29. © Stephen Janaway 2015 BECOMING A GREAT MOBILE TESTER
  • 30. © Stephen Janaway 2015 THE OBVIOUS STUFF • Flexible. • Great understanding of technology. • Employ exploratory approaches. • Coach the team on how to deliver good quality. • Perhaps do less actual testing? • Give great information in bug reports.
  • 31. © Stephen Janaway 2015 UNDERSTAND YOUR TECH • OS updates. • New devices. • Using SDKs, Android, Xcode. • Build and deploy the software. • Battery life. • OS specific functionality.
  • 32. © Stephen Janaway 2015 © Stephen Janaway 2014 DIFFERENT OS’S
  • 33. © Stephen Janaway 2015 © Stephen Janaway 2014 DIFFERENT MOBILE BROWSERS
  • 34. © Stephen Janaway 2015 Source: https://developer.android.com/about/dashboards/index.html ANDROID VERSIONS
  • 35. © Stephen Janaway 2015 IOS VERSIONS Source: https://mixpanel.com
  • 36. © Stephen Janaway 2015 SCREEN SIZES
  • 37. © Stephen Janaway 2015 USE REAL HARDWARE • Can be dropped. • Can get wet. • Heats up!! • Shaking. • Tactile. • Things are removable.
  • 38. © Stephen Janaway 2015 CHOOSE CLEVERLY Open Device Labs • Borrow devices, normally for free. • http://opendevicelab. com • Open Device Labs = shared community pools of internet connected devices for testing purposes.
  • 39. © Stephen Janaway 2015 USE AUTOMATION OR KNOW SOMEONE WHO DOES
  • 40. © Stephen Janaway 2015 LEARN HOW TO TEST WEB SERVICES DON’T JUST TEST THE CLIENT
  • 41. © Stephen Janaway 2015 UNDERSTAND WHY APPS GET REJECTED More info needed Bugs UI Too Complicated FraudulentName too similar Place holder text Inappropriate ratings Beta/ demo
  • 42. © Stephen Janaway 2015 WRITE GREAT BUG REPORTS Can I repeat the issue? What steps are needed to reproduce the issue? Is the issue repeatable on a fresh install of the application? What data is available? Which device and OS version was I using? How was the device connected to a network (which mobile operator and/ or Wifi network)? Where was I when I saw the issue What other applications were running? Do I have screen shots or a video of the issue? Have I spoken with the developer?
  • 43. © Stephen Janaway 2015 WORK MORE CLOSELY WITH THE USERS HARNESS THE CROWD
  • 44. © Stephen Janaway 2015 © Stephen Janaway 2014 HARNESS THE CROWD • Usability testing. • Internal user groups. • Beta test groups.
  • 45. © Stephen Janaway 2015 ENGAGE USERS THROUGH APPS STORES
  • 46. © Stephen Janaway 2015 DON’T FORGET ABOUT SECURITY
  • 47. © Stephen Janaway 2015 © Stephen Janaway 2015
  • 48. © Stephen Janaway 2015 MONITOR APPS IN LIVE • USAGE PATTERNS • CRASHES • LOAD • APP STORE RATINGS
  • 49. © Stephen Janaway 2015 SO…
  • 50. © Stephen Janaway 2015 SUMMARY - BUILD ON WHAT YOU KNOW • Customer advocate: • Which platforms and devices will they use? • How will they use the app or website? • Mobile tech obsessive: • Devices, OS versions, what’s being updated, what’s new. • Test using simulators, real devices, web services and users. • Understand the cost of automation. • Use an exploratory approach to manual testing: • Mobile device projects are typically short.
  • 51. © Stephen Janaway 2015 EVERYONE IS RESPONSIBLE FOR QUALITY IF WE DON’T FORGET THAT THEN IT’LL BE OK
  • 52. © Stephen Janaway 2015 QUESTIONS “Be proud, your work will soon be in the hands of millions” A NOKIA PRODUCT MANAGER Stephen Janaway www.stephenjanaway.co.uk @stephenjanaway www.testinginthepub.com