Designing a user experience that mobile smartphone users love requires understanding the best practices in testing and monitoring mobile apps and mobile optimized websites - for performance, usability, and adoption.

1. Optimizing Mobile Apps and Websites
Or, How To Deliver an Experience Mobile Users Love
Vik Chaudhary
VP Product Management and Corporate Development
Keynote Systems http://www.keynote.com
@vikchaudhary

2. Agenda
Mobile Testing Analyzing Testing
Next Mobile
Device Mobile Mobile Usage Performance
Experience Performance
“What is the experience of my mobile users?”
- Mobile Business Manager
© 2011 Keynote Systems, Inc. 2

3. Testing Mobile Performance
Performance Testing Monitoring Analyzing
Next Mobile
Complexities Mobile Mobile Usage
Apps Performance
“What will a mobile user’s experience with the app be?”
- Content Developer
© 2011 Keynote Systems, Inc. 3

4. Analyzing Mobile Usage
Web Mobile Choosing a True
Next
Analytics App Vendor Mobile
Perspective
Tools Analytics
“What are my mobile app users doing?”
- Mobile Business Manager, Content Developer
© 2011 Keynote Systems, Inc. 4

5. Mobile App
and Website
Monitoring
Real Device
Performance Content
Testing Verification
True on Mobile
Mobile Devices
Perspective
Mobile
Usability
Testing Mobile
App
Analytics

6. Mobile Experience
The mobile user experience depends on the device, the OS, the service, and networking technology
Facebook has over 750 million users
but… 5 billion use cell phones around the world
and…500 million have full mobile web access
iPhone
Apple E-mail GSM LTE
Android
HTC Messaging CDMA WiMax
BlackBerry
Blackberry Video GPRS EVDO
Symbian
Samsung Mobile Web EDGE UMTS
WebOS
Motorola Native apps HSUPA HSDPA
Windows Mobile
2500 mobile devices 6 Major OSs 5 Services 10 Connections
© 2011 Keynote Systems, Inc. 6

7. Meeting User Expectations
Each delivery method presents unique challenges to providing a good experience.
© 2011 Keynote Systems, Inc. 7

8. Industry Benchmarks on Mobile User Experience
© 2011 Keynote Systems, Inc. 8

9. Media and
Entertainment users
mostly prefer mobile
browsers over apps
© 2011 Keynote Systems, Inc. 9

10. When online shoppers
use browsers vs apps
© 2011 Keynote Systems, Inc. 10

11. Mobile Apps vs Websites
Each mobile approach requires a different testing and monitoring solution.
Mobile Websites Mobile Apps
Testing and monitoring of mobile websites Testing and monitoring of mobile apps for
for all mobile devices smartphones
 Optimize your website for mobile devices  Smaller number of users
 Test for between 10 and 100 devices  Test using app emulators, or
 Monitor from global locations  Test using real devices connected to live operator
 Test “On Air” connected to wireless carriers networks
 Use latest smartphones in global locations
© 2011 Keynote Systems, Inc. 11

12. Designing for Smartphone and Tablet Screen Sizes
• Progressive enhancement (CSS, jquery mobile, HTML5)
• Transcoding of content on devices (Netbiscuits, UsableNet)
• Adaptive UI components (HTML5, Flash)
© 2011 Keynote Systems, Inc. 12

13. Progressive Enhancement
Smartphone browser Desktop browser
© 2011 Keynote Systems, Inc. 13

14. H
Testing and Monitoring Mobile Websites
MONITORING MOBILE WEB Browse mobile website using TESTING MOBILE WEB CONTENT
PERFORMANCE specific mobile devices
24/7 monitoring of critical Desktop-based tools for
business transactions from testing and validating
global locations mobile web content.
Monitor your mobile website Record any mobile website
from locations around path or transaction for later
the world replay
Self-service scripting and Certify mobile Web content
provisioning for rapid over multiple device profiles
deployment
© 2011 Keynote Systems, Inc. 14

15. Travel Mobile Website Benchmarking
Search/Book Hotel Use case:
1. Travel site home
2. Search or Book Hotel, By city iPhone on AT&T
Blackberry on Sprint
3. Input Honolulu, date and Search
Droid on Verizon wireless
4. Click first Hotel
5. Choose a Room or Rate Location: Chicago, Dallas,
San Francisco, New York
Site (pages): URL: Frequency: every 60 minutes on Air
Expedia: http://www.expedia.com
Hotels: http://www.hotels.com
Priceline: http://www.priceline.com
Travelocity: http://www.travelocity.com
© 2011 Keynote Systems, Inc. 15

16. Mobile Apps in the Enterprise and Performance
App Architecture Organizational Boundaries Business Transactions
Rich UIs End Users Device Capabilities
© 2011 Keynote Systems, Inc. 16

17. Why Data Center Latency Matters
100ms latency between data centers
x 10 million requests per second
= slow mobile website/app
© 2011 Keynote Systems, Inc. 17

18. The Mobile Device Matters the Most
Data Network Application
Center Speeds Construction
Latency
Device Attributes
• Operating system version
• Browser and browser version
• No. of concurrent threads
• App architecture (local storage)
18

19. Mobile Testing Best Practices
Mobile Device Mobile Certification on Live Network
Emulation Optimization Multiple Devices Troubleshooting
Choose a device Analyze and optimize Record and Perform over the
database that allows content and playback scripts to air testing and
testing on any device performance of certify mobile Web troubleshooting
profile mobile website content over of issues for web
multiple device content
profiles
simultaneously
© 2011 Keynote Systems, Inc. 19

20. Demo
Download MITE (the Mobile Internet Testing
Environment) from http://mite.keynote.com
© 2011 Keynote Systems, Inc. 20

21. Mobile App
and Website
Performance
Monitoring
Real Device
Performance Content
Testing Verification
True on Mobile
Mobile Devices
Perspective
Mobile
Usability
Testing Mobile
App
Analytics

22. Three Things to Remember
1 2 3
Measure what matters Great application
Measure business with real devices, performance
transactions, user browsers, and increases business
journeys, or scenarios locations performance
© 2011 Keynote Systems, Inc. 22

23. Thank You
Vik Chaudhary
vik.chaudhary@keynote.com
650-403-3279
@vikchaudhary
http://www.keynote.com
© 2011 Keynote Systems, Inc. 23