How to Test on the Right Mobile Platforms
•Descargar como PPTX, PDF•
1 recomendación•1,361 vistas
Your mobile test plan can't be adhoc. Watch this webinar and learn how to start testing more methodically to provide test coverage that reflects your users and ensures a great digital experience. We'll cover the most important insights from the latest issue of the Digital Mobile Test Coverage Index, including benchmarks, geographies and the latest devices and OS's that app developers and testers need to know.
Recomendados
Recomendados
Más contenido relacionado
La actualidad más candente
La actualidad más candente (20)
Destacado
Destacado (18)
Similar a How to Test on the Right Mobile Platforms
Similar a How to Test on the Right Mobile Platforms (20)
Más de Perfecto by Perforce
Más de Perfecto by Perforce (20)
Último
Último (20)
How to Test on the Right Mobile Platforms
- 1. Choose the Right Digital Platforms for Dev & Test January, 2016
- 2. Presenters 1/21/2016 2© 2015, Perfecto Mobile Ltd. All Rights Reserved. Eran Kinsbruner Dir. Technical Evangelist Gil Kidron Dir. Product Management Gidi Pridor VP Marketing
- 3. A few housekeeping items 1. Submit questions using the Q&A panel. 2. Slides and recording sent after the webinar. 3. Please complete survey after the presentation.
- 4. “What devices/platforms/browsers should I test on to ensure efficient market coverage?” Answering the most common question
- 5. Agenda for Today 1/21/2016 5© 2015, Perfecto Mobile Ltd. All Rights Reserved. Discussion: How to plan your own coverage strategy Web test coverage insights & recommendations Trends & insights from Digital Test Coverage Index Edition 3
- 6. Coverage Strategy is Fundamental All-Around For the Business it’s market coverage • Great end user experience • Build requirement for IT • Optimize user engagement & rating For the Dev/QA it’s test coverage • Optimize process • Discover bugs early, mitigate risk • Continuously test on what matters
- 7. What does it take to cover the REAL end user experience? v Device & Platform Model OS Version Screen Size browser v Environment Location Network Phone events Other apps v Conditions Signal Load CPU
- 8. Device Test Cases iPhone 4 iPhone 4s iPhone 5 iPhone 5s iPhone 6 iPhone 6+ iPad Mini iPad Mini iPad Gen3 iPad Gen4 Samsung S4 Samsung S5 Samsung Note III Android 2.4 Android 4.4 Improving Test Coverage Through Automation Environment While Driving Cell Site handoff GPS Locations Under Load 4G LTE Wifi Improve Overall Quality - Run Test Automation as part of CI - Run Parallel Unattended Tests - Run Anytime & More Frequently
- 9. Test Coverage Optimization Process 2. Lab Sizing Teams Projects SDLC Cycle Requirements How many? v Me Analytics Market My Space Popular & emerging 1. Coverage Mix Industry trends & insights Which?
- 10. Test Coverage Optimization Process Me Analytics Market My Space Popular & emerging Industry Current state Internal External Future state The Index
- 11. What’s new? • Web browsers index • Canada and Australia index Digital Test Coverage Index 3nd Edition
- 12. Did you send a gift to your travel agent this Christmas? 1/21/2016 12© 2015, Perfecto Mobile Ltd. All Rights Reserved. Survey
- 13. One Experience on All Digital Platforms 1/21/2016 13© 2015, Perfecto Mobile Ltd. All Rights Reserved. Using multi-screens one after the other to accomplish one task requires one experience across all of those screens Mobile is the #1 platform to start the digital experience but it is only a part of a broader set of digital platforms Source: Google
- 14. 1/21/2016 14© 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 15. 2015 Retrospective – A Lot To Learn From… 1/21/2016 15© 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 16. The new index Web test coverage Index Recommended OS version Pixels per Inch Trend
- 17. U.S Index Q4 2015 Apple & Samsung Leads Legacy & Critical Devices
- 18. Canadian Index Q4 2015 Blackberry holds ~8% Share Apple & Samsung Leads The Market Chrome & IE On Win 7 dominate
- 19. Digital Test Coverage Index - Q4 2015 Key Insights & Trends 1/21/2016 19© 2015, Perfecto Mobile Ltd. All Rights Reserved. iOS 9 stabilized on 70% market share, iOS 8 holds ~20% Android stronger in Europe (EU5) than in U.S, Canada Windows Phone clearly stronger In Europe (10% share) Disruptive technologies (Touch ID, Force Touch) enhances fragmentation and test coverage (e.g. Samsung S7 vs. S6, iPhone 6S vs. iPhone 6) Mobile Insights
- 20. Digital Test Coverage Index - Q4 2015 Key Insights & Trends 1/21/2016 20© 2015, Perfecto Mobile Ltd. All Rights Reserved. Desktop browsers auto update forces an instant response for Dev/Test Laggards desktop OS users shift towards early adopters **Microsoft heavily pushes for Windows 10 adoption Users transition to new Chrome & Firefox OS version is swift (3-4 Days) Web Insights
- 21. A word about Screen properties • Screen properties (Size, Resolution, HW) Impacts • CPU, Battery, Performance • Often large screen size reduces PPI (iPad Pro e.g.) • Mixing various PPI levels assures better UX coverage (Responsive web, intensive UI apps) 1/21/2016 21© 2015, Perfecto Mobile Ltd. All Rights Reserved. Source: Mobile Jury
- 22. Mobile Market Calendar Force Touch Large screens trending Samsung 18.4’’, iPad Pro 12.9’’ Growing customer demand 1st Tablet by Google, 10’’, Android 6.x
- 23. Web Index Insights © 2015, Perfecto Mobile Ltd. All Rights Reserved. 231/21/2016
- 24. 2016 – The Web Chase 51 50 49 48 52 53 54 55 43 44 45 46 47 48 49 50 51 52 10.0.2 10.0 9.0.9 9.0.89.0.79.0.6 9.0.59.0.4 9.0.3 10.0.1 OS X 10.12
- 25. Today’s Browsers are Auto- Updated by Default 1/21/2016 25© 2015, Perfecto Mobile Ltd. All Rights Reserved. Dec 2nd Dec 5th 3 days 46 47 Dec 15th Dec 19th 4 days 42 43
- 26. New Version Adoption Rate (days) 1/21/2016 26© 2015, Perfecto Mobile Ltd. All Rights Reserved. USA 3 4 5 Europe 3 4 7 UK 3 4 5 Germany 3 4 7 Australia 3 4 6 India 3-4 4 7
- 27. News Flash 1/21/2016 27© 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 28. Microsoft Cleaning the Stables 1/21/2016 28© 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 29. …and Cleaning 1/21/2016 29© 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 30. The EDGE Factor 1/21/2016 30© 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 31. Too Many Choices 1/21/2016 31© 2015, Perfecto Mobile Ltd. All Rights Reserved. 48 51 50 49 48 52 53 54 55 43 44 45 46 47 48 49 50 51 52 10.0.2 10.0 9.0.9 9.0.8 9.0.7 9.0.6 9.0.5 9.0.4 9.0.3 10.0.1
- 32. U.S Index Q4 2015
- 33. Discussion – Planning your own Test Coverage • How to use the index when planning your own test coverage strategy? How to combine it with your own analytics data? • How often should you revisit the coverage plan • Who should be involved and sign off on the coverage plan? • The role of automation in increasing your test coverage • Are user conditions part of the coverage strategy? 1/21/2016 33© 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 34. Reminder Please Complete the survey Learn More: www.perfectomobile.com
- 35. Thank You
- 36. • 1) Assign a person in charge of continuously planning test coverage . • merging business requirements (which are often based on analytics) with Index report and market stats is a valuable to do item • 2) CI & automation is key to continuous quality. Build the lab based on the right coverage and cross platform test automatically to assure no regressions introduced when lab is refreshed by new device, new OS version, new browser/desktop permutation • 3) The index is a recommendation but it includes valuable platform characteristics such as recommended OSV, screen properties, legacy & new devices etc. - even if you decide to 1/21/2016 36© 2015, Perfecto Mobile Ltd. All Rights Reserved.
Notas del editor
- Submit questions using the Q&A panel. We try to answer all questions during and after the presentation. Our experts do not have access to the chat interface Participate in the polls Your participation is critical to a relevant, meaningful discussion. Watch your email for a copy of the recording and slides Today’s presentation will be recorded and sent to you. Complete the survey following the presentation Your feedback helps us provide educational tools like this webinar.
- User profile – Consider your end user real life experience
- What should you do with this data? Combine it with your own data and guidelines
- What should you do with this data? Combine it with your own data and guidelines
- gil
- In 2015 there were twice as many iOS releases than Android There are specific months which are “busier” than others (e.g. April – post MWC, September – Apple product/platform releases) – testing/dev can prepare in advance and be ready Technologies growing in 2015 involve more sensor based capabilities (Force touch, Finger print authentication, Mobile payments and smart watches)
- Mix of new & emerging as well as legacy is critical in the lab – iPad 2 & iPad air account for 40% of the iPad market. iPad Pro as an exception is being required to be tested by Enterprises since it has new characteristics and might get adopted as a tablet replacement.
- BB is still a relevant platform in Canada for both the old BB OS as well as the emerging BB on Android (Priv) Apple and Samsung are as well clear leaders in this country.
- R.I.P XP Microsoft stopped supporting windows XP at the end of 2015 Both Chrome and FF stopped supporting XP around that time R.I.P windows 8 On Jan 12th 2016 Microsoft stopped supporting windows 8 R.I.P old IE On Jan 12th 2016 Microsoft stopped supporting IE<11 Go Windows 10 Microsoft has stopped supporting windows 7 and 8.1 on new hardware profiles
- R.I.P XP Microsoft stopped supporting windows XP at the end of 2015 Both Chrome and FF stopped supporting XP around that time R.I.P windows 8 On Jan 12th 2016 Microsoft stopped supporting windows 8 R.I.P old IE On Jan 12th 2016 Microsoft stopped supporting IE<11 Go Windows 10 Microsoft has stopped supporting windows 7 and 8.1 on new hardware profiles
- Need a visual…
- FF 37 on Windows 10?
- Submit questions using the Q&A panel. We try to answer all questions during and after the presentation. Our experts do not have access to the chat interface Participate in the polls Your participation is critical to a relevant, meaningful discussion. Watch your email for a copy of the recording and slides Today’s presentation will be recorded and sent to you. Complete the survey following the presentation Your feedback helps us provide educational tools like this webinar.
- 1) Assign a team member who consolidates Index reports with business analytics and assure continuous coverage task is managed and maintained. merging business requirements (which are often based on analytics) with Index report and market stats is a valuable to do item 2) CI & automation is key to continuous quality. Build the lab based on the right coverage and cross platform test automatically to assure no regressions introduced when lab is refreshed by new device, new OS version, new browser/desktop permutation 3) The index is a recommendation but it includes valuable platform characteristics such as recommended OSV, screen properties, legacy & new devices etc. - even if you decide to include additional devices or change the mix based on your analytics, please make sure to keep the various mix of the above properties to assure high quality across screens, platforms etc. 4) Though reference devices do not often tend to be that popular from a market share perspective (e.g. Nexus devices) - their importance to the test coverage does not come from their market share but from the frequent OS updates these devices receives - making them the 1st in the market to run on the latest Android OS. These devices are a must in any test lab in today's market 5) From a desktop and web perspective there is a clear auto update mechanism for leading web browsers (e.g. Chrome) where the end users are not even aware to. The fast adoption of these new platforms due to them being transparently updated, forces Dev/Test teams to continuously update their lab and test on early Beta/Dev versions of these browsers so they are ready to support them on Day 1