2015 AT&T Developer Summit
•Descargar como PPTX, PDF•
0 recomendaciones•775 vistas
You’ll never believe the crazy tricks top mobile app developers have learned in order to make their mobile apps run faster and leaner. Embarrassing performance mistakes are much more common that than you might believe…but are insanely easy to fix. In our talk, we’ll walk through five simple steps that will help ensure your mobile application is the fastest, most efficient application on mobile devices today. You’ll walk out of our session with the tools to quickly identify the issues and the knowledge to solve them. It’ll be the most useful talk you’ll hear all day!
Recomendados
Recomendados
Más contenido relacionado
Destacado
Destacado (16)
Similar a 2015 AT&T Developer Summit
Similar a 2015 AT&T Developer Summit (20)
Más de Doug Sillars
Más de Doug Sillars (20)
Último
Último (20)
2015 AT&T Developer Summit
- 1. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Doug Sillars High Performance: What These Apps Did May Shock You ARO Technical Lead @Dougsillars
- 2. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. The Next 40 Minutes Will Change Your App
- 3. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Developers Make This Mistake Everyday, And it’s Killing Their Customer’s Battery • Data Connections account for: • 40% of battery use (screen on) • 70% screen off http://thenextweb.com/dd/2013/08/05/how-to-minimize-your-mobile-apps-power-consumption/ http://commons.wikimedia.org/wiki/File:Free_EV_charge_station_sign_evinfra.svg
- 4. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. • Cellular Networks are High Latency Environments • Not Optimizing Your Content can lead to delays: • 500ms: • 26% frustration • 8% engagement • Amazon.com: 100ms delay • 1% revenue • 4% of mobile users admit to throwing their phones You Won’t Believe What Else Network Connections Do http://www.flickr.com/photos/9009139@N08/1263954439 http://blog.radware.com/applicationdelivery/applicationaccelerationoptimization/2013/12/mobile-web-stress-the-impact-of-network-speed-on-emotional-engagement-and-brand-perception-report http://www.mobilejoomla.com/mobile-joomla-blog/172-responsive-design-vs-server-side-solutions-infographic.html
- 5. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Is Performance Holding Your App Back? Retention Rate Usage Lifetime Value Lifetime Value Active Users Session Length Average Revenue per user App Launch/Load Time User Acquisition User Experience/ Happiness
- 6. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. One Developer Tried This One Simple Trick… Discovery Adoption Trial 48% of customers abandon if dissatisfied with the performance of a mobile app http://www.tatvic.com/blog/churn-analysis-for-mobile-app/ http://offers2.compuware.com/APM_13_WP_Mobile_App_Survey_Report_Registration.html
- 7. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Understanding Application Performance
- 8. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Just Because Someone Says “Unsinkable” 98% of apps tested have potential Performance Optimizations http://commons.wikimedia.org/wiki/File:RMS_Titanic_3.jpg https://www.flickr.com/photos/kb-monkeywrench/3639224089/
- 9. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Death by a Thousand Cuts Or, It Isn’t Always the Iceberg Minor issues found in testing Big problems at scale http://en.wikipedia.org/wiki/Hans_Brinker,_or _The_Silver_Skates#mediaviewer/File:Hans_Br inker_Madurodam.jpg
- 10. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. • 44% of all issues are reported by users • 20% issues were only found because of complaints in app reviews Helps to Find Issues Early Successful Applications Find That Testing http://info.perfectomobile.com/rs/perfectomobile/images/why-apps-fail-infographic.pdf
- 11. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. The Bigger They Are… The Quicker Small Issues Magnify
- 12. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Find My Goat*
- 13. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Find My Goat • Connecting to the network every 5 seconds • Creating a new connection every time • 18x more connections than this app’s architecture team expected • The triage team discovered that IP/port collisions = loss in sales
- 14. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Computers Are Great at Repetitive Stuff… http://commons.wikimedia.org/wiki/File:Assen_Gert_Sennema_-_Sisyphus_1.jpg http://commons.wikimedia.org/wiki/File:All_work_and_no_play_makes_Jack_a_dull_boy_(The_Shining)_(7957738500).jpg But Don’t Punish Your Users
- 15. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Repetitive Download vs. Caching 100 seconds to load
- 16. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Caching Enabled!! 30 second startup 2nd startup
- 17. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Major Snap Sales App http://pixabay.com/en/woman-smartphone- chatting-girl-410320/
- 18. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. World Famous Goat Racing Was $79, Now $39 User has to wait for image to load Thumbnails or Dumbnails… Downloading the same image twice, in different sizes, doesn’t make sense. Download it once and use it in multiple ways. 54 kb 198 kb World Famous Goat Racing Was $79, Now $39
- 19. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Major Brick and Mortar Retailer Image: http://pixabay.com/en/woman- shopping-happy-bags-dresses-169286/
- 20. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. A Rolling Stone Gathers No Moss, but Spinning Wheels Kill Sales http://www.lukew.com/ff/entry.asp?1797 “With the introduction of these progress indicators, we had made people watch the clock. As a result, time went slower and so did our app.” ~ Luke Wroblewski
- 21. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. AT&T DriveMode
- 22. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. AT&T DriveMode for Android 3 min 480 GPS connections/24hr ~20% Battery
- 23. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. AT&T DriveMode for Android Use activity APIs to identify when your users are in motion 11 minute trace DetectedActivity.IN_VEHICLEDetectedActivity.ON_BICYCLE:DetectedActivity.ON_FOOT: http://commons.wikimedia.org/wiki/File:Baby_goats_jan_2007_crop.jpg http://commons.wikimedia.org/wiki/File:Goat_in_a_car.jpg http://commons.wikimedia.org/wiki/File:2009_goat_and_bicycle_in_India_6512003001.jpg
- 24. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Major Sports Reporting Application • Regular NFL season Sept 4 – Feb 1 • 50,000,000 installs on just Android • So what would you expect the behavior of the app to be in June at 2am? https://www.flickr.com/photos/perspectiv e/33330283/
- 25. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Major Sports Reporting Application Pinging the network 3 minutes 24 x 7 x365 Consider 70,000 fans in a stadium with this app trying to hit the network
- 26. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Advertising Could Be Killing Your App • Consider your advertising partner like you would a business partner • Do they compress their content? • Do they close their connections? Caching?
- 27. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Most of these issues have already been fixed by the app developers we’ve worked with, but if you’re wondering why the tops apps are staying on top, it’s because they are constantly checking and watching all of these Best Practices. Constant Improvement
- 28. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Don’t Over Think Performance Testing http://www.glendaleinquiry.ca/2014/09/what-were-we-thinking.html
- 29. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. The Excuses Time Usage Why fix something that isn’t broken Skill sets Return on Investment Cost Everyone else does the same thing Too much effort Users haven’t complained
- 30. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Performance Testing Guidelines http://smarterappsguidelines.gsma.com/ http://knowmyapp.org/ http://www.appqualityalliance.org/aqua-performance-test-criteria http://developer.att.com/application-resource-optimizer
- 31. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. • Free Tools: • Application Resource Optimizer • Network Attenuator • Trepn • Android • Systrace • Battery Historian • Etc. • Two tests (minimum) • 40 minutes total testing time Keep it Simple
- 32. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. What You Find Might Surprise You Active Use Idle Use What the User Wants What the App Needs GPS
- 33. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. AT&T Defects Duplicate Content <5% of KB 5-20% of KB 20+% of KB Periodic Connections 0-20% of Power 20-50% of Power 50+% of Power GPS/BT 0-25% Active (s) 25-65% Active (s) 65+% Active (s) Text Compression 100-500KB 500-1000KB 1000+KB Closing Connections 0-20% of Power 20-50% of Power 50+% of Power Sev 3 Sev 2 Sev 1
- 34. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. • Encourage testers to move at a speed that emulates real users • Create flexible (yet reproducible) test cases • Test cases can even reflect more of a feature checklist • The Trace is not about the order of the features, but about the content • Don’t limit testing to 2 traces if additional are needed • Some streaming apps can have a trace with just streamed content • Some apps are most inefficient at startup • Be Curious • If something seems odd, explore it • Screen rotation best practice came out of tester noticing the network lighting up each time they turned the device Trace Collections Hints
- 35. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. http://bit.ly/HighPerfAndroidApps
- 36. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Q&A http://smarterappsguidelines.gsma.com/ http://knowmyapp.org/ http://www.appqualityalliance.org/aqua-performance-test-criteria http://developer.att.com/application-resource-optimizer http://bit.ly/HighPerfAndroidApps
- 37. © 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T. Thank You
Notas del editor
- TK: Hi Everyone and Thank you for joining us. Today we’re going to be talking about App Performance, specifically we’ll be looking at real examples of mistakes that some of the top apps make, so that you can avoid them. We’ll also give you a simple testing plan to improve your own app, before the app store reviews get ahold of them.
- TK …I think the next 40 minutes will fly by and help everyone improve their mobile apps. When we started looking at app performance 3 years ago, NO one was talking about it. Since then, we’ve worked with some of the largest development teams in the world. We’ve worked with the largest social networks, shopping apps, games, OEMs and even Platform providers to bring performance to the foreground. This year alone, we’ve tested more than a 1000 apps, and continue to find Performance issues that we think we can use to teach you how to improve your app.
- TK When we talk about performance, we focus on how the network connections are impacting customers. And it may have a bigger impact than you think. Data connections account for 40% of the battery life when the screen is on, and 70% of the battery life with the screen off. When we first started testing apps, we focused our testing on actively using the app, but shortly afterwards, we found the biggest impacts were when the apps were in the background or even just idle. As we look at examples today, I want you to have a little background information on the RRC state machine. The RRC state machine is essentially the antenna on the device, and many developers aren’t aware, that every time the antenna is opened, it says open for an extra 15 seconds after the last data is pulled down…. In the example here, you can see that RRC state machine powers up (here in Red) and stays active after the first group of data comes down. When it stays open the antenna is at full power. Then as another group of packets comes down at 50 seconds, the antenna stays open again until it finally turns off at 64 seconds. While 24 seconds of antenna power isn’t extreme in this screen shot, We often see this behavior repeated for the entire time a user is in an app. 10, 15, 25 minutes or more of the app not giving the battery second to rest. I So Just keep that in mind as we look at the rest of the examples, We’ll be showing how the RRC state machine is affected with each example.
- TK Some times we get push back …by focusing on the network, but honestly it’s the black box that can make or break your app. Just a 500 millisecond delay can increase user frustration by 26%, Decrease user engagement by 8%... And even a minor 100 millisecond delay can reduce Amazon’s revenue by 1% …. And our best stat of all is that High latency can lead to 4% of mobile users throwing their phones…. Admit it.. We’ve all been there. Just think of your raise, when you walk into your bosses office and show them that you can reduce customer frustration, and increase engagement and revenue. It’s our job to help developers get there everyday…. Well, we can’t help with the raise, but the rest we can.
- OK OK So your boss, doesn’t think “Performance” is something you need to focus on…… Well chances they do want you to focus on User Retention Rate, App store rating, User Acquisition Cost and things like Average Revenue per user. The more we research performance, the more we discover how performance influences all of these important application stats.
- DS
- DS
- DS Repeatedly we hear, “But not my developers… They‘re the best…. That issue is so minor it won’t affect my customers….” 98% of all the apps we test have some sort of optimization What appear to be minor issues are responsible for killing user batteries and slowing down applications to a point where revenue is being lost…. “I can’t even test my own app without it being plugged into an outlet because it drains so much battery”
- DS: Repeatedly we hear, “But not my developers… They‘re the best…. That issue is so minor it won’t affect my customers….” 98% of all the apps we test have some sort of optimization What appear to be minor issues are responsible for killing user batteries and slowing down applications to a point where revenue is being lost…. “There was a 4kb file that came down each time the app was launched and I didn’t think it was a big issue, until at launch we had so many downloads and new users that it took down our servers. Then we realized how much revenue we were losing every minute our servers were down.”
- TK Those of us that come from a testing background, drive home “TEST TEST TEST. Test early test often” Sometimes I feel like I get a little preachy. But developers are getting hit hard by application reviews, and most users will only give you that one shot. We’ve got to put our best foot forward. Users are getting smarter too. While crash screens are obvious, users expect their apps to load in less than 4 seconds… Actually that’s the stat from a few years ago, it’s moving down toward 2 seconds. When I heard that, I immediately pulled out my phone and started launching apps to see how long they take to load. 4 seconds goes by quicker than you think and 2 seconds well… it’s tough. Try it tonight when you’re in your hotel, pull out your phone and launch an app that you would expect to be at the top of it’s game. Preferably one that you haven’t used in a while. And see how long it takes…. Put your phones away, I didn’t say do it now.
- TK
- TK: We all know Doug loves his farm animals. He actually does have a few goats at home, and we like to incorporate goats into all our presentations. We’ve had a little fun with the examples we’re showing today, and put goats in as often as possible. Find my Goat is an application that brings together Goats and riders. Riders request a goat and the goats mobile device lets the goat know where he needs to go. Find my Goat has seen tremendous success, but one day there was trouble in Goatville, when there was a sudden drop in sales reported. Image: https://www.flickr.com/photos/68919440@N05/6269603592/in/photolist-nuiq6T-bTKEXz-beHLNH-cWRPWA-7Ztgj6-bGT5rF-joN57z-irVKZ4-9y3tkW-8FDAqc-oKAvgN-buRoNN-6XLEt-ddRZJ-aEAwr-d2gnrh-gUbVCV-hqWXPa-b3FmqZ-hr81FU-92UxSM-aX9rHF-2VSy9v-negLWP-apVG8d-dNs5gT-dAog6U-dqmHYT-dH9Xfd-ei6orG-ay2mHE-bc6Ryg-fGnRGf-aRHExn-7JUXEc-9iy5ko-8X6JYv-bPzDS4-mS1Rbv-b3Fxuv-eXkN8A-b3FrRk-b3FsHT-aUusft-9CHUJ3-f47gFM-fZt3Sk-d9B6ps-f47fDD-6diGxW/ Usability starts with the design and architecture OS ie: Cross platform inter-relations (Drive app vs Customer app) Small issues become magnified No sandbox Tiny issues become exponential when multiplied by an entire platform Growth of product matrix needed early
- TK: During a network test of Find my Goat, we found that the app was connecting to the network every 5 seconds……. So we know this is terrible for the battery, we can see that the RRC state machine is never able to rest, but on top of being hard on battery life. We discovered the app wasn’t reusing the same connection but creating a new connection each time…This turned out to be 18 times more connections than the architecture team expected and IP/port collisions were causing the loss in sales. Again, this is something that normal UAT testing wouldn’t show you. If you have 15 testers in a room, they may not have any issues, but when you are able to take an image like this to your architects and say “Are our servers ready to handle this for our 100,000 or more users?” it paints a different picture. You start to be able to see how these small connections start scaling. The other thing that I want to point out is the Throughput…. Notice how the throughput are a series of small blips. We often see this with streaming apps. We highly recommend grouping data, send out a larger batch of data, let the connection close and then reopen it. Often times we can cut loading time and reduce battery drain by just grouping data. Usability starts with the design and architecture OS ie: Cross platform inter-relations (Drive app vs Customer app) Small issues become magnified No sandbox Tiny issues become exponential when multiplied by an entire platform Growth of product matrix needed early
- DS
- DS: Netflix (Caching and Duplicates) (Can use example from Doug’s deck) Speed of app at startup Labs study where 17% of all content is dups How much of does that affect your servers if you remove 20% of all content served? Types of Caching Etags vs cache control Etags up to 3 seconds latency for connection
- DS: Netflix (Caching and Duplicates) (Can use example from Doug’s deck) Speed of app at startup Labs study where 17% of all content is dups How much of does that affect your servers if you remove 20% of all content served? Types of Caching Etags vs cache control Etags up to 3 seconds latency for connection
- TK I’ll be the first to admit that I love a good deal. I’m sure I’m the perfect demographic for these apps. We’re all bored with our standard date night,…sushi rolling lessons (Sweet), Painting and wine (I’m down for wine) , Goat racing….. Um, maybe…. http://pixabay.com/en/woman-smartphone-chatting-girl-410320/
- TK We lovingly call thumbnails…. Dumbnails in our group. Downloading the same image twice, just doesn’t make since. Download it once and use it multiple ways. You can see these cute little Racing goats here, but when you click on the offer, you are faced with a blank screen. Meanwhile the app has requested a new image to be downloaded…. It’s the same image… 4 times larger…. Remember just 100 milliseconds decreases amazon’s revenue by 1% if the user is faced with a blank page for several seconds, chances are the user is going to not wait for that image to load. Reusing that initial image from cache would be displayed almost instantaneously. What we aren’t showing here is that when the user clicks on the goat racing deal, They encounter a blank page while that second image downloads… Image: http://www.buzzfeed.com/ailbhemalone/6-adorable-photos-of-the-oxford-cambridge-goat-race
- TK Not all apps, are a companies first source of revenue. An executive of this company, said that this app was designed to help bring users into the store after browsing in the app. Great, so ease of browsing should be the top priority in this app. Image: http://pixabay.com/en/woman-shopping-happy-bags-dresses-169286/
- TK Well… how many users are excited to see a whole screen of spinning circles. Each of these Dumbnails, I mean Thumbnails are 250 KB * 9 = 1.75 MB Progress indicators actually hurt the perception of how long it’s taking to load the images. At the very least remove the spinning circles, but there is so much more we can do here. Reducing the image size, and caching those images and again, just reuse them for the detail page. One level of loading screens is bad but two is worse.
- DS
- DS: Drive mode - GPS Battery impact Utilize existing API’s to identify user movements
- DS: http://commons.wikimedia.org/wiki/File:Baby_goats_jan_2007_crop.jpg http://commons.wikimedia.org/wiki/File:Goat_in_a_car.jpg http://commons.wikimedia.org/wiki/File:2009_goat_and_bicycle_in_India_6512003001.jpg
- TK Image: https://www.flickr.com/photos/perspective/33330283/ Usability starts with the design and architecture OS ie: Cross platform inter-relations (Drive app vs Customer app) Small issues become magnified No sandbox Tiny issues become exponential when multiplied by an entire platform Growth of product matrix needed early
- TK I’m a football fanatic, my boys play, we have season tickets to our college games, and we love to be in Century Link field when our World champion Seattle Seahawks take the field. But when I’m in the stadiums, I cringe at the thought that every single phone for each of the 70,000 people in the stadium could have multiple apps that are all connecting absently to the network. This actually happens to the analytics on this app. The Developers of this app had no idea that this was happening all the time. When we test, we normally ask our testers to do a 20 minute idle test, but sometimes when we see this type of behavior, we ask to let the testers to let the test run overnight. We’ve even done 24 hour tests, again to show that this is a small issue that magnifies when you expand these connections over a 24 hour period for all your users.
- TK App is IDLE. Ads downloaded every 30s. Files are not compressed (extra data, more time) Connections are not closed (blue bars) battery drain
- TK
- http://www.glendaleinquiry.ca/2014/09/what-were-we-thinking.html TK
- TK
- DS
- DS
- Text Compression Applications use text files in ways that the user wouldn’t expect and/or can’t see. Opportunities to gzip text files will be identified during a normal Active trace. Duplicate Content Testers will need to navigate back to some screens that they navigated through earlier in the trace to test caching and duplicate content. Closing Connections Opportunities to Close connections will be identified during a normal Active trace. Bluetooth If the application uses Bluetooth, it’s good to use the feature that launches Bluetooth early in the trace, as it will give an opportunity to see how long it stays on during the rest of the trace. GPS If the application uses GPS, it’s good to use the feature that launches GPS early in the trace, as it will give an opportunity to see how long it stays on during the rest of the trace.
- DS