A slide for system automation conference in Japan https://testautomationresearch.connpass.com/event/144768/

1. Beyond automated functional
checking for mobile
2019

2. •
• HeadSpin, Inc.
• Senior Software Engineer, Device Automation
• : ex-cookpad, ACCESS
• Test/QA/Software Engineer
• OSS
• Appium

3. •
•
• Observability
• Performance

4. •
• UI

5. •
•
• Observability Performance
• ( )

6. •
•
• Observability Performance
• ( )

7. UI Tests
Integration Tests
Unit Tests

8. UI Tests
Integration Tests
Unit Tests

12. https://confengine.com/appium-conf-2019/proposal/8746/uncovering-breaking-changes-behind-ui-on-mobile-applications

13. •
•
• Observability Performance
• ( )

14. 4
https://lisacrispin.com/2011/11/08/using-the-agile-testing-quadrants/

15. 4
https://lisacrispin.com/2011/11/08/using-the-agile-testing-quadrants/

16. •
•
• Observability Performance
• ( )

18. • Observability
• Monitoring
• Logging
• Tracing
• Analytics
• Alerting
• etc

19. • Testing using real
device [ADOPT]
• By Technical
Radar
• Performance

20. •
•
• Observability Performance
• ( )

21. Performance
• CPU GPU
• FPS View
•
•
https://github.com/KazuCocoa/droid-monitor

22. • Android
• adb (adb dumpsys ), Benchmark (Nov 20, 2019 1.0.0)
• iOS
• instruments, measureMetrics (Xcode 7.2 +), XCMetric (Xcode 11.0 +)
• Appium
• (iOS) mobile:startPerfRecord/mobile:stopPerfRecord
• (Android) Get Performance Data
https://developer.android.com/studio/command-line/dumpsys
https://developer.android.com/jetpack/androidx/releases/benchmark
https://developer.apple.com/documentation/xctest/xctestcase/1496290-measure
https://developer.apple.com/documentation/xctest/xctmetric
https://appium.io/docs/en/commands/device/performance-data/get-performance-data/
https://appium.io/docs/en/commands/mobile-command/

23. https://github.com/KazuCocoa/droid-monitor

24. Observability(Monitoring)

25. Observability(Monitoring)
•
•
•
•

26. Observability(Monitoring)
•
•
•
•
•

27. Observability(Monitoring)
•
•
•
•
•
•
• ( )

29. • HeadSpin
• Google Test Labs
• Amazon Device
Farm
• etc

30. • CI/CD
• Observability

31. • SREcon18 Europe - SRE for Mobile Applications: Samuel Littley, Google
• https://youtu.be/4pQP8xiiMgo
• Mobile performance testing at Slack: Valera Zakharov
• https://youtu.be/xKMIGN1WHgo
• ThourghtWorks, Technology Rader
• https://www.thoughtworks.com/radar

32. • Performance
• https://developer.android.com/studio/command-line/dumpsys
• https://developer.android.com/jetpack/androidx/releases/benchmark
• https://developer.apple.com/documentation/xctest/xctestcase/1496290-measure
• https://developer.apple.com/documentation/xctest/xctmetric
• https://appium.io/docs/en/commands/device/performance-data/get-
performance-data/
• https://appium.io/docs/en/commands/mobile-command/

33. • HeadSpin
• https://www.headspin.io/
• Google Test Lab
• https://firebase.google.com/docs/test-lab/
• Amazon Device Farm
• https://aws.amazon.com/device-farm/

34. email: kazucocoa1117@gmail.com
Twitter: @Kazu_cocoa