The presentation on HikeRunner: Load Test Framework was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author. Author and presenter : Harsh Verma

1. #ATAGTR201
7
16th 17th March
HikeRunner: LoadTestFramework
- Siva Subramanian
- Harsh Verma

2. Agile Testing Alliance Global Testing Retreat 2017
Indian Messaging App
● Launched globally in December 2012
● 100m+ users
● 40 billion + messages per month
● iOS/Android
Based in
● Bengaluru
● New Delhi
What we do at Hike?

3. Agile Testing Alliance Global Testing Retreat 2017
Why Load Test Hike ?
● 100+ Millions users, 40 billion+ messages per
month
● To mimic user journey based on analytics data
● To cover all permutations of user flows
● To scale infra systems based on results
● To find performance degradation point of Hike
services
Our Solution : HikeRunner

4. Agile Testing Alliance Global Testing Retreat 2017
Metrics we take into consideration ?
● Throughput
● CPU Utilization
● Memory Consumption
● Network Bandwidth
● Latency
● Load Average on system

5. Agile Testing Alliance Global Testing Retreat 2017
HikeRunner: LoadTest Framework
HikeRunner: In-house Load Test Framework to mock
user journey based on data from analytics system.
● Mimic Real Time Scenarios
● Vertically load test any service
● Robust and easily scalable
● Can be used for soak testing
● Benchmark(releases), throughput
● Help in finding bottleneck in system
What it does:

6. Agile Testing Alliance Global Testing Retreat 2017
Architecture of HikeRunner

7. Agile Testing Alliance Global Testing Retreat 2017
Load Configurator Config

8. Agile Testing Alliance Global Testing Retreat 2017
Generator Json Output
{"plan":[{"offlineMode":false,"task":"SignUpHttpTask","data":[{"considerUsers":2,"activeUsers":2}]
,"actions":[{"action":"SignUp"}]},{"offlineMode":false,"task":"OneToOne","data":[{"considerUsers"
:2,"activeUsers":2}],"actions":[{"action":"HikeToHike"}]},{"offlineMode":false,"task":"Multiforward
MessageTask","data":[{"considerUsers":14,"activeUsers":15}],"actions":[{"action":"Multiforward"}]
},{"offlineMode":false,"task":"FileTransferTask","data":[{"considerUsers":2,"activeUsers":2}],"actio
ns":[{"action":"FileTransfer"}]}]}

9. Agile Testing Alliance Global Testing Retreat 2017
CI Integration- HikeRunner

10. Agile Testing Alliance Global Testing Retreat 2017
Generated Report
● Throughput
● Cpu Utilization
● Latency
● Threshold Point
● Benchmark(successive releases)
Load generated Hike Messages
Latency, Threshold point
Active connections results

11. Agile Testing Alliance Global Testing Retreat 2017
Demo: HikeRunner

12. Agile Testing Alliance Global Testing Retreat 2017
Our Key Takeaways:
● Mocking user journey based on analytics help us finding bottleneck
points, performance degradation at various layers of db/cache/service
● Assertion scripts are useful to find threshold point and generate alerts
● Infrastructure scalability can be taken into consideration based on load
generated results
● Disk Utilization and archiving of generated component logs.

13. Agile Testing Alliance Global Testing Retreat 2017
Questions?

14. Agile Testing Alliance Global Testing Retreat 2017
Siva Subramanian (Specialist SDET)
Hike Messenger
Linkedin: https://in.linkedin.com/in/siva-
subramanian-537b227b
Email : siva@hike.in
Mobile : 9916205202
Harsh Verma (SDET)
Hike Messenger
Linkedin :
https://in.linkedin.com/in/harshverma59
Email : harsh@hike.in
phn : 7042060555