Slides from a seminar done in January 2013 by Dynacron Group. Note that these slides are from a hands on presentation & demo - come to our next seminar to get the full effect.
http://www.dynacrongroup.com/newsletter
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
QA Lab in the Cloud
1. 1/28/2013 1
QA LAB IN THE CLOUD
Dynacron Group
Slides from Jan 2013 Seminar
2. 1/28/2013 2
Summary
• These slides are from a January 2013 seminar
by Dynacron Group
• The slides were intended to be viewed as part
of a demonstration
• We’ll probably post video of it next time
• To stay in touch, sign up for our newsletter!
• http://www.dynacrongroup.com/newsletter
12. 1/28/2013 12
About Neustar:
• Among other services, Neustar offers cloud-based
load testing.
13. 1/28/2013 13
Why choose cloud-based load
testing?
• Identify bottlenecks/unusual performance issues
before going live.
• Local load testing adds unnecessary load to
network/cpu.
• Local load tests originate in one location.
14. 1/28/2013 14
What does Neustar have to
offer?
• Real browser tests
Browser: Firefox
Asynchronous calls included or blacklisted
Screen shots, video playback of failures
• Basic tests
Headless Http client
Ideal for testing web services
10x cheaper than real browser tests
Direct Http calls, faster performance
15. 1/28/2013 15
What does Neustar have to
offer?
• Schedule tests, ramp up users to peak load.
• Tests originate from multiple IPs/geographical locations.
• Integrated metrics/report publishing.
• Query and export test results.
• Local and UI script validation.
16. 1/28/2013 16
Anatomy of a test script:
Test scripts written in Javascript
Tests occur
in a
transaction
A transaction
is comprised
of steps
18. 1/28/2013 18
Gotchas
• File based test resources are unreliable.
• Limited script size (Too many instructions exception).
• Limited client-side SSL support.
• Heap size issues running basic tests.
19. 1/28/2013 19
Gotchas
• No failure pagination (Large failure list causes logging
page to become unresponsive).
• Firefox-only in browser tests (Chrome support on
2013 roadmap).
• Number of available agents dependent on origin
datacenter (eg: more in DC than Oregon).
• Too many pauses/waits can cause transaction to fail.