Webinar deck describes key web performance testing tips to assure retail website readiness. Examples cover in-flight web performance testing projects delivered by SOASTA using the cloud computing based CloudTest platform.

1. Best Practices in
Performance Testing
Webinar Series

2. In This Webinar:!
Here come the holidays!
I. The Top 5 Keys to Web & Mobile Performance Readiness
II. Real World CloudTest Case Studies with the SOASTA Performance
Team
III. Discussion & Q&A
TODAY’S PRESENTERS
Dan Bartow: VP Product Management, Evangelist
Amit Patel: Sr. Performance Engineer
Brad Johnson: VP Product Marketing
Questions: Submit in the question box during event

3. #1 - Use The Cloud for Realistic Results!
Low cost, unlimited scale & global availability deliver…
Most accurate models
of real user behavior
Meaningful scale &
appropriate concurrency
Control to start, stop & modify
tests without delays
Testing on your
schedule

4. #2 Measure across the entire application !
Measuring user response time may indicate a problem!
Constrained Load Scenarios
Web Applications
User Experience
!
slow

5. #2 Measure across the entire application !
Measuring everything captures the source of delays!
Accurate Scale Load & Business Flows
Complex Web Applications : AJAX, HTML5, video, mobile, web services
Application
Deployment
Deployment
Component &
Infrastructure
Infrastructure
Network
User Experience
Code
(Internal)
(External)
Why
Slow?

6. #3 Correlate in real-time during test execution!
Drill down into the cause while issues are occurring

7. #4 Compress Test Build & Execution!
More tests, less time, high coverage = less risk
Traditional
Approaches
TIME
Cloud Test

8. #5 Test for Failure!
Broaden the scope of coverage to worst cases
Failover Scenarios
Chaos Monkeys
Success Disasters

9. SOASTA Case Studies
Dan Bartow and Amit Patel
- Current Engagements –
- Fresh Data –
- Leading Companies -

10. CloudTest Live!
Production Testing Veterans, Year Round
Company Profile Project Profile
Company
Retailer
Environment
Stage and Production
Size
Top 10 Retailer
Application
Java, ATG, Oracle
Multiple Dedicated
Location
Private Data Centers
Objective
150,000 Concurrent
Project Length
Year Round

11. CloudTest Live!
Production Testing Veterans, Year Round
Discipline and Rigor
• Comprehensive Test Cases
• Two Datacenters, Thousands of Servers
• Mobile App Testing
• Geographically Relevant Load Generation
• Near Daily Production Testing Across 7 Properties
• The CDN is a Big Player

12. CloudTest Live!
Success Through Constant Testing and Improvement

13. CloudTest Live!
Comprehensive Testing Plan
Company Profile Project Profile
Company
Toy Manufacturer
Environment
Production
Hosted Private Data
Size
Fortune 500
Location
Center
Test Multiple Web
Objective
Properties
Project Length
< 1 Month

14. CloudTest Live!
Comprehensive Test Plan
Thorough Coverage
• Fairly High Level Test Cases
• One Datacenter, Handful of Servers
• Baseline, Spike, Failover, Stress
• Flex Based Apps, Browser Based Games
• Cloud Based Load Generation
• Executed in About Three Weeks
• The CDN is a Big Player

15. CloudTest Live!
Thorough Coverage – Great Results

16. CloudTest Live!
Large Testing Initiative
Company Profile Project Profile
Company
Retailer
Environment
Stage and Production
Size
Fortune 50
Application
Java, Oracle
Multiple Dedicated
Location
Private Data Centers
Objective
30,000 Concurrent
Project Length
Ten Months

17. CloudTest Live!
Large Testing Initiative
Testing, Testing, Testing!!!!
• Two Work Load Models
• Two Environments
• Infrastructure Testing
• Application Testing
• 24/7 Testing

18. CloudTest Live!
Large Testing Initiative
Success!

19. CloudTest Live!
Real-world Issue Resolution
Company Profile Project Profile
Company
Music Retailer
Environment
Stage
Hosted Private Data
Size
Fortune 1000
Location
Centers
Test Multiple Web
Objective
Properties
Project Length
< 1 Month

20. CloudTest Live!
Real-world Issue Resolution
• Scaling Issues • High Response Times • Timeout Errors

21. Q&A
About SOASTA
• Founded in 2006, privately held Contact SOASTA:
• Silicon Valley HQ: EMEA & N/A offices www.soasta.com/cloudtest/
• 1 Platform: 6 CloudTest Editions: info@soasta.com
– Lite: Free performance testing at any stage
– Mobile: Mobile performance testing
866.344.8766
– Standard: Internal performance testing Follow us:
– Pro: External & internal testing to any scale
– Enterprise: Multi-division solution
– On-Demand: Complete testing service