CA Technologies Performance Testing-in-a-Box allows companies to test applications more quickly by eliminating test resource constraints, provisioning quality reusable data and scaling tests to millions of users . Learn from this presentation how to virtualize production systems, generate quality test data and stress test with millions of virtual users to significantly improve application quality and stability. For more information, please visit http://cainc.to/Nv2VOe

1. Ready, Set, Shop!
The Pressure is on For Your
Applications to Perform Flawlessly
before the Holiday Rush
Jeff Hughes
DevOps: Continuous Delivery
CA Technologies
Application Delivery
D03T37T
@yourtechtrends
#CAWorld

2. 2 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
For Informational Purposes Only
© 2015 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.
The content provided in this CA World 2015 presentation is intended for informational purposes only and does not form any type of
warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.
Terms of this Presentation

3. 3 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Abstract
CA Technologies Performance Testing-in-a-Box allows
companies to test applications more quickly by eliminating test
resource constraints, provisioning quality reusable data and
scaling tests to millions of users . Learn from this presentation
how to virtualize production systems, generate quality test data
and stress test with millions of virtual users to significantly
improve application quality and stability.
Jeff Hughes
CA Technologies
Product Marketing
Manager

4. 4 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Agenda
APPLICATION TRENDS & TESTING CHALLENGES
CA’S VISION OF THE APPLICATION ECONOMY
THE SOLUTION
ENVIRONMENTAL CONSTRAINTS
WRONG TEST DATA
LACK OF SCALE TESTING
1
2
3
4
5
6

5. 5 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Are Your Applications Ready for Prime Time?
51% of online shoppers in the
US say that site slowness is the
top reason they’d abandon a
purchase.*
* Akami Interview: http://www.neotys.com/blog/load-testing-with-a-cdn/

6. 6 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
The Performance Testing Challenge
 Testing Remains Ad Hoc and Incomplete
 Testing Relies on Accessing Production
Systems that are often Unavailable
 Test Data is Incomplete and Difficult to
Create
 Testers Need to Stress Test with Thousands
(or Millions) of Users

7. 7 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
DESIGN RELEASE
CA’s Vision for the Application Economy…
Quicker Time-to-market with Better Collaboration, Quality, with Security
OPERATIONS
MONITORING
COLLABORATIVE
PORTFOLIO PLANNING
CONTINUOUS FEEDBACK
DEVELOP
MODEL
TEST
CONTINUOUS PLANNING CONTINUOUS INTEGRATION & DELIVERY CONTINUOUS OPERATONS
API MANAGEMENT
RELEASE AUTOMATION
SERVICE
VIRTUALIZATION
TEST DATA
MANAGEMENT
AGILE PLANNING
PERFORMANCE &
CAPACITY MGMT
App Governance DevOps Enterprise Reliability
SECURE
MOBILE END-USER
APPLICATION ANALYTICS
& DIAGNOSTICS
CLOUD TESTING

8. 8 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Key Performance Testing Challenges
ENVIRONMENTAL
 Pre-production environment
is not representative of
production
 Application components
delivered on different
timelines
DATA – NOT FIT FOR
PURPOSE
 Insufficient
 Not representative of
production
 In ability to quickly reset to
the baseline
TRANSACTION LOAD
GENERATION
 Appropriate transaction
mix to represent
production
 How to address injection
points that are
representative of
production
 Monitoring of results – real
time

9. 9 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Solving for the – Performance Testing Pitfalls
ENVIRONMENTAL
 Pre-production environment
is not representative of
production
 Application components
delivered on different
timelines
DATA – NOT FIT FOR
PURPOSE
 Insufficient
 Not representative of
production
 In ability to quickly reset to
the baseline
TRANSACTION LOAD
GENERATION
 Appropriate transaction
mix to represent
production
 How to address injection
points that are
representative of
production
 Monitoring of results – real
time

10. 10 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Service Virtualization: Why It’s Needed
“I can’t do anything
until I have everything
…
and I never have
everything!”
Data
Constraints
System
Constraints
Cost
Constraints
Parallel Dev
Constraints
Bottlenecks
Everywhere

11. 11 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Service Virtualization Eliminates
Dev/Test Constraints
“I have
everything
I need, when
I need it!"
SV … like Wind Tunnel
for Fight Simulation
Mainframe
System of
Record
ERP SaaS/API
Availability Sync Capacity Cost
System Under Test

12. 12 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
“I have
everything
I need, when
I need it!"
Service Virtualization Eliminates
Dev/Test Constraints
SV … like Wind Tunnel
for Fight Simulation
Mainframe
System of
Record
ERP SaaS/API
Availability Sync Capacity Cost
CA Service
Virtualization
System Under Test

13. 13 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
“I have
everything
I need, when
I need it!"
Service Virtualization Eliminates
Dev/Test Constraints
SV … like Wind Tunnel
for Fight Simulation
Mainframe
System of
Record
ERP SaaS/API
Availability Sync Capacity Cost
CA Service
Virtualization
System Under Test
CA Cloud Test

14. 14 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Solving for the – Performance Testing Pitfalls
ENVIRONMENTAL
 Pre-production environment
is not representative of
production
 Application components
delivered on different
timelines
DATA – NOT FIT FOR
PURPOSE
 Insufficient
 Not representative of
production
 In ability to quickly reset to
the baseline
TRANSACTION LOAD
GENERATION
 Appropriate transaction
mix to represent
production
 How to address injection
points that are
representative of
production
 Monitoring of results – real
time

15. 15 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Can’t I Just Copy Production Data?

16. 16 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Can’t I Just Copy Production Data?

17. 17 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Can’t I Just Copy Production Data?
MORE COVERAGE WITH BETTER DATA

18. 18 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
CA Test Data Manager
Provide High Quality “fit-for-purpose” Data to Dev/Test
Data Profiling
Data Subsetting / Slicing
Data Obfuscation
Virtual Services
Synthetic Data
Subset
Masked
Created
Test
Matching
Coverage Metrics
Data Design
Test Design
CA Dev Test
Development/Test
Production
Data
Objectives
Test Data
Warehouse
Version
Control
Data
Inheritance

19. 19 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Solving for the – Performance Testing Pitfalls
ENVIRONMENTAL
 Pre-production environment
is not representative of
production
 Application components
delivered on different
timelines
DATA – NOT FIT FOR
PURPOSE
 Insufficient
 Not representative of
production
 In ability to quickly reset to
the baseline
TRANSACTION LOAD
GENERATION
 Appropriate transaction
mix to represent
production
 How to address injection
points that are
representative of
production
 Monitoring of results – real
time

20. 20 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Many Companies Don’t Test in Production

21. 21 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Automated Grid Provisioning

22. 22 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
You Need a Kill Switch – No Fear Factor!

23. 23 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Real-time Performance Analysis

24. 24 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Detailed Error Analysis

25. 25 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Multi-Test-Run Comparison
COMPARE RESULTS OF A LIVE TEST WITH PREVIOUS TEST EXECUTIONS

26. 26 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Detailed Transaction, Page, and URL Analysis
• Detailed Transaction and Page Analysis of Web and Mobile Load Tests
Detailed URL Analysis of Web and Mobile Load Tests

27. 27 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Run Globally Distributed Load Tests

28. 28 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Detailed Page Component Breakdown

29. 29 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
• Eliminates resource constraints across
your backend systems
• Generates test data quickly that is fit-for-
purpose, reusable and reliable
• Scales tests up to millions of users across
global locations
CA Performance Testing-in-a-Box
A Solution utilizing: CA Service Virtualization, CA Test Data Manager
and CA Cloud Test
 Eliminates resource constraints
across your backend systems
 Generates test data quickly that is
fit-for-purpose, reusable and
reliable
 Scales tests up to millions of users
across global locations

30. 30 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Achieve cost savings via infrastructure
optimization and testing resources of
Reduce test data set up effort by
Avoids investing testing costs of
Increase testing platform availability by
90%
Increase application deployment time by
75%
75%
40%http://bit.ly/15bY6Tc
http://bit.ly/184km3C
http://bit.ly/1iNXkCL
http://bit.ly/1Cf80AN
http://slidesha.re/1JajBDp
Here is What’s Possible…
$300,000

31. 31 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Q & A

32. 32 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Recommended Sessions
SESSION # TITLE DATE/TIME
DO3X113S
Case Study: DBS Shares Its Continuous Delivery Journey
as a Global Financial Institution
11/19/2015 at 3:00 pm
DO3X114S
Technology Primer: Freeing the World from Slow: How
Service Virtualization and the Concept of S.P.E.E.D. Will
Steer You Away from Committing Continuous Delivery
Suicide
11/19/2015 at 3:45 pm
D03T22S
Business Transformation: DevOps for a 10-Year Old
(Codebase)
11/19/2015 at 4:45 pm

33. 33 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Must See Demos
Test Data
Management
Embrace Test Data
Management
Theater 4
Service
Virtualization
on Demand
Service
Virtualization
on Demand
Theater 3
Service
Virtualization
Deliver Better Apps
Faster with Service
Virtualization
Theater 4
DevOps Sim
Experience
DevOps Simulation
Experience
Theater 3

34. 34 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Follow On Conversations At…
Smart Bar
Theaters 3 & 4
Tech Talks
Theaters 3 & 4

35. 35 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Q & A

36. 36 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
For More Information
To learn more, please visit:
http://cainc.to/Nv2VOe
CA World ’15