This document discusses challenges with performance testing in Agile development and proposes solutions. It outlines traditional waterfall performance testing versus an Agile approach. Key aspects of an Agile performance testing process include continuous performance management through automation, performance testing in each sprint, and identifying bottlenecks early. The document provides examples of implementing this approach successfully for bill payment and digital mailbox projects.

1. Addressing Performance Testing Challenges in
Agile

2. Outline
• Traditional approach to Performance Engineering
• Performance Engineering in Agile
• Continuous performance management
• Case Studies
© 2013 Impetus Technologies Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

3. Introduction
• Enterprises are moving towards Agile
– Improved Quality
– Midcourse corrections
– Customer satisfaction
– Quicker time-to-market
– Competition
© 2013 Impetus Technologies Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

4. Traditional approach to Performance
Engineering
• Waterfall model
• Afterthought in SDLC
• Reactive approach
• Insufficient time – testing, tuning, optimization
and forecasting
• Adverse system performance
• Business losses
© 2013 Impetus Technologies Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

5. Testing Challenges in Agile
• Time boxed sprints
– Shorter time to test
• Test Environment
– H/w infrastructure
– Test Data
• Customer expectations
• Frequent changes
• Delivery pressures
• Defining performance user stories
© 2013 Impetus Technologies Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

6. Performance Engineering in Agile
© 2013 Impetus Technologies
Release Lifecycle
Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

7. Performance Planning
• Define
performance
requirements
– User
– System
• Performance
test strategy
• Workload analysis
• Tool selection
• Test data
© 2013 Impetus Technologies Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

8. Sprint Execution
• Performance centric
development
• Scripting and
Execution
• Performance unit
testing
• Continuous
Performance
Management
• Bottleneck
Identification
© 2013 Impetus Technologies Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

9. Performance Centric Development
• Technology evaluation
• Architecture and Design Review
• Prototyping
• Deployment and Production monitoring
© 2013 Impetus Technologies Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

10. Performance Unit Testing
• Unit tests as performance tests
• Performance Evaluation
– Code Level
– Single user performance
• Automated unit testing
– ANT, Maven
• Tools
– Junit, junitperf,TestNG, Solex,TPTP, p-unit
© 2013 Impetus Technologies Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

11. Performance Unit Testing
© 2013 Impetus Technologies Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

12. Continuous Performance Management
• Integrate test execution
& Continuous
Integration
• Component level
performance
• Automated result
analysis
– Alerts and
Notifications
• Performance
comparison
• Tools
– Jenkins, SVN,ANT,
Maven, JMeter,
SandStorm, Profilers
© 2013 Impetus Technologies
Automated
Build Trigger
Dev
Environment
Code
Repository
CI tool Performance
testing tool
Performance
Environment
Performance
Scripts
Test scripts
and Scenarios
Test
Execution
Generate
Load
Results
Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

13. Continuous Performance Management
© 2013 Impetus Technologies Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

14. Bottleneck Identification
• Using Diagnostic tools
• Profiling
– Code
– Database
• System tuning
– Thread pool
– Connection pool
– JVM
– Queries
• Tools
– Yourkit, Jprofiler, visualVM,
jConsole,AWR, SQL
profiler, GC Analyzer,
Glassbox, jwebApp, Jamon
© 2013 Impetus Technologies Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

15. Hardening Sprint
• Dedicated sprint for performance testing
• End-to-end performance testing
• Stress andVolume testing
• Endurance, Reliability, Fail over testing
• Production monitoring
– Nagios, Zabbix,Wily, Dynatrace,AppDynamics
• Performance certification
© 2013 Impetus Technologies Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

16. Bill Payment Solutions
© 2013 Impetus Technologies
Impetus Contributions
• Defined and established Performance
engineering process in Scrum
• Defined performance tasks in product
backlog
• Performance benchmarking for critical
web services
• Defined optimal set of JVM parameters
for maximum throughput
• Recommended optimum hardware
based on expected user base
• Automated monitoring utilities to debug
performance issues
The Challenge
• Scrum development cycle
• Identify performance bottlenecks
during the development
• Identify hardware requirements for
deployment of new release
• Define optimized set of parameters for
JVM
• Benchmark and tune the individual
web services
Benefits Realized
• In time release with zero performance issues
• Cost savings due to early identification and resolution of performance issues
Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

17. Digital Mailbox Solution
© 2013 Impetus Technologies
Impetus Contributions
• Automated tasks for performance test
data, environment and execution
• Performance test execution via Hudson
• Performance benchmarking for critical
web services
• Recommended optimum hardware
based on expected user base
• Automated monitoring utilities to
monitor sub-system performance
The Challenge
• Identify performance bottlenecks
during the development
• H/w sizing for the production
deployment
• Benchmark and tune the individual
web services
• Monitoring performance of multiple-
sub-systems during test execution
• Performance testing via CI
Benefits Realized
• In time release with zero performance issues
• Significant cost savings due to use of open source tools
Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

18. CPM in Digital Mailbox Solution
© 2013 Impetus Technologies Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

19. Summary
© 2013 Impetus Technologies
• Proactive performance engineering
– Early detection and resolution
• Performance unit testing and optimization
• High degree of automation
• Extensive collaboration between teams
• Certainty in Deployment
Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

20. • Over 20 years focus on technology
• Innovation is in our DNA
• Technology thought leaders
• Process engineering maturity
• World-class user experience designs
What Sets Us Apart
Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

21. Q&A
Please send in your questions
Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68

22. Legal
© 2013 Impetus Technologies
© 2013 Impetus Technologies.All rights reserved.
You are prohibited from making a copy or modification of, or
from redistributing, rebroadcasting, or re-encoding of this
content without the prior written consent of Impetus
Technologies.
This presentation includes images from other products and
services.These images are used for illustrative purposes only.
There is no explicit or implied endorsement or sponsorship
of these products by Impetus.All copyrights and trademarks
are property of their respective owners.

23. Thank you
inquiry@impetus.com | www.impetus.com