A set of static slides that accompanied a "Live Demo" of using APM tools (AppDynamics) during load testing to isolate a performance issue, fix it, de-deploy and compare the improvement. This presentation accompanies the workshop held at the NCC Group Web Performance event in March 2014. Videos should be available on the NCC Group Community website - http://community.nccgroup-webperf.com/

1. DevOpsGuys
Perf Testing with APM
Workshop
Live demo without a safety net!
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
1

2. Workshop agenda
•
•
•
•
•
•
•
•
Intro – Steve – 10mins
Load Testing Portal – Gareth – 10 mins
APM Analysis – Steve – 10 mins
Deploy Fix & Re-Test – Steve – 5 mins
APM Demo + Q&A – Steve – 10 mins
Test #2 Analysis – Steve – 10 mins
Result Comparison – Gareth – 10 mins
Wrap up Q&A – Steve & Gareth
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
2

3. NCC
Test
Servers
@DevOpsGuys
Load Balancer
Test Environment
Web #1
MS SQL
Server
Web #2
DevOpsGuys
www.devopsguys.com
3

4. Cloud Servers
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
4

5. Load Balancer
Only one node
active (for now)
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
5

6. Test Application
• Online Art Shop Demo App
• .Net MVC Application
• http://spark.devopsguys.com/
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
6

7. The Art Shop
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
7

8. APM Weapon of Choice
• AppDynamics APM
– Gartner Magic Quadrant Leader
• SaaS Portal
• Agent install
– 15 minutes to install on 2 web servers
• OOTB Configuration
– 2 minor instrumentation changes
– Create a dashboard (~1hr)
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
8

9. OctopusDeploy
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
9

10. A brief overview of the Portal & Test setup
NCC GROUP LOAD TESTING
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
10

11. Where we break stuff live, for your viewing pleasure!
WORKSHOP DEMO PART 1
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
11

12. AppDynamics Portal
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
12

13. Failure in Minute 8(ish)
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
13

14. What went wrong?
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
14

15. SQL Client Exceptions
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
15

16. Slow Connection Open?
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
16

17. Code Bug (Thread.Sleep)
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
17

18. Fix it problems, deploy & re-test
WORKSHOP DEMO PART 2
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
18

19. Fix the Bugs…
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
19

20. Deploy it…
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
20

21. #3
Faster Iteration
= Better Value
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
21

22. Maximise Testing Value
Deploy
Fix
@DevOpsGuys
Test
Analyse
DevOpsGuys
www.devopsguys.com
22

23. While we wait for the load to ramp up…
MORE ON APM…
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
23

24. Comparing the two releases
SHOW THE IMPROVEMENT
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
24

25. 10,000 vs 45,000
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
25

26. Summary
1.
2.
3.
4.
See the Big Picture (systems thinking)
Drill down to the details
Faster Iteration = Better Value
Stop the “Blame Game”
– aka “There’s your Problem!”
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
26

27. DevOpsGuys
Thank You
AppDynamics Free Trial
http://ow.ly/ubW6r
operations | availability | performance | scalability | migration | strategy
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
27

28. What We Do
DevOpsGuys provide development &
operations support (DevOps) services
for your online applications.
You run your business. We run your website.
It’s as simple as that.
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
28

29. Our service portfolio
• 24 x 7 Application-Centric
web operations
• DevOps Transformation &
Training
• Continuous Delivery
implementation
• Infrastructure Automation &
“Infrastructure as Code”
• Application Performance
Management
• AppDynamics
Implementation &
Consultancy
@DevOpsGuys
• Web Performance
consulting
• Web monitoring
• Load Testing
• Test Automation and
scripting
• JetBrains Product
Implementation &
Consultancy
• Octopus Deploy
implementation
DevOpsGuys
www.devopsguys.com
29

30. The Leadership Team
James Smith
(@TheDevMgr)
Steve Thair
(@TheOpsMgr)
• 16 years of software
delivery experience.
• Proven track record
• 25 years of IT Operations
experience.
• Proven track record
–
–
–
–
–
–
–
Pizza Hut
KFC
Dell
RAC
Aviva
Fujitsu Siemens
Whitbread
@DevOpsGuys
–
–
–
–
–
–
–
DevOpsGuys
Vodafone
Credit Suisse Group
IBM
BNP Paribas
Zurich Financial Services
Totaljobs Group
TSL Education
www.devopsguys.com
30

31. Contact Us
Visit us at www.devopsguys.com
Call our team on +44 (0)20 8798 3079
Email our engineers at
team@devopsguys.com
@DevOpsGuys
DevOpsGuys
www.devopsguys.com
31