1. Webservice Performance Testing
with SoapUI (LoadUI)
Nguyen Huu Phuoc, MEng.
HCMC, 11/2013

2. Agenda
•
What is Performance Testing?
•
Performance Testing Kinds
•
Using LoadUI for Performance Testing
•
The advanced topics

3. Performance Testing
•
Creating or simulating artificially load.
•
Measuring how the system handle the load.

4. Performance Testing Kinds (1/2)
•
Baseline Testing
–
–
•
Load: Expected or normal load
Goal: Find the metrics under normal load.
Load Testing
–
–
•
Load: High load.
Goal: Find the metrics under high load.
Stress Testing
–
Load: High load.
–
Goal: Find the system breaking point

5. Performance Testing Kinds (2/2)
•
Soak Testing
–
–
Time: Long period.
–
•
Load: normal load or high load.
Goal: Find unwanted behavior emerges over time .
Scalability Testing
–
Load: Like Load test but increase the complexity or
size of request.
–
Goal: Find the metrics under high volumes of data

6. Using LoadUI For LoadTest
•
What is LoadUI?
•
Quick Start:
–
Create a new LoadTest
–
Run the LoadTest
–
Add Assertions to a LoadTest

7. Using LoadUI For LoadTest
•
LoadUI:
–
LoadUI is a free load testing tool which is integrate
into SoapUI
–
LoadUI provides the following features:
•
Distributed Load Testing: Allow user to distribute Load
Tests to multiple LoadUI agents.
•
Run multiple Test Cases simultaneously.
•
Long-run tests.
•
Interactive load testing: Change parameter real time.

8. Using LoadUI For LoadTest
•
Create a new LoadTest:
–
In Navigator > Right click on a Test case >New Loa
dTest
–
In New LoadTest dialog, enter your LoadTest nam
e > Click on OK button.

9. Using LoadUI For LoadTest
•
Run the LoadTest
–
Modify pre-configured LoadTest with the desired
values.
–
Run the LoadTest.
–
We will see the statistic table during the LoadTest
running.

10. Using LoadUI For LoadTest
•
Add Assertions to a LoadTest:
–
In the LoadTest editor, select “LoadTest Assertion” ta
b at the bottom of the editor.
–
Click LoadTest Assertion button in the LoadTest Assert
ion menu bar.
–
In the Add Assertion dialog, select Step Maximum and
click OK button.
–
In the TestStep Max Assertion window, modify anythi
ng you want and click OK button.
–
The assertion is added successfully.
–
Run test again.

11. The Advanced Topics
•
Test Strategies.
•
Available Assertions.
•
Export Data & Statistics
•
Scripting.

12. Test Strategies
•
•
•
Simple Strategy  Baseline, Load and Soak Testing.
Fixed-Rate Strategy  Guarantee the number of executions
within a certain time.
Variable Load Strategies:
–
Variance: varies the number of threads over time in a
“sawtooth” manor.
–
Burst: Recovery testing, bursting thread in short duration and
do baseline testing after that.
–
Thread: The linearly change in number of threads.
–
Grid: The relative change in number of threads.
–
Script: The number of thread is scripted.

13. Available Assertions
•
•
•
•
•
Step Average: Asserts that the average value d
oesn't exceed the specified limit.
Step TPS: Asserts the TPS (transaction per sec
ond) value
Step Minimum: Asserts the max value
Step Status: Check that the underlying executi
on status is successful.
Max Errors: Check that the number of failures.

14. Export Data & Statistics
•
Export statistics to CSV.
•
Export Statistics Diagrams to CSV.
•
Export Data Continuously: Using Statistic
Log

15. Scripting
•
LoadUI allow user make the following TestCas
e-specific scripting hooks:
–
Setup and TearDown scripts
–
Access to LoadTest related objects in a TestCase sc
ript
–
The objects we can use in the scripts:
•
context
•
log
•
loadTestRunner

16. THANK YOU !
Nguyen Huu Phuoc, MEng.
Homepage:
http://hữuphướcnguyễn.vn
http://phuocnh.nghelong.com