B2 2005 introduction_load_testing_blackboard_primer_draft

An Introduction to Load Testing: A Blackboard Primer Steve Feldman Director of Performance Engineering and Architecture Blackboard Inc. July 18 th 3pm

What is Software Performance Engineering? Software Execution Model System Execution Model SPE System Software

[object Object],[object Object],[object Object],The Software Execution Model SPE System Software

[object Object],[object Object],[object Object],The System Execution Model

[object Object],[object Object],[object Object],[object Object],The System Execution Model and the Performance Maturity Model Level 1: Reactive Fire Fighting Level 2: Monitoring And Instrumenting Level 3: Performance Optimizing Level 4: Business Optimizing Level 5: Process Optimizing

How Do We Optimize our Environment Using the System Execution Model? ,[object Object],[object Object],[object Object]

Introduction to Load Testing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What is Load Testing? ,[object Object],[object Object],[object Object],[object Object],[object Object]

Why do we Load Test? ,[object Object],[object Object],[object Object],[object Object]

What tools do we use? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Preparing for load testing? ,[object Object],[object Object],[object Object],[object Object],[object Object]

Define Performance Objectives ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Define Use Cases ,[object Object],[object Object],[object Object],[object Object],[object Object]

Define Performance Scenarios ,[object Object],[object Object],[object Object],[object Object]

Design an Accurate Data Model ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Scripting and Parameterization ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Scripting and Parameterization: Example ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Code Comments Reusable Action Name Echo Status and Transaction HTTP Representation with Parameterization and Abandonment

Scripting and Parameterization: Example ,[object Object],[object Object],[object Object],Parameterization Name: Course_Assessments_Pk If Not Found: Issues a Warning Finds the Values b/w Left Boundary and Right Boundary These are LoadRunner Terminology References. However, other scripting tools use same constructs.

Scripting and Parameterization: Blackboard Gotchas ,[object Object],[object Object],[object Object],[object Object]

Scripting and Parameterization: Blackboard Gotchas ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Scripting and Parameterization: Blackboard Gotchas ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Scripting and Parameterization: Blackboard Gotchas (Example) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Transaction Timer Dynamic Parameterized Values Explicit Abandonment Policy and Parameterized Think Time

How do we load test? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Load Testing: How To Initially Configure ,[object Object],[object Object],[object Object],[object Object],[object Object]

Load Testing: Calibration ,[object Object],[object Object],[object Object],[object Object],[object Object]

Load Testing: Response Time Calibration X-Axis: Iterations Y-Axis: Response Time Response Time Threshold Line Optimal Workload

Load Testing: Response Time Calibration X-Axis: Iterations Y-Axis: Resource Utilization Resource Saturation Threshold CPU Optimal Workload

Load Testing: How To Baseline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Load Testing: How To Baseline Arrival Period Run-Time Iterations Departure Period X-Axis: Time Y-Axis: Users Workload Departure Period

Load Testing: How To Clean-Up between Tests ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Load Testing: Samples and Measurements X-Axis: Time Y-Axis: Users Samples = Iterations Response Time Measurement Begins After Arrivals Response Time Measurement Ends Before Departure Calibrated Data Is more reliable

Load Testing: How To Optimize ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What to do with the Results of a Load Test ,[object Object],[object Object],[object Object]

Advanced Topic: Behavioral Modeling ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Advanced Topic: User Abandonment ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Resources and Citations ,[object Object],[object Object],[object Object],[object Object]

B2 2005 introduction_load_testing_blackboard_primer_draft

Recomendados

Recomendados

Más contenido relacionado

Destacado

Destacado (8)

Similar a B2 2005 introduction_load_testing_blackboard_primer_draft

Similar a B2 2005 introduction_load_testing_blackboard_primer_draft (20)

Más de Steve Feldman

Más de Steve Feldman (20)

B2 2005 introduction_load_testing_blackboard_primer_draft