Enviar búsqueda
Cargar
Ptformanagersppt - Scott Barber
•
0 recomendaciones
•
389 vistas
A
Archana Survase
Seguir
Denunciar
Compartir
Denunciar
Compartir
1 de 28
Descargar ahora
Descargar para leer sin conexión
Recomendados
Perf Intro Ppt
Perf Intro Ppt
Rahul Sharma
Control model testing
Control model testing
Scott Barber
Iqnite keynote
Iqnite keynote
Scott Barber
Testing and Tester Evolution
Testing and Tester Evolution
Scott Barber
Performance Testing on Agile Development Teams
Performance Testing on Agile Development Teams
Scott Barber
Introducing the Captain of your Special Teams... The Performance Test Lead
Introducing the Captain of your Special Teams... The Performance Test Lead
Scott Barber
Asril_Resume_LinkedIn
Asril_Resume_LinkedIn
Muhamad Asril Abdullah
Oracle siebel application testing
Oracle siebel application testing
Infosys
Recomendados
Perf Intro Ppt
Perf Intro Ppt
Rahul Sharma
Control model testing
Control model testing
Scott Barber
Iqnite keynote
Iqnite keynote
Scott Barber
Testing and Tester Evolution
Testing and Tester Evolution
Scott Barber
Performance Testing on Agile Development Teams
Performance Testing on Agile Development Teams
Scott Barber
Introducing the Captain of your Special Teams... The Performance Test Lead
Introducing the Captain of your Special Teams... The Performance Test Lead
Scott Barber
Asril_Resume_LinkedIn
Asril_Resume_LinkedIn
Muhamad Asril Abdullah
Oracle siebel application testing
Oracle siebel application testing
Infosys
Testing Sap: Modern Methodology
Testing Sap: Modern Methodology
Ethan Jewett
Resume - Gagan Gupta
Resume - Gagan Gupta
Gagan Gupta
An Introduction to Software Performance Engineering
An Introduction to Software Performance Engineering
Correlsense
Sap manual testing
Sap manual testing
Dele N.
Ez- template-IT- Quality Assurance
Ez- template-IT- Quality Assurance
Ezni Serafina
William Petcher_sat
William Petcher_sat
Bill Petcher
Resume
Resume
Vaibhav Jain
Important skills a Tester should have
Important skills a Tester should have
Kanoah
Quality Metrics: The Dirty Word in the Room
Quality Metrics: The Dirty Word in the Room
Josiah Renaudin
Combining Performance Testing And Modelling For Easy Jet.Com V 1.0
Combining Performance Testing And Modelling For Easy Jet.Com V 1.0
dannyq
Performance Engineering Basics
Performance Engineering Basics
Impetus Technologies
QAIBP
QAIBP
Keerthivardhan Naidu Sunkara
PCoE Team Maturity Model
PCoE Team Maturity Model
Shlomi Nissim
Erp post implementation audit
Erp post implementation audit
velcomerp
resume 5
resume 5
Soodeh Abshari
qLabs Test Automation
qLabs Test Automation
qLabs
Hema_Testing
Hema_Testing
Hema Latha
End-to-End Quality Approach: 14 Levels of Testing
End-to-End Quality Approach: 14 Levels of Testing
Josiah Renaudin
Rogeliodevenencia
Rogeliodevenencia
Rogelio de Venencia
Beginner guide-to-software-testing
Beginner guide-to-software-testing
biswajit52
perf_intro_ppt.pdf
perf_intro_ppt.pdf
kirangandhi23
Top 50 Performance Testing Interview Questions | Edureka
Top 50 Performance Testing Interview Questions | Edureka
Edureka!
Más contenido relacionado
La actualidad más candente
Testing Sap: Modern Methodology
Testing Sap: Modern Methodology
Ethan Jewett
Resume - Gagan Gupta
Resume - Gagan Gupta
Gagan Gupta
An Introduction to Software Performance Engineering
An Introduction to Software Performance Engineering
Correlsense
Sap manual testing
Sap manual testing
Dele N.
Ez- template-IT- Quality Assurance
Ez- template-IT- Quality Assurance
Ezni Serafina
William Petcher_sat
William Petcher_sat
Bill Petcher
Resume
Resume
Vaibhav Jain
Important skills a Tester should have
Important skills a Tester should have
Kanoah
Quality Metrics: The Dirty Word in the Room
Quality Metrics: The Dirty Word in the Room
Josiah Renaudin
Combining Performance Testing And Modelling For Easy Jet.Com V 1.0
Combining Performance Testing And Modelling For Easy Jet.Com V 1.0
dannyq
Performance Engineering Basics
Performance Engineering Basics
Impetus Technologies
QAIBP
QAIBP
Keerthivardhan Naidu Sunkara
PCoE Team Maturity Model
PCoE Team Maturity Model
Shlomi Nissim
Erp post implementation audit
Erp post implementation audit
velcomerp
resume 5
resume 5
Soodeh Abshari
qLabs Test Automation
qLabs Test Automation
qLabs
Hema_Testing
Hema_Testing
Hema Latha
End-to-End Quality Approach: 14 Levels of Testing
End-to-End Quality Approach: 14 Levels of Testing
Josiah Renaudin
Rogeliodevenencia
Rogeliodevenencia
Rogelio de Venencia
Beginner guide-to-software-testing
Beginner guide-to-software-testing
biswajit52
La actualidad más candente
(20)
Testing Sap: Modern Methodology
Testing Sap: Modern Methodology
Resume - Gagan Gupta
Resume - Gagan Gupta
An Introduction to Software Performance Engineering
An Introduction to Software Performance Engineering
Sap manual testing
Sap manual testing
Ez- template-IT- Quality Assurance
Ez- template-IT- Quality Assurance
William Petcher_sat
William Petcher_sat
Resume
Resume
Important skills a Tester should have
Important skills a Tester should have
Quality Metrics: The Dirty Word in the Room
Quality Metrics: The Dirty Word in the Room
Combining Performance Testing And Modelling For Easy Jet.Com V 1.0
Combining Performance Testing And Modelling For Easy Jet.Com V 1.0
Performance Engineering Basics
Performance Engineering Basics
QAIBP
QAIBP
PCoE Team Maturity Model
PCoE Team Maturity Model
Erp post implementation audit
Erp post implementation audit
resume 5
resume 5
qLabs Test Automation
qLabs Test Automation
Hema_Testing
Hema_Testing
End-to-End Quality Approach: 14 Levels of Testing
End-to-End Quality Approach: 14 Levels of Testing
Rogeliodevenencia
Rogeliodevenencia
Beginner guide-to-software-testing
Beginner guide-to-software-testing
Similar a Ptformanagersppt - Scott Barber
perf_intro_ppt.pdf
perf_intro_ppt.pdf
kirangandhi23
Top 50 Performance Testing Interview Questions | Edureka
Top 50 Performance Testing Interview Questions | Edureka
Edureka!
JMeter Interview Questions | Performance Testing Interview Questions | Edureka
JMeter Interview Questions | Performance Testing Interview Questions | Edureka
Edureka!
Approachesppt 111112121701 Phpapp02
Approachesppt 111112121701 Phpapp02
Archana Survase
Approaches to Software Testing
Approaches to Software Testing
Scott Barber
How CapitalOne Transformed DevTest or Continuous Delivery - AppSphere16
How CapitalOne Transformed DevTest or Continuous Delivery - AppSphere16
AppDynamics
Performance Testing in Agile Process
Performance Testing in Agile Process
Idexcel Technologies
Pinpointing and Exploiting Specific Performance Bottlenecks
Pinpointing and Exploiting Specific Performance Bottlenecks
Scott Barber
Load and Performance Testing in Production, featuring Scott Barber
Load and Performance Testing in Production, featuring Scott Barber
Neotys
Evolving Team Structure in DevOps
Evolving Team Structure in DevOps
Sherry Chang
Webinar Presentation: Best Practices in QA Testing - Leveraging Open Source T...
Webinar Presentation: Best Practices in QA Testing - Leveraging Open Source T...
Emtec Inc.
Paul Marples Resume
Paul Marples Resume
Paul Marples
Syed_E_Res
Syed_E_Res
Syed Hussain
Primer on application_performance_testing_v0.2
Primer on application_performance_testing_v0.2
Trevor Warren
A Complete Guide to Functional Testing
A Complete Guide to Functional Testing
Matthew Allen
A Complete Guide to Functional Testing
A Complete Guide to Functional Testing
Abhay Kumar
Best Practices for Shifting Left Performance and Accessibility Testing
Best Practices for Shifting Left Performance and Accessibility Testing
Perfecto by Perforce
Building functional Quality Gates with ReportPortal
Building functional Quality Gates with ReportPortal
Dmitriy Gumeniuk
Use Automation to Assist—Not Replace—Manual Testing
Use Automation to Assist—Not Replace—Manual Testing
TechWell
Sachin_Waghmare_Resume
Sachin_Waghmare_Resume
Sachin Wghmare
Similar a Ptformanagersppt - Scott Barber
(20)
perf_intro_ppt.pdf
perf_intro_ppt.pdf
Top 50 Performance Testing Interview Questions | Edureka
Top 50 Performance Testing Interview Questions | Edureka
JMeter Interview Questions | Performance Testing Interview Questions | Edureka
JMeter Interview Questions | Performance Testing Interview Questions | Edureka
Approachesppt 111112121701 Phpapp02
Approachesppt 111112121701 Phpapp02
Approaches to Software Testing
Approaches to Software Testing
How CapitalOne Transformed DevTest or Continuous Delivery - AppSphere16
How CapitalOne Transformed DevTest or Continuous Delivery - AppSphere16
Performance Testing in Agile Process
Performance Testing in Agile Process
Pinpointing and Exploiting Specific Performance Bottlenecks
Pinpointing and Exploiting Specific Performance Bottlenecks
Load and Performance Testing in Production, featuring Scott Barber
Load and Performance Testing in Production, featuring Scott Barber
Evolving Team Structure in DevOps
Evolving Team Structure in DevOps
Webinar Presentation: Best Practices in QA Testing - Leveraging Open Source T...
Webinar Presentation: Best Practices in QA Testing - Leveraging Open Source T...
Paul Marples Resume
Paul Marples Resume
Syed_E_Res
Syed_E_Res
Primer on application_performance_testing_v0.2
Primer on application_performance_testing_v0.2
A Complete Guide to Functional Testing
A Complete Guide to Functional Testing
A Complete Guide to Functional Testing
A Complete Guide to Functional Testing
Best Practices for Shifting Left Performance and Accessibility Testing
Best Practices for Shifting Left Performance and Accessibility Testing
Building functional Quality Gates with ReportPortal
Building functional Quality Gates with ReportPortal
Use Automation to Assist—Not Replace—Manual Testing
Use Automation to Assist—Not Replace—Manual Testing
Sachin_Waghmare_Resume
Sachin_Waghmare_Resume
Ptformanagersppt - Scott Barber
1.
Performance Testing for
Managers First Presented: Software Test & Performance Conference November 2005, New York, NY Most Recently Revised for: Software Test & Performance Conference October 2007, Boston, MA Based on: “High Performance Testing” Better Software Magazine, May/June 2005 Scott Barber, Chief Technologist PerfTestPlus, Inc. www.PerfTestPlus.com Performance Testing for Managers Page 1 © 2005-7 PerfTestPlus All rights reserved.
2.
Agenda Overview People Tools Process Results Summary
www.PerfTestPlus.com Performance Testing for Managers Page 2 © 2005-7 PerfTestPlus All rights reserved.
3.
Overview
As an activity, performance testing is widely misunderstood, particularly by executives and managers. This misunderstanding can lead to a variety of difficulties -- including outright project failure. www.PerfTestPlus.com Performance Testing for Managers Page 3 © 2005-7 PerfTestPlus All rights reserved.
4.
Overview
Managers and executives do not need to understand the technical details of performance testing to make good decisions or effectively manage performance testing projects. They do need to understand what performance testing is, what it is not and what value it adds. www.PerfTestPlus.com Performance Testing for Managers Page 4 © 2005-7 PerfTestPlus All rights reserved.
5.
Overview
Learning, understanding, and applying the nuggets of knowledge in this presentation to your performance testing projects will improve your chances for success. www.PerfTestPlus.com Performance Testing for Managers Page 5 © 2005-7 PerfTestPlus All rights reserved.
6.
Performance Testing for
Managers Scott Barber, (A.K.A. “The Perf Guy”) sbarber@perftestplus.com Chief Technologist, PerfTestPlus, Inc. www.perftestplus.com Vice President & Executive Director, Association for Software Testing www.associationforsoftwaretesting.org Contributing Author & Expert Advisor Performance Testing Guidance for Web Applications www.codeplex.com/PerfTestingGuide www.PerfTestPlus.com Performance Testing for Managers Page 6 © 2005-7 PerfTestPlus All rights reserved.
7.
People
“There is no such thing as a „junior performance tester‟… but there are people who are new to performance testing.“ --Scott Barber www.PerfTestPlus.com Performance Testing for Managers Page 7 © 2005-7 PerfTestPlus All rights reserved.
8.
A (Good) Performance
Tester Is: A senior member of the team. A “mid-level” everything. Consultative, collaborative, competent, self-managing, trustworthy, and dependable. Multi-disciplinary. A member of a network of peers to collaborate with about performance testing challenges. www.PerfTestPlus.com Performance Testing for Managers Page 8 © 2005-7 PerfTestPlus All rights reserved.
9.
A (Good) Performance
Tester Will: Help you verbalize and quantify both business and technical goals & objectives. Collect and present goal achievement data intuitively. Speak intelligently about risks & implications related to: The Business The Application/System The Project Users of the application/system Advise managers about performance and performance testing to help them make good decisions. www.PerfTestPlus.com Performance Testing for Managers Page 9 © 2005-7 PerfTestPlus All rights reserved.
10.
Interviewing Performance Testers: Expect
candidates to address questions typically asked of: Developers System administrators DBAs Technical managers Expect candidates to relate personal experiences about: Solving complex technical problems in specific technical detail Addressing business risks through their testing Leading or coordinating cross-functional teams Expect candidates to ask a lot of questions. www.PerfTestPlus.com Performance Testing for Managers Page 10 © 2005-7 PerfTestPlus All rights reserved.
11.
Managers Set Expectations: You
are not interested in “fools with tools.” The performance tester is your personal advisor. You will review strategies, whiteboards, results & deliverables – and ask questions about them. You want to be educated along the way. Encourage performance testers to develop relationships: With performance testers And other specialists Internally and externally And to leverage those relationships to solve challenges www.PerfTestPlus.com Performance Testing for Managers Page 11 © 2005-7 PerfTestPlus All rights reserved.
12.
Tools “Enterprise grade load
generation tools are designed to look easy in sales demos. Don‟t be fooled.” --Scott Barber www.PerfTestPlus.com Performance Testing for Managers Page 12 © 2005-7 PerfTestPlus All rights reserved.
13.
Tool Related Tips
for Managers: The tool is a load-generator & data collector, not a performance tester. The tool was not created for your system, making it work for you will be hard. Commit to the performance tester’s tool(s) of choice. Avoid “tool-driven test design.” Do not accept “canned” reports as analysis. Allow the use of supplemental open-source or free tools. Cough up $35 when your performance tester asks to license share-ware when the trial expires. Trust your performance testers, but not the tools. www.PerfTestPlus.com Performance Testing for Managers Page 13 © 2005-7 PerfTestPlus All rights reserved.
14.
A (Good) Performance
Tester Is: A master with their tool(s) of choice. Able to extend the tool to implement the test design correctly (but it will take time). Able to pick up a new tool quickly. Not defensive when the tool is challenged. Equipped with a virtual tool-box filled with tools that you have likely never heard of. Frequently overheard complaining about the inadequacies of the tool… when their not bragging about the cool new features. www.PerfTestPlus.com Performance Testing for Managers Page 14 © 2005-7 PerfTestPlus All rights reserved.
15.
Process “Only performance testing
at the conclusion of system or functional testing is like ordering a diagnostic blood test after the patient is dead.” --Scott Barber www.PerfTestPlus.com Performance Testing for Managers Page 15 © 2005-7 PerfTestPlus All rights reserved.
16.
Performance Testing Principles:
Project context is central to successful performance testing. Business, project, system, & user success criteria. Identify system usage, and key metrics; plan and design tests. Install and prepare environment, tools, & resource monitors. Script the performance tests as designed. Run and monitor tests. Validate tests, test data, and results. Analyze the data individually and as a cross-functional team. Consolidate and share results, customized by audience. "Lather, rinse, repeat" as necessary. www.PerfTestPlus.com Performance Testing for Managers Page 16 © 2005-7 PerfTestPlus All rights reserved.
17.
Agile Performance Testing:
www.PerfTestPlus.com Performance Testing for Managers Page 17 © 2005-7 PerfTestPlus All rights reserved.
18.
CMMI Performance Testing:
www.PerfTestPlus.com Performance Testing for Managers Page 18 © 2005-7 PerfTestPlus All rights reserved.
19.
A (Good) Performance
Tester Will: Pair with developers & architects on early performance tasks. Work within the constraints of the schedule. Speed up the process of finding root causes and fixing performance issues detected late in the project life-cycle. Know “delivery” is a business decision based on risks, costs, and benefits. Help management weigh those risks, rather than trying to be “release traffic cops.” Know that releasing the software is no reason to stop performance testing. www.PerfTestPlus.com Performance Testing for Managers Page 19 © 2005-7 PerfTestPlus All rights reserved.
20.
Process Related Tips
for Managers : Performance test from kick-off through roll-out. Encourage the development team to use the performance tester’s skills and resources as a development tool. Performance testing is a primary role – not an additional duty. Do not assign the performance tester to the test manager. Plan to keep testing performance after the first release. Prepare for performance monitoring in production. Do not trust performance results until validated in production. Plan to push a performance maintenance releases prior to the first expected peak load. Realize that performance has a tendency to change over time. www.PerfTestPlus.com Performance Testing for Managers Page 20 © 2005-7 PerfTestPlus All rights reserved.
21.
Results
“Linear extrapolation of performance test results is, at best, black magic. Don‟t do it (unless your name is Connie Smith, PhD. or Daniel Menasce, PhD.)” --Scott Barber www.PerfTestPlus.com Performance Testing for Managers Page 21 © 2005-7 PerfTestPlus All rights reserved.
22.
A (Good) Performance
Testers Will: Know that linear extrapolation is, at best, black magic. Not predict production performance based on measurements of a system that isn’t identical to production. Like when you ask to see the data. Present data, results, and findings clearly and intuitively. Find “prove it” to be a fair, reasonable, and anticipated request. www.PerfTestPlus.com Performance Testing for Managers Page 22 © 2005-7 PerfTestPlus All rights reserved.
23.
Results Related Tips
for Managers: Demand to review the assumptions, calculations, and data that contribute to any predictions. Ensure that your project plan involves at least one load test on production hardware. Do not accept defensiveness and/or arrogance in response to a request to justify or prove predictions. Know (or learn) some statistics. With every presented result ask “How many users will this make unhappy?” www.PerfTestPlus.com Performance Testing for Managers Page 23 © 2005-7 PerfTestPlus All rights reserved.
24.
Statistics Summary for
Managers: All three have an average of 4. Which has the “best” performance”? How do you know? www.PerfTestPlus.com Performance Testing for Managers Page 24 © 2005-7 PerfTestPlus All rights reserved.
25.
Summary Experienced performance testers
relate to executives and managers, not only “geeks.” Performance testing can start adding value with the “bar napkin.” Deliver based on risks. Stop testing when goals are met. Don’t confuse the two. Expect skills and experience from a performance tester. There is no such thing as a “junior” performance tester. The best tool for the job is the one that your performance tester recommends. Don’t accept extrapolated results – they are wrong. www.PerfTestPlus.com Performance Testing for Managers Page 25 © 2005-7 PerfTestPlus All rights reserved.
26.
Credits Adapted from “High-Performance
Testing,” Better Software Magazine, May/June 2005 issue located at http://www.perftestplus.com/pubs.htm. Enhanced with material from Performance Testing Guidance for Web Applications, a Microsoft patterns & practices publication by J.D. Meier, Scott Barber, Carlos Farre, Prashant Bansode, and Dennis Rea available at http://www.codeplex.com/perftestingguide www.PerfTestPlus.com Performance Testing for Managers Page 26 © 2005-7 PerfTestPlus All rights reserved.
27.
Questions
www.PerfTestPlus.com Performance Testing for Managers Page 27 © 2005-7 PerfTestPlus All rights reserved.
28.
Contact Info
Scott Barber Chief Technologist PerfTestPlus, Inc. E-mail: Web Site: sbarber@perftestplus.com www.PerfTestPlus.com www.PerfTestPlus.com Performance Testing for Managers Page 28 © 2005-7 PerfTestPlus All rights reserved.
Descargar ahora