SlideShare una empresa de Scribd logo
1 de 8
 Enable Performance Testing through the entire development cycle to ensure adequate
performance of the code by the end of project
 Define the acceptance criteria and definition of done or pass/fail of a story.
 Build the performance testing into smaller cycles and call them unit performance testing
that will measure component level performance .
 Build performance test cases in the tools like Jira or any other tool to enable visibility.
 Ensure that the Agile team are confirming the release against the agreed set of
performance requirements.
 Ensure continuous feedback among all stakeholders .
Groups Tasks
 Define how work will be broken down into small
chunks.
 Performance Team lead identifies performance
testing stories and make sure the acceptance
criteria is defined.
 Resource Planning for sprint work.
 Need to train the performance testers to adapt
to agile approach.
Tasks
 Create performance test cases.
 Create scripts run tests measure performance
and report performance
 Create front end performance measurement
using web page test or equivalent .
Scrum
Level
Progra
m
Level
 Performance Activities
 Create the performance test cases in shared repository for each sprint in parallel with
coding.
 Work on unit level performance test of each module being developed .
 Report the individual module performance to scrum team
 Automate the tests explore the tools that will work better to include as part of CI
 Work on getting the test data created for regression test
 Environments
 Can be performed in QA environment after the code has been QA certified
 Tools
 We can explore the tools like JunitPerf .
 We can also include the load testing scripts as part of the CI build.
 Resources
 Agile revolves around principle of cross training and working more in collabaration so this can
be achieved by developers also to begin with once the performance engineer get ramped up.
 Performance Activities
 Create the performance test cases in shared repository for the hardening sprint.
 Work on performance testing integrated components like services along with the UI
 Report the performance of the integrated components.
 Automate the tests and run the integrated tests(Single users tests) as part of CI To
track performance.
 Continue to work on getting the test data created for regression test
 We may have this sprint or might create integration user stories as part of next
sprint.
 Environments
 Can be performed in QA env after the code has been QA certified
 Tools
 Use load runner or Jeter be flexible with tool choices
 Resources
 Performance test engineer
 Performance Activities
 Fully integrate yourself into the Sprint team, immediately
Performance awareness, practices, and results organically increased because it was a well represented function within the team as
opposed to an
after thought farmed out to a remote organization.
 Build multiple performance and stress test scenarios with distinct goals and execution schedules. Plan for longer soak and stress tests as
part of the release process, but have one or more per-sprint, and even nightly, performance tests that can be continually executed to
proactively measure performance, and identify defects as they are introduced. Consider it your mission to quantify the performance
impact of a code change.
 Extend your Continuous Integration (CI) pipelines to include performance testing. At PayPal, I built custom integrations between Jenkins
and JMeter to automate test execution and report generation. Our pipelines triggered automated nightly regressions on development
branches and within a well-understood platform where QA and development could parameterize workload, kick-off a performance test
and interpret a test report. Unless you like working 18-hour days, I can’t overstate the importance of building integrations into tools
that are already or easily adopted by the broader team. If you’re using Jenkins, you might take a look at the Jenkins Performance Plugin.
 Define Key Performance Indicators (KPIs). In an Agile model you should expect smaller scoped tests, executed at a higher frequency. It’s
critical to have a set of KPIs the group understands, and buys into, so you can quickly look at a test and interpret if a) things look good,
or b) something funky happened and additional investigation is needed. Some organizations have clearly defined non-functional criteria,
or SLAs, and many don’t. Be Agile with your KPIs, and refine them over time. Here are some of the KPIs we commonly evaluated:
 Environments
 Needs to be performed in pre prod after the code has been QA certified
 Tools
 Use load runner
 Resources:
 Performance Test engineer
 Change Agile from a development practice to a delivery practice
 Build a change-friendly framework
 Bake performance testing into every iteration Performance awareness, practices, and
results will organically increase if it is a well represented function within the team as
opposed to an after thought
 Automate as soon as possible
 Extend your Continuous Integration (CI) pipelines to include performance testing
 In an Agile model you should expect smaller scoped tests, executed at a higher
frequency. It’s critical to have a set of KPIs the group understands, and buys into, so
you can quickly look at a test and interpret if a) things look good, or b) something funky
happened and additional investigation is needed
 Monitor performance trends per iteration
 Monitor SLA performance per iteration

Más contenido relacionado

La actualidad más candente

RQM in scrum agile testing - Raj kumar
RQM in scrum agile testing - Raj kumarRQM in scrum agile testing - Raj kumar
RQM in scrum agile testing - Raj kumar
Roopa Nadkarni
 

La actualidad más candente (20)

Agile testing - Testing From Day 1
Agile testing - Testing From Day 1Agile testing - Testing From Day 1
Agile testing - Testing From Day 1
 
Agile testing - Reducing time to Market
Agile testing - Reducing time to MarketAgile testing - Reducing time to Market
Agile testing - Reducing time to Market
 
Relieveing the Testing Bottle Neck - Webinar
Relieveing the Testing Bottle Neck - WebinarRelieveing the Testing Bottle Neck - Webinar
Relieveing the Testing Bottle Neck - Webinar
 
Introducing QA Into an Agile Environment
Introducing QA Into an Agile EnvironmentIntroducing QA Into an Agile Environment
Introducing QA Into an Agile Environment
 
Agile QA presentation
Agile QA presentationAgile QA presentation
Agile QA presentation
 
Agile Testing - presentation for Agile User Group
Agile Testing - presentation for Agile User GroupAgile Testing - presentation for Agile User Group
Agile Testing - presentation for Agile User Group
 
Quality Assurance
Quality AssuranceQuality Assurance
Quality Assurance
 
QASymphony Atlanta Customer User Group Fall 2017
QASymphony Atlanta Customer User Group Fall 2017QASymphony Atlanta Customer User Group Fall 2017
QASymphony Atlanta Customer User Group Fall 2017
 
Certified Professional Master Agile Testing information and highlights
Certified Professional Master Agile Testing  information and highlightsCertified Professional Master Agile Testing  information and highlights
Certified Professional Master Agile Testing information and highlights
 
Addressing Performance Testing Challenges in Agile: Process and Tools: Impetu...
Addressing Performance Testing Challenges in Agile: Process and Tools: Impetu...Addressing Performance Testing Challenges in Agile: Process and Tools: Impetu...
Addressing Performance Testing Challenges in Agile: Process and Tools: Impetu...
 
RQM in scrum agile testing - Raj kumar
RQM in scrum agile testing - Raj kumarRQM in scrum agile testing - Raj kumar
RQM in scrum agile testing - Raj kumar
 
Scrum Testing Methodology
Scrum Testing MethodologyScrum Testing Methodology
Scrum Testing Methodology
 
Quality strategies in Agile Transformation
Quality strategies in Agile TransformationQuality strategies in Agile Transformation
Quality strategies in Agile Transformation
 
Agile Tester in a Nutshell
Agile Tester in a NutshellAgile Tester in a Nutshell
Agile Tester in a Nutshell
 
QA Best Practices in Agile World_new
QA Best Practices in Agile World_newQA Best Practices in Agile World_new
QA Best Practices in Agile World_new
 
QTest - Test management Tool
QTest - Test management ToolQTest - Test management Tool
QTest - Test management Tool
 
Agile Testing by Example
Agile Testing by ExampleAgile Testing by Example
Agile Testing by Example
 
QA Process Overview for Firefox OS 2014
QA Process Overview for Firefox OS 2014QA Process Overview for Firefox OS 2014
QA Process Overview for Firefox OS 2014
 
Istqb Agile-tester Extension
Istqb Agile-tester ExtensionIstqb Agile-tester Extension
Istqb Agile-tester Extension
 
Agile Test Automation
Agile Test AutomationAgile Test Automation
Agile Test Automation
 

Destacado

Destacado (10)

fundamentals of collaboration.ppt
fundamentals of collaboration.pptfundamentals of collaboration.ppt
fundamentals of collaboration.ppt
 
Bell&Baecher's Push-In/Pull-Out Collaboration ppt
Bell&Baecher's Push-In/Pull-Out Collaboration pptBell&Baecher's Push-In/Pull-Out Collaboration ppt
Bell&Baecher's Push-In/Pull-Out Collaboration ppt
 
Bilingual esl models_coto
Bilingual esl models_cotoBilingual esl models_coto
Bilingual esl models_coto
 
Creating a Collaborative Culture - SideraWorks
Creating a Collaborative Culture - SideraWorksCreating a Collaborative Culture - SideraWorks
Creating a Collaborative Culture - SideraWorks
 
The Future of Collaboration
The Future of CollaborationThe Future of Collaboration
The Future of Collaboration
 
The Three Speeds of Effective Collaboration
The Three Speeds of Effective CollaborationThe Three Speeds of Effective Collaboration
The Three Speeds of Effective Collaboration
 
Collaboration Diagram
Collaboration DiagramCollaboration Diagram
Collaboration Diagram
 
Collaboration Techniques that really work
Collaboration Techniques that really workCollaboration Techniques that really work
Collaboration Techniques that really work
 
Preventing Conflict and Building Social Cohesion through Respecting Diversity...
Preventing Conflict and Building Social Cohesion through Respecting Diversity...Preventing Conflict and Building Social Cohesion through Respecting Diversity...
Preventing Conflict and Building Social Cohesion through Respecting Diversity...
 
Collaborate to Win - Why Every Company Needs a Culture of Collaboration
Collaborate to Win - Why Every Company Needs a Culture of CollaborationCollaborate to Win - Why Every Company Needs a Culture of Collaboration
Collaborate to Win - Why Every Company Needs a Culture of Collaboration
 

Similar a Performance engineering10042915

Similar a Performance engineering10042915 (20)

Performance Testing in Agile Process
Performance Testing in Agile ProcessPerformance Testing in Agile Process
Performance Testing in Agile Process
 
Impact of QAOps on Software Quality
Impact of QAOps on Software QualityImpact of QAOps on Software Quality
Impact of QAOps on Software Quality
 
An Ultimate Guide to Continuous Testing in Agile Projects.pdf
An Ultimate Guide to Continuous Testing in Agile Projects.pdfAn Ultimate Guide to Continuous Testing in Agile Projects.pdf
An Ultimate Guide to Continuous Testing in Agile Projects.pdf
 
How Does IBM Do Agile
How Does IBM Do AgileHow Does IBM Do Agile
How Does IBM Do Agile
 
Quality Assurance Process
Quality Assurance ProcessQuality Assurance Process
Quality Assurance Process
 
Application Lifecycle Management with Visual Studio 2013
Application Lifecycle Management  with Visual Studio 2013Application Lifecycle Management  with Visual Studio 2013
Application Lifecycle Management with Visual Studio 2013
 
Non-Functional testing
Non-Functional testingNon-Functional testing
Non-Functional testing
 
Introduction to testing.
Introduction to testing.Introduction to testing.
Introduction to testing.
 
Ashish Baraiya
Ashish BaraiyaAshish Baraiya
Ashish Baraiya
 
Agile at scale
Agile at scaleAgile at scale
Agile at scale
 
hp_alm.docx
hp_alm.docxhp_alm.docx
hp_alm.docx
 
A Comprehensive Step-by-Step Guide for Designing an Agile-Friendly Automation...
A Comprehensive Step-by-Step Guide for Designing an Agile-Friendly Automation...A Comprehensive Step-by-Step Guide for Designing an Agile-Friendly Automation...
A Comprehensive Step-by-Step Guide for Designing an Agile-Friendly Automation...
 
Best Practices for a Repeatable Shift-Left Commitment
Best Practices for a Repeatable Shift-Left CommitmentBest Practices for a Repeatable Shift-Left Commitment
Best Practices for a Repeatable Shift-Left Commitment
 
How To Transform the Manual Testing Process to Incorporate Test Automation
How To Transform the Manual Testing Process to Incorporate Test AutomationHow To Transform the Manual Testing Process to Incorporate Test Automation
How To Transform the Manual Testing Process to Incorporate Test Automation
 
Visual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools WalkthroughVisual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools Walkthrough
 
Agile testing
Agile testingAgile testing
Agile testing
 
Agile case studies
Agile case studiesAgile case studies
Agile case studies
 
Agile Software Development Methodologies
Agile Software Development MethodologiesAgile Software Development Methodologies
Agile Software Development Methodologies
 
Shift Left - Approach and practices with IBM
Shift Left - Approach and practices with IBMShift Left - Approach and practices with IBM
Shift Left - Approach and practices with IBM
 
ExpoQA 2017 testing_tools_in_the_ages_of_devops_and_agile
ExpoQA 2017 testing_tools_in_the_ages_of_devops_and_agileExpoQA 2017 testing_tools_in_the_ages_of_devops_and_agile
ExpoQA 2017 testing_tools_in_the_ages_of_devops_and_agile
 

Último

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Último (20)

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 

Performance engineering10042915

  • 1.
  • 2.  Enable Performance Testing through the entire development cycle to ensure adequate performance of the code by the end of project  Define the acceptance criteria and definition of done or pass/fail of a story.  Build the performance testing into smaller cycles and call them unit performance testing that will measure component level performance .  Build performance test cases in the tools like Jira or any other tool to enable visibility.  Ensure that the Agile team are confirming the release against the agreed set of performance requirements.  Ensure continuous feedback among all stakeholders .
  • 3. Groups Tasks  Define how work will be broken down into small chunks.  Performance Team lead identifies performance testing stories and make sure the acceptance criteria is defined.  Resource Planning for sprint work.  Need to train the performance testers to adapt to agile approach. Tasks  Create performance test cases.  Create scripts run tests measure performance and report performance  Create front end performance measurement using web page test or equivalent . Scrum Level Progra m Level
  • 4.
  • 5.  Performance Activities  Create the performance test cases in shared repository for each sprint in parallel with coding.  Work on unit level performance test of each module being developed .  Report the individual module performance to scrum team  Automate the tests explore the tools that will work better to include as part of CI  Work on getting the test data created for regression test  Environments  Can be performed in QA environment after the code has been QA certified  Tools  We can explore the tools like JunitPerf .  We can also include the load testing scripts as part of the CI build.  Resources  Agile revolves around principle of cross training and working more in collabaration so this can be achieved by developers also to begin with once the performance engineer get ramped up.
  • 6.  Performance Activities  Create the performance test cases in shared repository for the hardening sprint.  Work on performance testing integrated components like services along with the UI  Report the performance of the integrated components.  Automate the tests and run the integrated tests(Single users tests) as part of CI To track performance.  Continue to work on getting the test data created for regression test  We may have this sprint or might create integration user stories as part of next sprint.  Environments  Can be performed in QA env after the code has been QA certified  Tools  Use load runner or Jeter be flexible with tool choices  Resources  Performance test engineer
  • 7.  Performance Activities  Fully integrate yourself into the Sprint team, immediately Performance awareness, practices, and results organically increased because it was a well represented function within the team as opposed to an after thought farmed out to a remote organization.  Build multiple performance and stress test scenarios with distinct goals and execution schedules. Plan for longer soak and stress tests as part of the release process, but have one or more per-sprint, and even nightly, performance tests that can be continually executed to proactively measure performance, and identify defects as they are introduced. Consider it your mission to quantify the performance impact of a code change.  Extend your Continuous Integration (CI) pipelines to include performance testing. At PayPal, I built custom integrations between Jenkins and JMeter to automate test execution and report generation. Our pipelines triggered automated nightly regressions on development branches and within a well-understood platform where QA and development could parameterize workload, kick-off a performance test and interpret a test report. Unless you like working 18-hour days, I can’t overstate the importance of building integrations into tools that are already or easily adopted by the broader team. If you’re using Jenkins, you might take a look at the Jenkins Performance Plugin.  Define Key Performance Indicators (KPIs). In an Agile model you should expect smaller scoped tests, executed at a higher frequency. It’s critical to have a set of KPIs the group understands, and buys into, so you can quickly look at a test and interpret if a) things look good, or b) something funky happened and additional investigation is needed. Some organizations have clearly defined non-functional criteria, or SLAs, and many don’t. Be Agile with your KPIs, and refine them over time. Here are some of the KPIs we commonly evaluated:  Environments  Needs to be performed in pre prod after the code has been QA certified  Tools  Use load runner  Resources:  Performance Test engineer
  • 8.  Change Agile from a development practice to a delivery practice  Build a change-friendly framework  Bake performance testing into every iteration Performance awareness, practices, and results will organically increase if it is a well represented function within the team as opposed to an after thought  Automate as soon as possible  Extend your Continuous Integration (CI) pipelines to include performance testing  In an Agile model you should expect smaller scoped tests, executed at a higher frequency. It’s critical to have a set of KPIs the group understands, and buys into, so you can quickly look at a test and interpret if a) things look good, or b) something funky happened and additional investigation is needed  Monitor performance trends per iteration  Monitor SLA performance per iteration