SlideShare a Scribd company logo
1 of 6
Download to read offline
A Business Case for a Modern QA Organization
To describe what a modern QA organization could look like, we must first understand our
history. What defined a QA organization some 10-20 years ago?
Traditional QA Organization Traits
Almost as large as the development organization - 1:1 or 1:2 Tester:Developer ratio
Separate development and test teams
Focus on test cases for traceability, visibility and reporting
We run all our tests as often as we can because if they all pass we know everything is
working
Almost non-existent testing by developers, because they should focus their time on
development where they add the most value
Little collaboration between developers and testers until there is something to test
Test cases are sometimes designed by a Test Designer and then executed by a tester
Testing is performed very late in the SDLC, when the software is “done”
Testers are gatekeepers of quality and push developers to fix bugs
Test automation is driven by the QA organization because it only impacts their work
Focus on Black Box testing because testers should emulate our customers
Being a tester is a low skilled and low value job, and you are easily replaceable
Testers adapt around development processes
This was the reality around 20 years ago, but software development and testing has luckily
evolved since then.
Before we go into the details of why this was not efficient or effective, let’s look at an overview of
what a modern QA organization could look like in comparison.
Modern QA Organization Traits
1:7 QA Specialist:Developer ratio - basically one QA Specialist in an Agile team
QA Specialists are an integrated part of Agile teams
Focus on testing, not test cases - test cases are just artifacts that may or may not be useful
depending on context
We know that there is an unlimited number of tests we could run at any given time, and we let
risk analysis and opportunity cost guide how we spend our time efficiently to maximize value
Developers perform simple[1] and complicated[1] testing, QA Specialist focus on complex[1]
testing, and testing which require specialist competence and tools
Extensive collaboration between developers and testers, supporting and coaching each other
with their specialist competence
Tests are not designed in isolation, they are designed as an integrated part of the
development process
Test and quality is part of the entire SDLC, both Shift Left [2] and Shift Right [2]
Testers uncover quality information/intelligence which stakeholders use to make decision with
regards to quality, and the team as a whole owns the quality of the product
Test automation is software development and is driven by someone with that expertise
The more insight you have into the product as a QA Specialist the better - using the product
without any insight can be organized as specific test activities, such as user testing or
persona testing [3]
Being a QA Specialist requires a specific skill set that is not easily replaceable, just as a
developer or designer
QA Specialists use their expertise to influence good quality practices and processes
So why is the modern approach more effective and efficient than what was common 20 years
ago? What are the problems that were solved with this modern approach, and how were they
solved?
We can boil it down to three major problems:
● High operational costs
● Long lead times
● Insufficient quality
1. High Operational Costs
Having a large test department carries a high operational cost, and unless that cost actually
provides value in the form of shorter lead times and higher quality, it becomes a problem.
The solution to this is simple. Don’t have a large test department unless it provides value.
2. Long lead times
What caused long lead times with the traditional approach?
● Bugs and problems being found late in the SDLC, requiring delays to fix
● Handovers between development teams and test teams, especially when tasks go back
and forth due to lack of collaboration
● Redundant testing
● Creating unnecessary artifacts, such as test cases and test reports
● Test and QA activities are not planned accordingly due to lack of communication and
expertise in the right place
This is mainly solved in the modern approach by:
● Integrating QA specialists into development teams reduces handovers
● Working with quality and test throughout the SDLC reduces late bugs and problems, and
is planned accordingly from the start
● Risk-based testing [4] reduces redundant testing
● QA Specialists integrated in teams reduces unnecessary reporting, and focus on testing
instead of test cases reduces unnecessary test case creation
3. Insufficient quality
What caused insufficient quality with the traditional approach?
● Quality cannot be tested in, it needs to be built in from the start, and be on everyone’s
minds throughout the SDLC
● Developers not owning quality causes lack of agency in developing high quality code
and not designing around testability
● Lack of collaboration and coaching between people with different skill sets - QA
Specialists and Developers
● Making test automation a problem to solve for people without the right expertise
● Leaving business decisions related to quality in the hands of QA Specialists, who do not
have the right expertise to make those decisions
● Not hiring experienced QA Specialists with valuable expertise and skill set
● Not using QA Specialists’ expertise where it adds the most value - solving complex test
problems, but instead forcing QA Specialists to spend most of their time handling simple
[1] test problems that could be done by anyone
● Testing without actually understanding the underlying system can easily miss
non-intuitive test scenarios at worst, and just be inefficient at best
● Processes have been defined without QA expertise
This is mainly solved in the modern approach by:
● Quality and test are taken into consideration throughout the entire SLDC
● QA Specialists and developers work closely together, supporting and coaching each
other, taking testing and QA to the next level
● Everyone is accountable for their work, and the team as a whole is accountable for the
quality of the product
● Test automation is driven by someone with software development expertise, in
collaboration with anyone who can provide value, often QA Specialists
● QA Specialists are hired because of their specialist skills, just like developers are
● QA Specialists focus on solving complex test problems, with a strong understanding of
the underlying system, while everyone is responsible for testing their deliverables to the
best of their abilities
● QA Specialists use their expertise to influence practices and processes to achieve higher
quality and efficiency
● Business decisions around quality, such as what bugs to fix, are taken by people with the
right business expertise
Comparison Chart
Traditional QA Organization Traits Modern QA Organization Traits
Almost as large as the development organization - 1:1
or 1:2 Tester:Developer ratio
1:7 Developer:QA Specialist ratio - basically one QA
Specialist in an Agile team
Separate development and test teams QA Specialists are an integrated part of Agile teams
Focus on test cases for traceability, visibility and
reporting
Focus on testing, not test cases - test cases are just
artifacts that may or may not be useful depending on
context
We run all our tests as often as we can because if they
all pass we know everything is working
We know that there is an unlimited number of tests we
could run at any given time, and we let risk analysis and
opportunity cost guide how we spend our time efficiently
to maximize value
Almost non-existent testing by developers, because
they should focus their time on development where they
add the most value
Developers perform simple[1] and complicated[1]
testing, QA Specialist focus on complex[1] testing, and
testing which require specialist competence and tools
Little collaboration between developers and testers until
there is something to test
Extensive collaboration between developers and
testers, supporting and coaching each other with their
specialist competence
Test cases are sometimes designed by a Test Designer
and then executed by a tester
Tests are not designed in isolation, they are designed
as an integrated part of the development process
Testing is performed very late in the SDLC, when the
software is “done”
Test and quality is part of the entire SDLC, both Shift
Left [2] and Shift Right [2]
Testers are gatekeepers of quality and push developers
to fix bugs
Testers uncover quality information/intelligence which
stakeholders use to make decision with regards to
quality, and the team as a whole owns the quality of the
product
Test automation is driven by the QA organization
because it only impacts their work
Test automation is software development and is driven
by someone with that expertise
Focus on Black Box testing because testers should
emulate our customers
The more insight you have into the product as a QA
Specialist the better - using the product without any
insight can be organized as specific test activities, such
as user testing or persona testing [3]
Being a tester is a low skilled and low value job, and
you are easily replaceable
Being a QA Specialist requires a specific skill set that is
not easily replaceable, just as a developer or designer
Testers adapt around development processes QA Specialists use their expertise to influence good
quality practices and processes
References
[1] Cynefin Framework
https://en.wikipedia.org/wiki/Cynefin_framework
[2] Shift Left, Shift Right
https://www.dynatrace.com/news/blog/what-is-shift-left-and-what-is-shift-right/
[3] Personas - A Simple Introduction
https://www.interaction-design.org/literature/article/personas-why-and-how-you-should-use-them
[4] Heuristic Risk-Based Software Testing
https://www.satisfice.com/download/heuristic-risk-based-software-testing

More Related Content

Similar to A business case for a modern QA organization

How to overcome agile methodology challenges
How to overcome agile methodology challengesHow to overcome agile methodology challenges
How to overcome agile methodology challengesBugRaptors
 
What Makes A Great Dev Team - Mike Robinson
What Makes A Great Dev Team - Mike RobinsonWhat Makes A Great Dev Team - Mike Robinson
What Makes A Great Dev Team - Mike RobinsonJeffrey Clark
 
What Makes A Great Dev Team - Mike Robinson
What Makes A Great Dev Team - Mike RobinsonWhat Makes A Great Dev Team - Mike Robinson
What Makes A Great Dev Team - Mike RobinsonJeffrey Clark
 
Introducing QA Into an Agile Environment
Introducing QA Into an Agile EnvironmentIntroducing QA Into an Agile Environment
Introducing QA Into an Agile EnvironmentJoseph Beale
 
Qa 3 best practices
Qa 3 best practicesQa 3 best practices
Qa 3 best practicesJorge Boria
 
! Testing for agile teams
! Testing for agile teams! Testing for agile teams
! Testing for agile teamsDennis Popov
 
Process Guidelines
Process GuidelinesProcess Guidelines
Process Guidelinestechwriter
 
Agile Testing Transformation is as Easy as 1, 2, 3 by Michael Buening
Agile Testing Transformation is as Easy as 1, 2, 3 by Michael BueningAgile Testing Transformation is as Easy as 1, 2, 3 by Michael Buening
Agile Testing Transformation is as Easy as 1, 2, 3 by Michael BueningQA or the Highway
 
Quality - A Priority In Service Engagements
Quality - A Priority In Service EngagementsQuality - A Priority In Service Engagements
Quality - A Priority In Service Engagementsppd1961
 
Manual Testing real time questions .pdf
Manual Testing real time questions .pdfManual Testing real time questions .pdf
Manual Testing real time questions .pdfTiktokIndia2
 
SOFTWARE QUALITY ASSURANCE.ppt
SOFTWARE QUALITY ASSURANCE.pptSOFTWARE QUALITY ASSURANCE.ppt
SOFTWARE QUALITY ASSURANCE.pptDrTThendralCompSci
 
Code campiasi qa-in-agile-projects-ana-figher-embarcadero
Code campiasi qa-in-agile-projects-ana-figher-embarcaderoCode campiasi qa-in-agile-projects-ana-figher-embarcadero
Code campiasi qa-in-agile-projects-ana-figher-embarcaderoCodecamp Romania
 
ISTQB agile tester exam - Conclusions about Certification
ISTQB agile tester exam - Conclusions about CertificationISTQB agile tester exam - Conclusions about Certification
ISTQB agile tester exam - Conclusions about CertificationMichał Dudziak
 
Software testing for beginners
Software testing for beginners Software testing for beginners
Software testing for beginners ssuser622d45
 
Quality Testing and Agile at Salesforce
Quality Testing and Agile at Salesforce Quality Testing and Agile at Salesforce
Quality Testing and Agile at Salesforce Salesforce Engineering
 

Similar to A business case for a modern QA organization (20)

QAAgility Trainings Brochure
QAAgility Trainings BrochureQAAgility Trainings Brochure
QAAgility Trainings Brochure
 
QAAgility Trainings
QAAgility TrainingsQAAgility Trainings
QAAgility Trainings
 
How to overcome agile methodology challenges
How to overcome agile methodology challengesHow to overcome agile methodology challenges
How to overcome agile methodology challenges
 
What Makes A Great Dev Team - Mike Robinson
What Makes A Great Dev Team - Mike RobinsonWhat Makes A Great Dev Team - Mike Robinson
What Makes A Great Dev Team - Mike Robinson
 
What Makes A Great Dev Team - Mike Robinson
What Makes A Great Dev Team - Mike RobinsonWhat Makes A Great Dev Team - Mike Robinson
What Makes A Great Dev Team - Mike Robinson
 
Introducing QA Into an Agile Environment
Introducing QA Into an Agile EnvironmentIntroducing QA Into an Agile Environment
Introducing QA Into an Agile Environment
 
Qa 3 best practices
Qa 3 best practicesQa 3 best practices
Qa 3 best practices
 
! Testing for agile teams
! Testing for agile teams! Testing for agile teams
! Testing for agile teams
 
Process Guidelines
Process GuidelinesProcess Guidelines
Process Guidelines
 
quality
qualityquality
quality
 
Agile Testing Transformation is as Easy as 1, 2, 3 by Michael Buening
Agile Testing Transformation is as Easy as 1, 2, 3 by Michael BueningAgile Testing Transformation is as Easy as 1, 2, 3 by Michael Buening
Agile Testing Transformation is as Easy as 1, 2, 3 by Michael Buening
 
Quality - A Priority In Service Engagements
Quality - A Priority In Service EngagementsQuality - A Priority In Service Engagements
Quality - A Priority In Service Engagements
 
Manual Testing real time questions .pdf
Manual Testing real time questions .pdfManual Testing real time questions .pdf
Manual Testing real time questions .pdf
 
What is agile
What is agileWhat is agile
What is agile
 
SOFTWARE QUALITY ASSURANCE.ppt
SOFTWARE QUALITY ASSURANCE.pptSOFTWARE QUALITY ASSURANCE.ppt
SOFTWARE QUALITY ASSURANCE.ppt
 
Code campiasi qa-in-agile-projects-ana-figher-embarcadero
Code campiasi qa-in-agile-projects-ana-figher-embarcaderoCode campiasi qa-in-agile-projects-ana-figher-embarcadero
Code campiasi qa-in-agile-projects-ana-figher-embarcadero
 
ISTQB agile tester exam - Conclusions about Certification
ISTQB agile tester exam - Conclusions about CertificationISTQB agile tester exam - Conclusions about Certification
ISTQB agile tester exam - Conclusions about Certification
 
stfbegn.ppt
stfbegn.pptstfbegn.ppt
stfbegn.ppt
 
Software testing for beginners
Software testing for beginners Software testing for beginners
Software testing for beginners
 
Quality Testing and Agile at Salesforce
Quality Testing and Agile at Salesforce Quality Testing and Agile at Salesforce
Quality Testing and Agile at Salesforce
 

More from Johan Hoberg

Approaches to unraveling a complex test problem
Approaches to unraveling a complex test problemApproaches to unraveling a complex test problem
Approaches to unraveling a complex test problemJohan Hoberg
 
Signing off on Quality
Signing off on QualitySigning off on Quality
Signing off on QualityJohan Hoberg
 
Quality Information Coverage - A QI Concept
Quality Information Coverage - A QI ConceptQuality Information Coverage - A QI Concept
Quality Information Coverage - A QI ConceptJohan Hoberg
 
The Bug Backlog - An Evergrowing Mountain
The Bug Backlog - An Evergrowing MountainThe Bug Backlog - An Evergrowing Mountain
The Bug Backlog - An Evergrowing MountainJohan Hoberg
 
Quality Intelligence: Transparency & Visibility
Quality Intelligence: Transparency & VisibilityQuality Intelligence: Transparency & Visibility
Quality Intelligence: Transparency & VisibilityJohan Hoberg
 
Building a QA Mindset
Building a QA Mindset Building a QA Mindset
Building a QA Mindset Johan Hoberg
 
Building High Quality Software
Building High Quality Software Building High Quality Software
Building High Quality Software Johan Hoberg
 
Testit 2017 - Exploratory Testing for Everyone
Testit 2017 - Exploratory Testing for EveryoneTestit 2017 - Exploratory Testing for Everyone
Testit 2017 - Exploratory Testing for EveryoneJohan Hoberg
 
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...Johan Hoberg
 
Moving from scripted regression testing to exploratory testing
Moving from scripted regression testing to exploratory testingMoving from scripted regression testing to exploratory testing
Moving from scripted regression testing to exploratory testingJohan Hoberg
 
Building High Quality Software
Building High Quality SoftwareBuilding High Quality Software
Building High Quality SoftwareJohan Hoberg
 
Quality, Testing & Agile Methodologies
Quality, Testing & Agile MethodologiesQuality, Testing & Agile Methodologies
Quality, Testing & Agile MethodologiesJohan Hoberg
 
Defining Test Competence
Defining Test CompetenceDefining Test Competence
Defining Test CompetenceJohan Hoberg
 
Why all deadlines are bad for quality
Why all deadlines are bad for qualityWhy all deadlines are bad for quality
Why all deadlines are bad for qualityJohan Hoberg
 
Do we really need game testers?
Do we really need game testers?Do we really need game testers?
Do we really need game testers?Johan Hoberg
 
Hardware/Software Integration Testing
Hardware/Software Integration TestingHardware/Software Integration Testing
Hardware/Software Integration TestingJohan Hoberg
 
Defining Test Competence
Defining Test CompetenceDefining Test Competence
Defining Test CompetenceJohan Hoberg
 

More from Johan Hoberg (20)

Approaches to unraveling a complex test problem
Approaches to unraveling a complex test problemApproaches to unraveling a complex test problem
Approaches to unraveling a complex test problem
 
Signing off on Quality
Signing off on QualitySigning off on Quality
Signing off on Quality
 
Quality Information Coverage - A QI Concept
Quality Information Coverage - A QI ConceptQuality Information Coverage - A QI Concept
Quality Information Coverage - A QI Concept
 
The Bug Backlog - An Evergrowing Mountain
The Bug Backlog - An Evergrowing MountainThe Bug Backlog - An Evergrowing Mountain
The Bug Backlog - An Evergrowing Mountain
 
Quality Intelligence: Transparency & Visibility
Quality Intelligence: Transparency & VisibilityQuality Intelligence: Transparency & Visibility
Quality Intelligence: Transparency & Visibility
 
Building a QA Mindset
Building a QA Mindset Building a QA Mindset
Building a QA Mindset
 
What is QI?
What is QI?What is QI?
What is QI?
 
Building High Quality Software
Building High Quality Software Building High Quality Software
Building High Quality Software
 
Testit 2017 - Exploratory Testing for Everyone
Testit 2017 - Exploratory Testing for EveryoneTestit 2017 - Exploratory Testing for Everyone
Testit 2017 - Exploratory Testing for Everyone
 
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
 
Moving from scripted regression testing to exploratory testing
Moving from scripted regression testing to exploratory testingMoving from scripted regression testing to exploratory testing
Moving from scripted regression testing to exploratory testing
 
Building High Quality Software
Building High Quality SoftwareBuilding High Quality Software
Building High Quality Software
 
Quality, Testing & Agile Methodologies
Quality, Testing & Agile MethodologiesQuality, Testing & Agile Methodologies
Quality, Testing & Agile Methodologies
 
QI, not QA
QI, not QAQI, not QA
QI, not QA
 
Defining Test Competence
Defining Test CompetenceDefining Test Competence
Defining Test Competence
 
Why all deadlines are bad for quality
Why all deadlines are bad for qualityWhy all deadlines are bad for quality
Why all deadlines are bad for quality
 
QI, not QA
QI, not QAQI, not QA
QI, not QA
 
Do we really need game testers?
Do we really need game testers?Do we really need game testers?
Do we really need game testers?
 
Hardware/Software Integration Testing
Hardware/Software Integration TestingHardware/Software Integration Testing
Hardware/Software Integration Testing
 
Defining Test Competence
Defining Test CompetenceDefining Test Competence
Defining Test Competence
 

Recently uploaded

Call Girls Walvekar Nagar Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Walvekar Nagar Call Me 7737669865 Budget Friendly No Advance BookingCall Girls Walvekar Nagar Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Walvekar Nagar Call Me 7737669865 Budget Friendly No Advance Bookingroncy bisnoi
 
UNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its PerformanceUNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its Performancesivaprakash250
 
notes on Evolution Of Analytic Scalability.ppt
notes on Evolution Of Analytic Scalability.pptnotes on Evolution Of Analytic Scalability.ppt
notes on Evolution Of Analytic Scalability.pptMsecMca
 
Double Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torqueDouble Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torqueBhangaleSonal
 
Thermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - VThermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - VDineshKumar4165
 
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756dollysharma2066
 
Design For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the startDesign For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the startQuintin Balsdon
 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXssuser89054b
 
Generative AI or GenAI technology based PPT
Generative AI or GenAI technology based PPTGenerative AI or GenAI technology based PPT
Generative AI or GenAI technology based PPTbhaskargani46
 
Intze Overhead Water Tank Design by Working Stress - IS Method.pdf
Intze Overhead Water Tank  Design by Working Stress - IS Method.pdfIntze Overhead Water Tank  Design by Working Stress - IS Method.pdf
Intze Overhead Water Tank Design by Working Stress - IS Method.pdfEr. Suman Jyoti
 
Double rodded leveling 1 pdf activity 01
Double rodded leveling 1 pdf activity 01Double rodded leveling 1 pdf activity 01
Double rodded leveling 1 pdf activity 01KreezheaRecto
 
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 BookingVIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Bookingdharasingh5698
 
Unit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdfUnit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdfRagavanV2
 
Unit 2- Effective stress & Permeability.pdf
Unit 2- Effective stress & Permeability.pdfUnit 2- Effective stress & Permeability.pdf
Unit 2- Effective stress & Permeability.pdfRagavanV2
 
University management System project report..pdf
University management System project report..pdfUniversity management System project report..pdf
University management System project report..pdfKamal Acharya
 
Booking open Available Pune Call Girls Koregaon Park 6297143586 Call Hot Ind...
Booking open Available Pune Call Girls Koregaon Park  6297143586 Call Hot Ind...Booking open Available Pune Call Girls Koregaon Park  6297143586 Call Hot Ind...
Booking open Available Pune Call Girls Koregaon Park 6297143586 Call Hot Ind...Call Girls in Nagpur High Profile
 

Recently uploaded (20)

Call Girls Walvekar Nagar Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Walvekar Nagar Call Me 7737669865 Budget Friendly No Advance BookingCall Girls Walvekar Nagar Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Walvekar Nagar Call Me 7737669865 Budget Friendly No Advance Booking
 
UNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its PerformanceUNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its Performance
 
NFPA 5000 2024 standard .
NFPA 5000 2024 standard                                  .NFPA 5000 2024 standard                                  .
NFPA 5000 2024 standard .
 
notes on Evolution Of Analytic Scalability.ppt
notes on Evolution Of Analytic Scalability.pptnotes on Evolution Of Analytic Scalability.ppt
notes on Evolution Of Analytic Scalability.ppt
 
Double Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torqueDouble Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torque
 
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
 
Call Girls in Netaji Nagar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Netaji Nagar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort ServiceCall Girls in Netaji Nagar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Netaji Nagar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
 
Thermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - VThermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - V
 
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
 
Design For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the startDesign For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the start
 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
 
Generative AI or GenAI technology based PPT
Generative AI or GenAI technology based PPTGenerative AI or GenAI technology based PPT
Generative AI or GenAI technology based PPT
 
Call Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort ServiceCall Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
 
Intze Overhead Water Tank Design by Working Stress - IS Method.pdf
Intze Overhead Water Tank  Design by Working Stress - IS Method.pdfIntze Overhead Water Tank  Design by Working Stress - IS Method.pdf
Intze Overhead Water Tank Design by Working Stress - IS Method.pdf
 
Double rodded leveling 1 pdf activity 01
Double rodded leveling 1 pdf activity 01Double rodded leveling 1 pdf activity 01
Double rodded leveling 1 pdf activity 01
 
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 BookingVIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
 
Unit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdfUnit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdf
 
Unit 2- Effective stress & Permeability.pdf
Unit 2- Effective stress & Permeability.pdfUnit 2- Effective stress & Permeability.pdf
Unit 2- Effective stress & Permeability.pdf
 
University management System project report..pdf
University management System project report..pdfUniversity management System project report..pdf
University management System project report..pdf
 
Booking open Available Pune Call Girls Koregaon Park 6297143586 Call Hot Ind...
Booking open Available Pune Call Girls Koregaon Park  6297143586 Call Hot Ind...Booking open Available Pune Call Girls Koregaon Park  6297143586 Call Hot Ind...
Booking open Available Pune Call Girls Koregaon Park 6297143586 Call Hot Ind...
 

A business case for a modern QA organization

  • 1. A Business Case for a Modern QA Organization To describe what a modern QA organization could look like, we must first understand our history. What defined a QA organization some 10-20 years ago? Traditional QA Organization Traits Almost as large as the development organization - 1:1 or 1:2 Tester:Developer ratio Separate development and test teams Focus on test cases for traceability, visibility and reporting We run all our tests as often as we can because if they all pass we know everything is working Almost non-existent testing by developers, because they should focus their time on development where they add the most value Little collaboration between developers and testers until there is something to test Test cases are sometimes designed by a Test Designer and then executed by a tester Testing is performed very late in the SDLC, when the software is “done” Testers are gatekeepers of quality and push developers to fix bugs Test automation is driven by the QA organization because it only impacts their work Focus on Black Box testing because testers should emulate our customers Being a tester is a low skilled and low value job, and you are easily replaceable Testers adapt around development processes This was the reality around 20 years ago, but software development and testing has luckily evolved since then. Before we go into the details of why this was not efficient or effective, let’s look at an overview of what a modern QA organization could look like in comparison.
  • 2. Modern QA Organization Traits 1:7 QA Specialist:Developer ratio - basically one QA Specialist in an Agile team QA Specialists are an integrated part of Agile teams Focus on testing, not test cases - test cases are just artifacts that may or may not be useful depending on context We know that there is an unlimited number of tests we could run at any given time, and we let risk analysis and opportunity cost guide how we spend our time efficiently to maximize value Developers perform simple[1] and complicated[1] testing, QA Specialist focus on complex[1] testing, and testing which require specialist competence and tools Extensive collaboration between developers and testers, supporting and coaching each other with their specialist competence Tests are not designed in isolation, they are designed as an integrated part of the development process Test and quality is part of the entire SDLC, both Shift Left [2] and Shift Right [2] Testers uncover quality information/intelligence which stakeholders use to make decision with regards to quality, and the team as a whole owns the quality of the product Test automation is software development and is driven by someone with that expertise The more insight you have into the product as a QA Specialist the better - using the product without any insight can be organized as specific test activities, such as user testing or persona testing [3] Being a QA Specialist requires a specific skill set that is not easily replaceable, just as a developer or designer QA Specialists use their expertise to influence good quality practices and processes So why is the modern approach more effective and efficient than what was common 20 years ago? What are the problems that were solved with this modern approach, and how were they solved?
  • 3. We can boil it down to three major problems: ● High operational costs ● Long lead times ● Insufficient quality 1. High Operational Costs Having a large test department carries a high operational cost, and unless that cost actually provides value in the form of shorter lead times and higher quality, it becomes a problem. The solution to this is simple. Don’t have a large test department unless it provides value. 2. Long lead times What caused long lead times with the traditional approach? ● Bugs and problems being found late in the SDLC, requiring delays to fix ● Handovers between development teams and test teams, especially when tasks go back and forth due to lack of collaboration ● Redundant testing ● Creating unnecessary artifacts, such as test cases and test reports ● Test and QA activities are not planned accordingly due to lack of communication and expertise in the right place This is mainly solved in the modern approach by: ● Integrating QA specialists into development teams reduces handovers ● Working with quality and test throughout the SDLC reduces late bugs and problems, and is planned accordingly from the start ● Risk-based testing [4] reduces redundant testing ● QA Specialists integrated in teams reduces unnecessary reporting, and focus on testing instead of test cases reduces unnecessary test case creation 3. Insufficient quality What caused insufficient quality with the traditional approach? ● Quality cannot be tested in, it needs to be built in from the start, and be on everyone’s minds throughout the SDLC
  • 4. ● Developers not owning quality causes lack of agency in developing high quality code and not designing around testability ● Lack of collaboration and coaching between people with different skill sets - QA Specialists and Developers ● Making test automation a problem to solve for people without the right expertise ● Leaving business decisions related to quality in the hands of QA Specialists, who do not have the right expertise to make those decisions ● Not hiring experienced QA Specialists with valuable expertise and skill set ● Not using QA Specialists’ expertise where it adds the most value - solving complex test problems, but instead forcing QA Specialists to spend most of their time handling simple [1] test problems that could be done by anyone ● Testing without actually understanding the underlying system can easily miss non-intuitive test scenarios at worst, and just be inefficient at best ● Processes have been defined without QA expertise This is mainly solved in the modern approach by: ● Quality and test are taken into consideration throughout the entire SLDC ● QA Specialists and developers work closely together, supporting and coaching each other, taking testing and QA to the next level ● Everyone is accountable for their work, and the team as a whole is accountable for the quality of the product ● Test automation is driven by someone with software development expertise, in collaboration with anyone who can provide value, often QA Specialists ● QA Specialists are hired because of their specialist skills, just like developers are ● QA Specialists focus on solving complex test problems, with a strong understanding of the underlying system, while everyone is responsible for testing their deliverables to the best of their abilities ● QA Specialists use their expertise to influence practices and processes to achieve higher quality and efficiency ● Business decisions around quality, such as what bugs to fix, are taken by people with the right business expertise
  • 5. Comparison Chart Traditional QA Organization Traits Modern QA Organization Traits Almost as large as the development organization - 1:1 or 1:2 Tester:Developer ratio 1:7 Developer:QA Specialist ratio - basically one QA Specialist in an Agile team Separate development and test teams QA Specialists are an integrated part of Agile teams Focus on test cases for traceability, visibility and reporting Focus on testing, not test cases - test cases are just artifacts that may or may not be useful depending on context We run all our tests as often as we can because if they all pass we know everything is working We know that there is an unlimited number of tests we could run at any given time, and we let risk analysis and opportunity cost guide how we spend our time efficiently to maximize value Almost non-existent testing by developers, because they should focus their time on development where they add the most value Developers perform simple[1] and complicated[1] testing, QA Specialist focus on complex[1] testing, and testing which require specialist competence and tools Little collaboration between developers and testers until there is something to test Extensive collaboration between developers and testers, supporting and coaching each other with their specialist competence Test cases are sometimes designed by a Test Designer and then executed by a tester Tests are not designed in isolation, they are designed as an integrated part of the development process Testing is performed very late in the SDLC, when the software is “done” Test and quality is part of the entire SDLC, both Shift Left [2] and Shift Right [2] Testers are gatekeepers of quality and push developers to fix bugs Testers uncover quality information/intelligence which stakeholders use to make decision with regards to quality, and the team as a whole owns the quality of the product Test automation is driven by the QA organization because it only impacts their work Test automation is software development and is driven by someone with that expertise Focus on Black Box testing because testers should emulate our customers The more insight you have into the product as a QA Specialist the better - using the product without any insight can be organized as specific test activities, such as user testing or persona testing [3] Being a tester is a low skilled and low value job, and you are easily replaceable Being a QA Specialist requires a specific skill set that is not easily replaceable, just as a developer or designer Testers adapt around development processes QA Specialists use their expertise to influence good quality practices and processes
  • 6. References [1] Cynefin Framework https://en.wikipedia.org/wiki/Cynefin_framework [2] Shift Left, Shift Right https://www.dynatrace.com/news/blog/what-is-shift-left-and-what-is-shift-right/ [3] Personas - A Simple Introduction https://www.interaction-design.org/literature/article/personas-why-and-how-you-should-use-them [4] Heuristic Risk-Based Software Testing https://www.satisfice.com/download/heuristic-risk-based-software-testing