SlideShare una empresa de Scribd logo
1 de 21
QA is Dead!

Long live the
  new QA!
Ronen Bar Nahor, Yuval Yeret
      AgileSparks
 Challenging your comfort zone
        All Rights Reserved- AgileSparks
AgileSparks



 • We help companies improve by
    Adopting agile principles and practices.
 • We provide training and coaching to all organizational
   levels, from high management to developers.
 • Our team consists of Agile professionals with diverse
   expertise – several coaches participate in each
   implementation.
 • Successfully completed dozens of projects.




                      All Rights Reserved- AgileSparks
Agile is … Delighting Customers

 Deliver value to customers/users frequently,
 at a continuously sustainable pace, seeking
 constant feedback and welcoming direction
 changes in an UNCERTAIN DYNAMIC world




 *Maturity/Effectiveness of process is a factor of the frequency


                          All Rights Reserved- AgileSparks
Feature Teams
                                                        Testers
                                                        Developers




 •   Whole Team Approach
 •   Working Tested Software
 •   Build Quality In – Zero Defects
 •   Trusted / Empowered with Meaningful Goal

                     All Rights Reserved- AgileSparks
G-Forces of agility

                 Learn                    Idea




    Validate                                           Specify




                 Verify                  Code                                         Learn    Idea
                                                                                                                           Learn    Idea




                                                                                                                Validate                   Specify




                                                                                                                           Verify   Code

                                                                           Validate                   Specify




                                                                                      Verify   Code




                                                 All Rights Reserved- AgileSparks
http://www.slideshare.net/KentBeck/software-g-forces
Deployment to production: 1990




               Annual        Quarterly         Monthly                  Weekly      Daily   Hourly

                                                 All Rights Reserved- AgileSparks
http://www.slideshare.net/KentBeck/software-g-forces
Deployment to production : 2010




               Annual        Quarterly         Monthly                  Weekly      Daily   Hourly

                                                 All Rights Reserved- AgileSparks
http://www.slideshare.net/KentBeck/software-g-forces
Deployment to production : 2030




               Annual        Quarterly         Monthly                  Weekly      Daily   Hourly

                                                 All Rights Reserved- AgileSparks
http://www.slideshare.net/KentBeck/software-g-forces
Early Feedback – The Goal and the conflict…

                                     Improve – Reduce Testing Overhead

      Ideal Batch Size
            WITH                                          Ideal Batch        Traditional
      Great automation                                       W/O             Processes
                                                          Automation




                                         Earlier Feedback – Cheaper to change



                                             Lower Testing Overhead

  •   Even without reducing testing overhead it is usually more cost-effective to reduce batch size
  •   Aim to reduce testing overhead to reduce batch size even more and be even more cost-effective

                                          All Rights Reserved- AgileSparks
Automate at the right level
                                             Manual

                                                                            UI
                                                                            5%



                                                              Acceptance
           ROI
  Cost




                                                             (Service/API)
                                                                         15%


                                                               Unit Testing
                                                                         80%


                                                 All Rights Reserved- AgileSparks
http://www.mountaingoatsoftware.com/blog/the-forgotten-layer-of-the-test-automation-pyramid
How do we get these supermen testers?




             All Rights Reserved- AgileSparks
So what is the unique value of QA?




                 All Rights Reserved- AgileSparks
13


     Credit - Udi Weinberg – HP Software   All Rights Reserved- AgileSparks
Back to Basics – Minimize Quality Risks

 • Being Champions of the
   Product and the
   Customer/User.
 • Specializing in Performance/
   Security/Load/etc.
 • Shining light on where to
   focus quality efforts by
   analyzing risk probability
   and Impact.

                   All Rights Reserved- AgileSparks
Test for Value

          Deliver the RIGHT                                       it is
                even more important

         than doing                        it RIGHT
* Fit to Customer OVER Fit to Spec
                               All Rights Reserved- AgileSparks
New Perspective of QA’s Role




    Accountable to Quality:
    By Enabling it rather than Owning it




                All Rights Reserved- AgileSparks
Quality OVER Quantity - experts SUPPORTING delivery
                                                Test
                                         Experts/Architects



    Delivery Team
  Software Engineers                             Delivery Team
                                               Software Engineers




                Delivery Team                                       Choose where to be
              Software Engineers                                        involved


                                                               Delivery Team
     Delivery Team                                           Software Engineers
   Software Engineers
                          All Rights Reserved- AgileSparks
How will roles/ratios change over time?


                             Automation                           Test Engineers/
                              Experts                                 Experts

                             Testers




                                                                          SW Engineers

                SW Developers




      2005                       2010                             2015              2020
   *AgileSparks prediction             All Rights Reserved- AgileSparks
What do I do tomorrow?

 • Learn about post-agile QA.
 • Map Current State,
   Decide on Direction.
 • Work on
    – Effective whole team Automation/
      Continuous Integration/Deployment.
    – The “Test Engineer” Role –
      Identify, Gap Analysis,
      Establish plan for closing gaps.
    – Mindset/Doctrine and Processes/
      Policies to transition from Owning to
      Enabling at the teams level.

 • Proceed using small experiments or
   big revolution,
   depending on the context.


                          All Rights Reserved- AgileSparks
References




                                                         http://bit.ly/testisdeadGTAC11




                                                http://gojko.net/2012/05/08/redefin
                                                ing-software-quality/
             All Rights Reserved- AgileSparks
Questions? Ask us How

Ronen@AgileSparks.com
Yuval@AgileSparks.com
www.AgileSparks.com

Q&A at our booth




                    All Rights Reserved- AgileSparks

Más contenido relacionado

Más de AgileSparks

Más de AgileSparks (20)

Jira Portfolio by Elad Ben-Noam
Jira Portfolio by Elad Ben-NoamJira Portfolio by Elad Ben-Noam
Jira Portfolio by Elad Ben-Noam
 
Agile Hiring at Scale by Yon Bergman
Agile Hiring at Scale by Yon Bergman Agile Hiring at Scale by Yon Bergman
Agile Hiring at Scale by Yon Bergman
 
Are We Really Using Our Resources in The Most Effective Way? by Perry Yaqubo...
Are We Really Using Our Resources in The Most Effective Way?  by Perry Yaqubo...Are We Really Using Our Resources in The Most Effective Way?  by Perry Yaqubo...
Are We Really Using Our Resources in The Most Effective Way? by Perry Yaqubo...
 
Honest Experimentation by Jonathan Bertfield
 Honest Experimentation by Jonathan Bertfield Honest Experimentation by Jonathan Bertfield
Honest Experimentation by Jonathan Bertfield
 
Pango Journey to an Agile Cloud by Yaniv Kalo
Pango Journey to an Agile Cloud by Yaniv KaloPango Journey to an Agile Cloud by Yaniv Kalo
Pango Journey to an Agile Cloud by Yaniv Kalo
 
ClickSoftware Agile Tranistion by Meny Duek
ClickSoftware Agile Tranistion by Meny DuekClickSoftware Agile Tranistion by Meny Duek
ClickSoftware Agile Tranistion by Meny Duek
 
Augury's Journey Towards CD by Assaf Mizrachi
Augury's Journey Towards CD by Assaf Mizrachi Augury's Journey Towards CD by Assaf Mizrachi
Augury's Journey Towards CD by Assaf Mizrachi
 
Kubernetes is Hard! Lessons Learned Taking Our Apps to Kubernetes by Eldad Assis
Kubernetes is Hard! Lessons Learned Taking Our Apps to Kubernetes by Eldad AssisKubernetes is Hard! Lessons Learned Taking Our Apps to Kubernetes by Eldad Assis
Kubernetes is Hard! Lessons Learned Taking Our Apps to Kubernetes by Eldad Assis
 
Creating a Culture of Ownership and Trust with Visibility and Transparency by...
Creating a Culture of Ownership and Trust with Visibility and Transparency by...Creating a Culture of Ownership and Trust with Visibility and Transparency by...
Creating a Culture of Ownership and Trust with Visibility and Transparency by...
 
Real Innovation is with Real Customers by Baat Enosh
Real Innovation is with Real Customers by Baat EnoshReal Innovation is with Real Customers by Baat Enosh
Real Innovation is with Real Customers by Baat Enosh
 
True Continuous Improvement with Toyota Kata by Jesper Boeg
True Continuous Improvement with Toyota Kata by Jesper BoegTrue Continuous Improvement with Toyota Kata by Jesper Boeg
True Continuous Improvement with Toyota Kata by Jesper Boeg
 
Homo-Adaptus Agile Worker by Lior Frenkel
Homo-Adaptus Agile Worker by Lior FrenkelHomo-Adaptus Agile Worker by Lior Frenkel
Homo-Adaptus Agile Worker by Lior Frenkel
 
Intel CHD Case Study by Ronen Ezra
Intel CHD Case Study by Ronen EzraIntel CHD Case Study by Ronen Ezra
Intel CHD Case Study by Ronen Ezra
 
Leading Innovation by Jonathan Bertfield
Leading Innovation by Jonathan BertfieldLeading Innovation by Jonathan Bertfield
Leading Innovation by Jonathan Bertfield
 
Organization architecture autonomy and accountability
Organization architecture autonomy and accountability Organization architecture autonomy and accountability
Organization architecture autonomy and accountability
 
Tribal Unity, Agile Israel 2017
Tribal Unity, Agile Israel 2017Tribal Unity, Agile Israel 2017
Tribal Unity, Agile Israel 2017
 
The mindful manager, Agile Israel 2017
The mindful manager, Agile Israel 2017The mindful manager, Agile Israel 2017
The mindful manager, Agile Israel 2017
 
Agile Israel 2017 bugs zero by Arlo Belshee
Agile Israel 2017 bugs zero by Arlo BelsheeAgile Israel 2017 bugs zero by Arlo Belshee
Agile Israel 2017 bugs zero by Arlo Belshee
 
Agile בעידן הדיגיטלי
Agile בעידן הדיגיטליAgile בעידן הדיגיטלי
Agile בעידן הדיגיטלי
 
Agile Israel 2017 by VO
Agile Israel 2017 by VO Agile Israel 2017 by VO
Agile Israel 2017 by VO
 

Último

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Último (20)

A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 

QA is Dead - Long Live the New QA!

  • 1. QA is Dead! Long live the new QA! Ronen Bar Nahor, Yuval Yeret AgileSparks Challenging your comfort zone All Rights Reserved- AgileSparks
  • 2. AgileSparks • We help companies improve by Adopting agile principles and practices. • We provide training and coaching to all organizational levels, from high management to developers. • Our team consists of Agile professionals with diverse expertise – several coaches participate in each implementation. • Successfully completed dozens of projects. All Rights Reserved- AgileSparks
  • 3. Agile is … Delighting Customers Deliver value to customers/users frequently, at a continuously sustainable pace, seeking constant feedback and welcoming direction changes in an UNCERTAIN DYNAMIC world *Maturity/Effectiveness of process is a factor of the frequency All Rights Reserved- AgileSparks
  • 4. Feature Teams Testers Developers • Whole Team Approach • Working Tested Software • Build Quality In – Zero Defects • Trusted / Empowered with Meaningful Goal All Rights Reserved- AgileSparks
  • 5. G-Forces of agility Learn Idea Validate Specify Verify Code Learn Idea Learn Idea Validate Specify Verify Code Validate Specify Verify Code All Rights Reserved- AgileSparks http://www.slideshare.net/KentBeck/software-g-forces
  • 6. Deployment to production: 1990 Annual Quarterly Monthly Weekly Daily Hourly All Rights Reserved- AgileSparks http://www.slideshare.net/KentBeck/software-g-forces
  • 7. Deployment to production : 2010 Annual Quarterly Monthly Weekly Daily Hourly All Rights Reserved- AgileSparks http://www.slideshare.net/KentBeck/software-g-forces
  • 8. Deployment to production : 2030 Annual Quarterly Monthly Weekly Daily Hourly All Rights Reserved- AgileSparks http://www.slideshare.net/KentBeck/software-g-forces
  • 9. Early Feedback – The Goal and the conflict… Improve – Reduce Testing Overhead Ideal Batch Size WITH Ideal Batch Traditional Great automation W/O Processes Automation Earlier Feedback – Cheaper to change Lower Testing Overhead • Even without reducing testing overhead it is usually more cost-effective to reduce batch size • Aim to reduce testing overhead to reduce batch size even more and be even more cost-effective All Rights Reserved- AgileSparks
  • 10. Automate at the right level Manual UI 5% Acceptance ROI Cost (Service/API) 15% Unit Testing 80% All Rights Reserved- AgileSparks http://www.mountaingoatsoftware.com/blog/the-forgotten-layer-of-the-test-automation-pyramid
  • 11. How do we get these supermen testers? All Rights Reserved- AgileSparks
  • 12. So what is the unique value of QA? All Rights Reserved- AgileSparks
  • 13. 13 Credit - Udi Weinberg – HP Software All Rights Reserved- AgileSparks
  • 14. Back to Basics – Minimize Quality Risks • Being Champions of the Product and the Customer/User. • Specializing in Performance/ Security/Load/etc. • Shining light on where to focus quality efforts by analyzing risk probability and Impact. All Rights Reserved- AgileSparks
  • 15. Test for Value Deliver the RIGHT it is even more important than doing it RIGHT * Fit to Customer OVER Fit to Spec All Rights Reserved- AgileSparks
  • 16. New Perspective of QA’s Role Accountable to Quality: By Enabling it rather than Owning it All Rights Reserved- AgileSparks
  • 17. Quality OVER Quantity - experts SUPPORTING delivery Test Experts/Architects Delivery Team Software Engineers Delivery Team Software Engineers Delivery Team Choose where to be Software Engineers involved Delivery Team Delivery Team Software Engineers Software Engineers All Rights Reserved- AgileSparks
  • 18. How will roles/ratios change over time? Automation Test Engineers/ Experts Experts Testers SW Engineers SW Developers 2005 2010 2015 2020 *AgileSparks prediction All Rights Reserved- AgileSparks
  • 19. What do I do tomorrow? • Learn about post-agile QA. • Map Current State, Decide on Direction. • Work on – Effective whole team Automation/ Continuous Integration/Deployment. – The “Test Engineer” Role – Identify, Gap Analysis, Establish plan for closing gaps. – Mindset/Doctrine and Processes/ Policies to transition from Owning to Enabling at the teams level. • Proceed using small experiments or big revolution, depending on the context. All Rights Reserved- AgileSparks
  • 20. References http://bit.ly/testisdeadGTAC11 http://gojko.net/2012/05/08/redefin ing-software-quality/ All Rights Reserved- AgileSparks
  • 21. Questions? Ask us How Ronen@AgileSparks.com Yuval@AgileSparks.com www.AgileSparks.com Q&A at our booth All Rights Reserved- AgileSparks

Notas del editor

  1. The problem with small stories and continous testing and re-test  setup costCompressed Cycle compared to waterfallSymptom:everything slows down (“we don’t have time to develop anything, we test 50% of the time”)Done is not really Done. PSP==Potentially S#!*ty ProductNeed to minimize cost of stuff repeated per iteration – enable effective small batches