SlideShare una empresa de Scribd logo
1 de 29
Agile Defect Management
Focus On Prevention

David Jellison
Director, Quality Engineering


djellison@constantcontact.com
Twitter: davidjellison
You Will Learn
       Categorizing defects drives defect context
        management
       Testing is part of delivering a story or feature
       Detecting and resolving defects as the work is
        delivered prevents backlog
       Attaching an in-progress defect to a current story
        encapsulates the defect in the current work
       Escaping defects become the exception rather than
        the norm



    2                    Twitter: davidjellison
The One Finding The Most Bugs Wins!
                                  Downstream Testing Approach




      Lord of the Rings: Legolas & Gimli counting kills

                    Twitter: davidjellison
Preventing Bugs is Craftsmanship




                         upstream Testing Approach

              Twitter: davidjellison
Quest for Zero Defects
       You can only manage what is known
           Crosby’s “Zero Defect” standard manages to requirements
            (http://en.wikipedia.org/wiki/Zero_Defects)
       Agile changes the game, managing business value to
        the customer frequently
           Need a pattern to manage defects that we inevitably
            discover during and after release



                               Never really reach 0 Defects



    5                         Twitter: davidjellison
Defect Discovery

    Moving Defect Discovery Earlier




6
Traditional Defect Discovery Trends




7             Twitter: davidjellison
Late Defect Discovery Costs
       Opportunity cost
           Not working on other things
       Developer Context switching
           Time to get acclimated and then back again
       Rebuild and test time
           More cycles to deliver the fix
       Damage control
           Support time and reputation
       Other hidden costs…



    8                       Twitter: davidjellison
Traditional Defect Discovery Trends

                                       Defect debt accumulation




                                       Delay in resolution




                                       Defects resolved




                                       Dev/QE aligned

9             Twitter: davidjellison
Defect Discovery Improvement Plan
    Stop defect debt accumulation
        Move defect discovery up in the development cycle
        Embed QE into teams with Dev/QE alignment
        Prevent defects through design review & test automation
        Write failing regression tests as defects are discovered
    Test in sandbox
        Don’t wait for final integration environment to test
        Continuous build and continuous integration patterns
    Whole-team responsibility for quality
        Clear acceptance criteria for all new work
        Everyone tests
        Automated test code reviews with developer
    10                     Twitter: davidjellison
Defect Prevention

       Automating Along The Way




11
Defect Discovery Late

    Downstream test teams
     focus on defect
     discovery




    12               Twitter: davidjellison
Defect Discovery Early

    Embedded test teams
     focus on defect
     prevention
    Regression tests
     assure no system
     failures




    13              Twitter: davidjellison
Agile Practices
    Smaller cycles                                     Scrum
    Collaboration
    Design reviews
    Test early and
     often
    Test Driven
     Development
    Continuous
     Integration
    Automated                                 Kanban
     Regression
    14                Twitter: davidjellison
Automated Regression Tests



                                        Available
                                        Test Time




                                        Unattended
                                        Test Runs




15             Twitter: davidjellison
Defect Categorization

            Introducing WIP Defects




16
Categorizing Defects
    Escaping Defects
        Discovered defects allowed into the field
        Undiscovered defects found in the field




    17                      Twitter: davidjellison
Categorizing Defects
    WIP (work in progress) Defects
        Defects discovered in new code not yet delivered to field
        Becomes additional acceptance criteria for delivery
        Treat as subtasks of feature work
        Caged by the parent work in progress




    18                     Twitter: davidjellison
Managing Defect Discovery
    Its OK to not write
     defects if there are
     failing automated tests
     to manage
    Promote failing tests to
     WIP defects if need to
     manage separately
    Promote WIP defects
     that are still failing at
     time of delivery to
     escaping defects and
     added to the backlog

    19                   Twitter: davidjellison
Focus on Prevention
    Develop failing
     regression tests when
     discovered manually
    Continuous feedback
     through failing test run
     reports
    Associate WIP defects
     with feature work in
     progress




    20
Managing Escaping Defects
    Delivering business
     value over no defects
    No unknown failures in
     regression tests
    Coordinate planned
     escaping defects with
     customer support
    Reduce escaping
     defects to less than you
     can count on two hands


    21
Managing Escaping Defects
            “Jellison Jazz Hands”




             Twitter: davidjellison
Driving escaping defects down




23            Twitter: davidjellison   Number s for illustration only
Escaping Defect Reduction Plan
    Set expectation in the teams that fixing WIP defects
     is part of the acceptance criteria
    Add escaping defects in the field to the backlog and
     rank along with other work
    Plan to fix some number of escaping defects from
     the backlog in each development cycle
    Treat escaping defects as the exception rather than
     the norm




    24                 Twitter: davidjellison
Examples

     Using WIP Defects




25
Example: WIP Defects/Escaping Defects
    Shifting the focus to WIP defects results in far fewer
     escaping defects in the field, even with increased
     discovery
                                                 WIP Defects [blue]
                                                 Escaping Defects [red]




    26                  Twitter: davidjellison
Example: WIP Defects/Escaping Defects
    Each team may be in a different place with business
     risk and can manage escaping defects differently
                      Develop a theme strategy
                      WIP Defects [ red & blue]
                      Escaping Defects [green]




    27                 Twitter: davidjellison
What We Covered
    Categorizing defects drives defect context
     management
    Testing is part of delivering a story or feature
    Detecting and resolving defects as the work is
     delivered prevents backlog
    Attaching an in-progress defect to a current story
     encapsulates the defect in the current work
    Escaping defects become the exception rather than
     the norm



    28                Twitter: davidjellison
    Contact:
     David Jellison
     Dir, QE
     Constant Contact, Inc.
     1601 Trapelo Road
     Waltham, MA 01451
     djellison@constantcontact.com
     P: 339-222-5712
    Blog: http://davidjellison.wordpress.com
    Twitter: davidjellison
    http://ConstantContact.com/Careers

    29                 Twitter: davidjellison

Más contenido relacionado

La actualidad más candente

Defect Analytics & Statistical Trends
Defect Analytics & Statistical TrendsDefect Analytics & Statistical Trends
Defect Analytics & Statistical Trends
Mani Nutulapati
 
Software Inspection And Defect Management
Software Inspection And Defect ManagementSoftware Inspection And Defect Management
Software Inspection And Defect Management
Ajay K
 
Practical Application Of Risk Based Testing Methods
Practical Application Of Risk Based Testing MethodsPractical Application Of Risk Based Testing Methods
Practical Application Of Risk Based Testing Methods
Reuben Korngold
 
Test Management introduction
Test Management introductionTest Management introduction
Test Management introduction
Oana Feidi
 

La actualidad más candente (20)

Defect prevention
Defect preventionDefect prevention
Defect prevention
 
Defect MgmtBugDay Bangkok 2009: Defect Management
Defect MgmtBugDay Bangkok 2009: Defect ManagementDefect MgmtBugDay Bangkok 2009: Defect Management
Defect MgmtBugDay Bangkok 2009: Defect Management
 
Defect Analytics & Statistical Trends
Defect Analytics & Statistical TrendsDefect Analytics & Statistical Trends
Defect Analytics & Statistical Trends
 
Advanced Defect Management
Advanced Defect ManagementAdvanced Defect Management
Advanced Defect Management
 
Software Inspection And Defect Management
Software Inspection And Defect ManagementSoftware Inspection And Defect Management
Software Inspection And Defect Management
 
Develop a Defect Prevention Strategy—or Else!
Develop a Defect Prevention Strategy—or Else!Develop a Defect Prevention Strategy—or Else!
Develop a Defect Prevention Strategy—or Else!
 
Defect prevention techniques
Defect prevention techniquesDefect prevention techniques
Defect prevention techniques
 
Put Risk Based Testing in place right now!
Put Risk Based Testing in place right now!Put Risk Based Testing in place right now!
Put Risk Based Testing in place right now!
 
From Defect Reporting To Defect Prevention
From Defect Reporting To Defect PreventionFrom Defect Reporting To Defect Prevention
From Defect Reporting To Defect Prevention
 
risk based testing and regression testing
risk based testing and regression testingrisk based testing and regression testing
risk based testing and regression testing
 
ISTQB Advanced – Study Guide -1
ISTQB Advanced – Study Guide -1ISTQB Advanced – Study Guide -1
ISTQB Advanced – Study Guide -1
 
Test management
Test managementTest management
Test management
 
Practical Application Of Risk Based Testing Methods
Practical Application Of Risk Based Testing MethodsPractical Application Of Risk Based Testing Methods
Practical Application Of Risk Based Testing Methods
 
[HCMC STC Jan 2015] Risk-Based Software Testing Approaches
[HCMC STC Jan 2015] Risk-Based Software Testing Approaches[HCMC STC Jan 2015] Risk-Based Software Testing Approaches
[HCMC STC Jan 2015] Risk-Based Software Testing Approaches
 
Istqb chapter 5
Istqb chapter 5Istqb chapter 5
Istqb chapter 5
 
Test Management introduction
Test Management introductionTest Management introduction
Test Management introduction
 
Risk-Based Testing - Designing & managing the test process (2002)
Risk-Based Testing - Designing & managing the test process (2002)Risk-Based Testing - Designing & managing the test process (2002)
Risk-Based Testing - Designing & managing the test process (2002)
 
Defect analysis and prevention methods
Defect analysis and prevention methods Defect analysis and prevention methods
Defect analysis and prevention methods
 
ISTQB Advanced Test Manager Training 2012 - Testing Process
ISTQB Advanced Test Manager Training 2012 - Testing Process ISTQB Advanced Test Manager Training 2012 - Testing Process
ISTQB Advanced Test Manager Training 2012 - Testing Process
 
Risk-based Testing
Risk-based TestingRisk-based Testing
Risk-based Testing
 

Destacado

mimacom f the_process
mimacom f the_processmimacom f the_process
mimacom f the_process
Felix Kubasch
 

Destacado (16)

Agile metrics and quality
Agile metrics and qualityAgile metrics and quality
Agile metrics and quality
 
ICTSS 2010 - Iterative Software Testing Process for Scrum and Waterfall Projects
ICTSS 2010 - Iterative Software Testing Process for Scrum and Waterfall ProjectsICTSS 2010 - Iterative Software Testing Process for Scrum and Waterfall Projects
ICTSS 2010 - Iterative Software Testing Process for Scrum and Waterfall Projects
 
Der Agile Qualitätsbaukasten - PHP Unconference 2014
Der Agile Qualitätsbaukasten - PHP Unconference 2014Der Agile Qualitätsbaukasten - PHP Unconference 2014
Der Agile Qualitätsbaukasten - PHP Unconference 2014
 
Defect management using kanban
Defect management using kanbanDefect management using kanban
Defect management using kanban
 
Medical Device Agile Quality Demo
Medical Device Agile Quality DemoMedical Device Agile Quality Demo
Medical Device Agile Quality Demo
 
defect tracking and management
defect tracking and management   defect tracking and management
defect tracking and management
 
Metrics In An Agile World
Metrics In An Agile WorldMetrics In An Agile World
Metrics In An Agile World
 
O Julgamento do Scrum - Agile Brazil 2013
O Julgamento do Scrum - Agile Brazil 2013O Julgamento do Scrum - Agile Brazil 2013
O Julgamento do Scrum - Agile Brazil 2013
 
Processos Ágeis - Scrum, Kanban ou ScrumBan
Processos Ágeis - Scrum, Kanban ou ScrumBanProcessos Ágeis - Scrum, Kanban ou ScrumBan
Processos Ágeis - Scrum, Kanban ou ScrumBan
 
6. SCRUM e Kanban
6. SCRUM e Kanban6. SCRUM e Kanban
6. SCRUM e Kanban
 
High Quality Software Development with Agile and Scrum
High Quality Software Development with Agile and ScrumHigh Quality Software Development with Agile and Scrum
High Quality Software Development with Agile and Scrum
 
#LFMF: Tales of Test Automation Gone Wrong
#LFMF: Tales of Test Automation Gone Wrong #LFMF: Tales of Test Automation Gone Wrong
#LFMF: Tales of Test Automation Gone Wrong
 
Agile Quality and Risk Management
Agile Quality and Risk ManagementAgile Quality and Risk Management
Agile Quality and Risk Management
 
Build-in Quality!? SAFe® Testing im Finnova-Express (Swiss Testing Day 2017)
Build-in Quality!? SAFe® Testing im Finnova-Express (Swiss Testing Day 2017)Build-in Quality!? SAFe® Testing im Finnova-Express (Swiss Testing Day 2017)
Build-in Quality!? SAFe® Testing im Finnova-Express (Swiss Testing Day 2017)
 
mimacom f the_process
mimacom f the_processmimacom f the_process
mimacom f the_process
 
The new job of qa was ein quality engineer zukünftig können muss
The new job of qa   was ein quality engineer zukünftig können mussThe new job of qa   was ein quality engineer zukünftig können muss
The new job of qa was ein quality engineer zukünftig können muss
 

Similar a StarWest 2012 - Agile Defect Management: Focus On Prevention

BizDevOps – Delivering Business Value Quickly at Scale
BizDevOps – Delivering Business Value Quickly at ScaleBizDevOps – Delivering Business Value Quickly at Scale
BizDevOps – Delivering Business Value Quickly at Scale
QASymphony
 
Test driven development
Test driven developmentTest driven development
Test driven development
Sunil Prasad
 
Phoenix User Group Slides
Phoenix User Group SlidesPhoenix User Group Slides
Phoenix User Group Slides
agilebuddy
 
Release Management for Large Enterprises
Release Management for Large EnterprisesRelease Management for Large Enterprises
Release Management for Large Enterprises
Salesforce Developers
 

Similar a StarWest 2012 - Agile Defect Management: Focus On Prevention (20)

Codemotion Amsterdam 2016 - The DevOps Disaster
Codemotion Amsterdam 2016 - The DevOps DisasterCodemotion Amsterdam 2016 - The DevOps Disaster
Codemotion Amsterdam 2016 - The DevOps Disaster
 
GOTO Amsterdam 2016 - The DevOps Disaster
GOTO Amsterdam 2016 - The DevOps DisasterGOTO Amsterdam 2016 - The DevOps Disaster
GOTO Amsterdam 2016 - The DevOps Disaster
 
BizDevOps – Delivering Business Value Quickly at Scale
BizDevOps – Delivering Business Value Quickly at ScaleBizDevOps – Delivering Business Value Quickly at Scale
BizDevOps – Delivering Business Value Quickly at Scale
 
Digital Ocean Amsterdam meetup March 2017 - The DevOps disaster
Digital Ocean Amsterdam meetup March 2017 - The DevOps disasterDigital Ocean Amsterdam meetup March 2017 - The DevOps disaster
Digital Ocean Amsterdam meetup March 2017 - The DevOps disaster
 
Oracle Code Brussels 2017 - The DevOps disaster
Oracle Code Brussels 2017 - The DevOps disasterOracle Code Brussels 2017 - The DevOps disaster
Oracle Code Brussels 2017 - The DevOps disaster
 
SFSCON23 - Juri Solovjov - Flaky tests – how to deal with them
SFSCON23 - Juri Solovjov - Flaky tests – how to deal with themSFSCON23 - Juri Solovjov - Flaky tests – how to deal with them
SFSCON23 - Juri Solovjov - Flaky tests – how to deal with them
 
JavaOne 2016 - The DevOps Disaster
JavaOne 2016 -  The DevOps DisasterJavaOne 2016 -  The DevOps Disaster
JavaOne 2016 - The DevOps Disaster
 
The DevOps disaster: 15 ways to fail at DevOps - Bert Jan Schrijver - Codemot...
The DevOps disaster: 15 ways to fail at DevOps - Bert Jan Schrijver - Codemot...The DevOps disaster: 15 ways to fail at DevOps - Bert Jan Schrijver - Codemot...
The DevOps disaster: 15 ways to fail at DevOps - Bert Jan Schrijver - Codemot...
 
Jfokus 2017 - The DevOps Disaster
Jfokus 2017 - The DevOps Disaster Jfokus 2017 - The DevOps Disaster
Jfokus 2017 - The DevOps Disaster
 
DevOps Utrecht - The DevOps Disaster
DevOps Utrecht - The DevOps DisasterDevOps Utrecht - The DevOps Disaster
DevOps Utrecht - The DevOps Disaster
 
JavaZone 2016 - The DevOps disaster
JavaZone 2016 - The DevOps disasterJavaZone 2016 - The DevOps disaster
JavaZone 2016 - The DevOps disaster
 
Principles of Continuous Delivery and DevOps
Principles of Continuous Delivery and DevOpsPrinciples of Continuous Delivery and DevOps
Principles of Continuous Delivery and DevOps
 
Fail Fast, Fail Often
Fail Fast, Fail OftenFail Fast, Fail Often
Fail Fast, Fail Often
 
Ian Cooper webinar for DDD Iran: Kent beck style tdd seven years after
Ian Cooper webinar for DDD Iran: Kent beck style tdd   seven years afterIan Cooper webinar for DDD Iran: Kent beck style tdd   seven years after
Ian Cooper webinar for DDD Iran: Kent beck style tdd seven years after
 
Test driven development
Test driven developmentTest driven development
Test driven development
 
A collaborative approach to the quality in the agile enterprise by Jaco Viljoen
A collaborative approach to the quality in the agile enterprise by Jaco ViljoenA collaborative approach to the quality in the agile enterprise by Jaco Viljoen
A collaborative approach to the quality in the agile enterprise by Jaco Viljoen
 
Introduction to Agile Testing
Introduction to Agile TestingIntroduction to Agile Testing
Introduction to Agile Testing
 
Phoenix User Group Slides
Phoenix User Group SlidesPhoenix User Group Slides
Phoenix User Group Slides
 
Release Management for Large Enterprises
Release Management for Large EnterprisesRelease Management for Large Enterprises
Release Management for Large Enterprises
 
How BDD enables True CI/CD
How BDD enables True CI/CDHow BDD enables True CI/CD
How BDD enables True CI/CD
 

Último

Último (20)

Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 

StarWest 2012 - Agile Defect Management: Focus On Prevention

  • 1. Agile Defect Management Focus On Prevention David Jellison Director, Quality Engineering djellison@constantcontact.com Twitter: davidjellison
  • 2. You Will Learn  Categorizing defects drives defect context management  Testing is part of delivering a story or feature  Detecting and resolving defects as the work is delivered prevents backlog  Attaching an in-progress defect to a current story encapsulates the defect in the current work  Escaping defects become the exception rather than the norm 2 Twitter: davidjellison
  • 3. The One Finding The Most Bugs Wins! Downstream Testing Approach Lord of the Rings: Legolas & Gimli counting kills Twitter: davidjellison
  • 4. Preventing Bugs is Craftsmanship upstream Testing Approach Twitter: davidjellison
  • 5. Quest for Zero Defects  You can only manage what is known  Crosby’s “Zero Defect” standard manages to requirements (http://en.wikipedia.org/wiki/Zero_Defects)  Agile changes the game, managing business value to the customer frequently  Need a pattern to manage defects that we inevitably discover during and after release Never really reach 0 Defects 5 Twitter: davidjellison
  • 6. Defect Discovery Moving Defect Discovery Earlier 6
  • 7. Traditional Defect Discovery Trends 7 Twitter: davidjellison
  • 8. Late Defect Discovery Costs  Opportunity cost  Not working on other things  Developer Context switching  Time to get acclimated and then back again  Rebuild and test time  More cycles to deliver the fix  Damage control  Support time and reputation  Other hidden costs… 8 Twitter: davidjellison
  • 9. Traditional Defect Discovery Trends Defect debt accumulation Delay in resolution Defects resolved Dev/QE aligned 9 Twitter: davidjellison
  • 10. Defect Discovery Improvement Plan  Stop defect debt accumulation  Move defect discovery up in the development cycle  Embed QE into teams with Dev/QE alignment  Prevent defects through design review & test automation  Write failing regression tests as defects are discovered  Test in sandbox  Don’t wait for final integration environment to test  Continuous build and continuous integration patterns  Whole-team responsibility for quality  Clear acceptance criteria for all new work  Everyone tests  Automated test code reviews with developer 10 Twitter: davidjellison
  • 11. Defect Prevention Automating Along The Way 11
  • 12. Defect Discovery Late  Downstream test teams focus on defect discovery 12 Twitter: davidjellison
  • 13. Defect Discovery Early  Embedded test teams focus on defect prevention  Regression tests assure no system failures 13 Twitter: davidjellison
  • 14. Agile Practices  Smaller cycles Scrum  Collaboration  Design reviews  Test early and often  Test Driven Development  Continuous Integration  Automated Kanban Regression 14 Twitter: davidjellison
  • 15. Automated Regression Tests Available Test Time Unattended Test Runs 15 Twitter: davidjellison
  • 16. Defect Categorization Introducing WIP Defects 16
  • 17. Categorizing Defects  Escaping Defects  Discovered defects allowed into the field  Undiscovered defects found in the field 17 Twitter: davidjellison
  • 18. Categorizing Defects  WIP (work in progress) Defects  Defects discovered in new code not yet delivered to field  Becomes additional acceptance criteria for delivery  Treat as subtasks of feature work  Caged by the parent work in progress 18 Twitter: davidjellison
  • 19. Managing Defect Discovery  Its OK to not write defects if there are failing automated tests to manage  Promote failing tests to WIP defects if need to manage separately  Promote WIP defects that are still failing at time of delivery to escaping defects and added to the backlog 19 Twitter: davidjellison
  • 20. Focus on Prevention  Develop failing regression tests when discovered manually  Continuous feedback through failing test run reports  Associate WIP defects with feature work in progress 20
  • 21. Managing Escaping Defects  Delivering business value over no defects  No unknown failures in regression tests  Coordinate planned escaping defects with customer support  Reduce escaping defects to less than you can count on two hands 21
  • 22. Managing Escaping Defects “Jellison Jazz Hands” Twitter: davidjellison
  • 23. Driving escaping defects down 23 Twitter: davidjellison Number s for illustration only
  • 24. Escaping Defect Reduction Plan  Set expectation in the teams that fixing WIP defects is part of the acceptance criteria  Add escaping defects in the field to the backlog and rank along with other work  Plan to fix some number of escaping defects from the backlog in each development cycle  Treat escaping defects as the exception rather than the norm 24 Twitter: davidjellison
  • 25. Examples Using WIP Defects 25
  • 26. Example: WIP Defects/Escaping Defects  Shifting the focus to WIP defects results in far fewer escaping defects in the field, even with increased discovery WIP Defects [blue] Escaping Defects [red] 26 Twitter: davidjellison
  • 27. Example: WIP Defects/Escaping Defects  Each team may be in a different place with business risk and can manage escaping defects differently Develop a theme strategy WIP Defects [ red & blue] Escaping Defects [green] 27 Twitter: davidjellison
  • 28. What We Covered  Categorizing defects drives defect context management  Testing is part of delivering a story or feature  Detecting and resolving defects as the work is delivered prevents backlog  Attaching an in-progress defect to a current story encapsulates the defect in the current work  Escaping defects become the exception rather than the norm 28 Twitter: davidjellison
  • 29. Contact: David Jellison Dir, QE Constant Contact, Inc. 1601 Trapelo Road Waltham, MA 01451 djellison@constantcontact.com P: 339-222-5712  Blog: http://davidjellison.wordpress.com  Twitter: davidjellison  http://ConstantContact.com/Careers 29 Twitter: davidjellison

Notas del editor

  1. Phillip Crosby’s “Absolute Defect Management” with a “Zero Defect” quality standard can only be met when validating against very clear and precise requirements and standards.
  2. The relative cost of defect discovery at least doubles at each stage of .