Se ha denunciado esta presentación.
Utilizamos tu perfil de LinkedIn y tus datos de actividad para personalizar los anuncios y mostrarte publicidad más relevante. Puedes cambiar tus preferencias de publicidad en cualquier momento.

QA Club Kiev #17 Measuring quality by Volodymyr Prymakov

The presentation will cover the following items:
Release Readiness criteria as a part of a master test plan, their types and details. (~ 30 min)
Release readiness criteria  appliance and areas of influence. (~ 5 min)
Quality report and quality metrics + their connection to release readiness criteria. (~ 15 min)
Concluding release readiness. (~1 min)
Questions (~ 10 min)

  • Inicia sesión para ver los comentarios

QA Club Kiev #17 Measuring quality by Volodymyr Prymakov

  1. 1. Measuring Quality Release Readiness Criteria and Quality Reporting
  2. 2. 22 11 Years general working experience in IT/QA (30+ projects) ---------- •QA Consultant at Ciklum Interactive •QA Manager (Manual) •Automated Testing Manager •Load Testing Manager •Project Manager ---------- •Hobbies: Job, Wife and 2 children, Sport ---------- Skype: vladimir.primakov Linkedin: ua.linkedin.com/in/vladimirprimakov/ Email: v.v.primakov@gmail.com Some Words About Me Volodymyr Prymakov (Vladimir Primakov)
  3. 3. 33 The presentation will cover the following items: • Release Readiness criteria as a part of a master test plan, their types and details. (~ 30 min) • Release readiness criteria appliance and areas of influence. (~ 5 min) • Quality report and quality metrics + their connection to release readiness criteria. (~ 15 min) • Concluding release readiness. (~1 min) • Questions (~ 10 min) Presentation’s Structure Presentation Plan
  4. 4. 44 Release Readiness Criteria as a part of Master Test Plan Release Readiness Criteria Master Test Plan
  5. 5. 55 Categories of Release Readiness Criteria Analyzing Quality (RESULTS) Catching Quality (ACTIVITIES) 1. New Functionality Testing 2. Regression Testing 3. Test Environments Testing 4. Unit & Integration testing 5. Special Types of Testing
  6. 6. 66 Any Ideas? Criteria for New Functionality Testing
  7. 7. 77 Short Example Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% Features of Any Priority Detailed Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria
  8. 8. 88 Short Example Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% Features of Any Priority Detailed Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria
  9. 9. 99 Short Example Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% Features of Any Priority Detailed Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria
  10. 10. 1010 Short Example Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% Features of Any Priority Detailed Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria
  11. 11. 1111 Short Example Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% Features of Any Priority Detailed Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria
  12. 12. 1212 Short Example Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% Features of Any Priority Detailed Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria
  13. 13. 1313 Short Example Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% Features of Any Priority Detailed Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria
  14. 14. 1414 Expanded Example Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% High (Blocker/Critical) Detailed Exploratory testing 100% 0% Medium (Major) Detailed Exploratory testing 100% 0% Low (Normal/Trivial) Happy path Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria
  15. 15. 1515 Test Deepness Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% High (Blocker/Critical) Detailed Exploratory testing 100% 0% Medium (Major) Detailed Exploratory testing 100% 0% Low (Normal/Trivial) Happy path Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria Test Deepness
  16. 16. 1616 Test Deepness Criteria for New Functionality Testing TEST DEEPNESS / DETALIZATION Test Case Based Thought Out Test Detailed Exploratory Test Happy Path Exploratory test Smoke test Nothing
  17. 17. 1717 Test Coverage Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% High (Blocker/Critical) Detailed Exploratory testing 100% 0% Medium (Major) Detailed Exploratory testing 100% 0% Low (Normal/Trivial) Happy path Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria Test Coverage
  18. 18. 1818 Test Coverage Criteria for New Functionality Testing Test Coverage Test Coverage is 71 %, But should be 100%
  19. 19. 1919 MaximumFail Rate % Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% High (Blocker/Critical) Detailed Exploratory testing 100% 0% Medium (Major) Detailed Exploratory testing 100% 0% Low (Normal/Trivial) Happy path Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria Fail Rate %
  20. 20. 2020 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs High (Blocker / Critical) 0 0 0 * * Medium (Major) 0 0 0 * * Low (Normal/Trivial) 0 0 * * * PASS CRITERIA *if too many bugs are in place for the functionality – the bugs number can be considered for any specific case separately
  21. 21. 2121 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs High (Blocker / Critical) 0 0 0 * * Medium (Major) 0 0 0 * * Low (Normal/Trivial) 0 0 * * * PASS CRITERIA *if too many bugs are in place for the functionality – the bugs number can be considered for any specific case separately
  22. 22. 2222 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs High (Blocker / Critical) 0 0 0 * * Medium (Major) 0 0 0 * * Low (Normal/Trivial) 0 0 * * * PASS CRITERIA *if too many bugs are in place for the functionality – the bugs number can be considered for any specific case separately
  23. 23. 2323 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs High (Blocker / Critical) 0 0 0 * * Medium (Major) 0 0 0 * * Low (Normal/Trivial) 0 0 * * * PASS CRITERIA
  24. 24. 2424 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs Features of Any Priority 0 0 * * * PASS CRITERIA (short and not so strict)
  25. 25. 2525 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs Features of Any Priority 0 0 * * * PASS CRITERIA (short and not so strict) Status: FAIL RATE % Blocked
  26. 26. 2626 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs Features of Any Priority 0 0 * * * PASS CRITERIA (short and not so strict) Status: FAIL RATE % Blocked Failed Release Readiness Criteria
  27. 27. 2727 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs Features of Any Priority 0 0 * * * PASS CRITERIA (short and not so strict) Status: FAIL RATE % Blocked Failed Release Readiness Criteria Status: Pass Rate % Failed With Acceptable Bugs
  28. 28. 2828 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs Features of Any Priority 0 0 * * * PASS CRITERIA (short and not so strict) Status: FAIL RATE % Blocked Failed Release Readiness Criteria Status: Pass Rate % Failed With Acceptable Bugs
  29. 29. 2929 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs Features of Any Priority 0 0 * * * PASS CRITERIA (short and not so strict) Status: FAIL RATE % Blocked Failed Release Readiness Criteria Status: Pass Rate % Failed With Acceptable Bugs
  30. 30. 3030 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs Features of Any Priority 0 0 * * * PASS CRITERIA (short and not so strict) Status: FAIL RATE % Blocked Failed Release Readiness Criteria Status: Pass Rate % Failed With Acceptable Bugs Passed
  31. 31. 3131 Fail Rate % Criteria for New Functionality Testing Test Coverage Fail Rate is 29%, But should be 0%
  32. 32. 3232 Test Environment Coverage Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% High (Blocker/Critical) Detailed Exploratory testing 100% 0% Medium (Major) Detailed Exploratory testing 100% 0% Low (Normal/Trivial) Happy path Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria Test Environments Coverage
  33. 33. 3333 Test Environment Coverage Criteria for New Functionality Testing Test Environments Type OS Browser/Device Resolution Priority PC Win 7 Chrome 1920*1080 Highest PC Win 8 (metro) IE 10 1920*1080 HighMac MacOS Firefox 1920*1080 iPad iOs7 iPad 4 2048*1536 Mac MacOS Safari 2880*1800 MediumPC Win 7 IE 11 1366*768 iPad iOs7 iPad 2 1024*768 PC Linux Firefox 1366*768 Low
  34. 34. 3434 Test Environment Coverage Criteria for New Functionality Testing Test Environments Type OS Browser/Device Resolution Priority PC Win 7 Chrome 1920*1080 Highest PC Win 8 (metro) IE 10 1920*1080 HighMac MacOS Firefox 1920*1080 iPad iOs7 iPad 4 2048*1536 Mac MacOS Safari 2880*1800 MediumPC Win 7 IE 11 1366*768 iPad iOs7 iPad 2 1024*768 PC Linux Firefox 1366*768 Low There is only 1 highest priority environment so the coverage, which it gives for the priority, is 100%.
  35. 35. 3535 Test Environment Coverage Criteria for New Functionality Testing Test Environments Type OS Browser/Device Resolution Priority PC Win 7 Chrome 1920*1080 Highest PC Win 8 (metro) IE 10 1920*1080 HighMac MacOS Firefox 1920*1080 iPad iOs7 iPad 4 2048*1536 Mac MacOS Safari 2880*1800 MediumPC Win 7 IE 11 1366*768 iPad iOs7 iPad 2 1024*768 PC Linux Firefox 1366*768 Low 1 environment of 3 high priority environments gives ~ 33% coverage. All these environments together gives 100% coverage for the priority.
  36. 36. 3636 Test Environment Coverage - Example Criteria for New Functionality Testing
  37. 37. 3737 What Else? Criteria for New Functionality Testing
  38. 38. 3838 What Else? Criteria for New Functionality Testing
  39. 39. 3939 DEFINTION OF DONE (EXAMPLE) User story reviewed & adjusted correspondingly Unit-test created and passed Integration test created and passed Pear review passed UX-review passed Manual Test Passed End User Test Passed… Definition of Done Criteria for New Functionality Testing
  40. 40. 4040 Criteria for Regression Testing
  41. 41. 4141 Criteria for Regression Testing Test Deepness
  42. 42. 4242 Criteria for Regression Testing Test Coverage Test Deepness
  43. 43. 4343 Criteria for Regression Testing Test Coverage Test Deepness Fail Rate
  44. 44. 4444 Criteria for Regression Testing Test Coverage Test Deepness Fail Rate Test Environments
  45. 45. 4545 Example Criteria for Regression Testing Test Environment Priority Coverage of Test Environments Tested Scenario Priority Minimum Test Deepness Minimum Functionalit y Coverage Maximum Fail Rate % The Highest one 100% High Detailed Exploratory testing 100% 0% Medium (That might be affected by recent product changes) Happy path Exploratory testing 100% 0% Other Medium Happy path Exploratory testing 50% 0% High See test environments related criteria Medium See test environments related criteria Low See test environments related criteria
  46. 46. 4646 Example Criteria for Regression Testing Test Environment Priority Coverage of Test Environments Tested Scenario Priority Minimum Test Deepness Minimum Functionalit y Coverage Maximum Fail Rate % The Highest one 100% High Detailed Exploratory testing 100% 0% Medium (That might be affected by recent product changes) Happy path Exploratory testing 100% 0% Other Medium Happy path Exploratory testing 50% 0% High See test environments related criteria Medium See test environments related criteria Low See test environments related criteria
  47. 47. 4747 Example Criteria for Regression Testing Test Environment Priority Coverage of Test Environments Tested Scenario Priority Minimum Test Deepness Minimum Functionalit y Coverage Maximum Fail Rate % The Highest one 100% High Detailed Exploratory testing 100% 0% Medium (That might be affected by recent product changes) Happy path Exploratory testing 100% 0% Other Medium Happy path Exploratory testing 50% 0% High See test environments related criteria Medium See test environments related criteria Low See test environments related criteria
  48. 48. 4848 Criteria for Test Environment Testing Possible Test Environment Ingredients Internet Speed Antivirus, Firewalls Plugins Integration with other applications and API User Rights Runtimes External Devices Screen Resolutions and Modes Hardware and Software Platforms and Modes Web-browsers Mobile Software Platforms Mobile Software Platforms External Libraries Hardware Characteristics and Capacity Robots (HD, Software, Capabilities)
  49. 49. 4949 Criteria for Test Environment Testing Product-wide Test Deepness
  50. 50. 5050 Criteria for Test Environment Testing Product-wide Test Deepness Full Regression Full Regression for functionality of certain priority Main product Flows test / User Acceptance Test / Cover test Selective Regression Smoke Test
  51. 51. 5151 Criteria for Test Environment Testing Coverage of Test Environments Product-wide Test Deepness
  52. 52. 5252 Criteria for Test Environment Testing Coverage of Test Environments Product-wide Test Deepness Fail Rate
  53. 53. 5353 Criteria for Test Environment Testing Test Environment Priority Target (functionality) Minimum Test Deepness Minimum Coverage of Test environments MaximumFa il Rate % Highest Please see the release readiness-criteria for new functionality and old functionality High New functionality Please see release readiness-criteria for new functionality Old (Regression-related) functionality Selective Regression and/or Main product Flows test 100% 0% Medium New and Old (Regression- related) functionality Product-wide Smoke test 75%* 0% Low New and Old (Regression- related) functionality Product-wide Smoke test 50%* 0% Example *Not covered environments may be covered next release and so on
  54. 54. 5454 Criteria for Test Environment Testing Test Environment Priority Target (functionality) Minimum Test Deepness Minimum Coverage of Test environments MaximumFa il Rate % Highest Please see the release readiness-criteria for new functionality and old functionality High New functionality Please see release readiness-criteria for new functionality Old (Regression-related) functionality Selective Regression and/or Main product Flows test 100% 0% Medium New and Old (Regression- related) functionality Product-wide Smoke test 75%* 0% Low New and Old (Regression- related) functionality Product-wide Smoke test 50%* 0% Example *Not covered environments may be covered next release and so on
  55. 55. 5555 Criteria for Test Environment Testing Test Environment Priority Target (functionality) Minimum Test Deepness Minimum Coverage of Test environments MaximumFa il Rate % Highest Please see the release readiness-criteria for new functionality and old functionality High New functionality Please see release readiness-criteria for new functionality Old (Regression-related) functionality Selective Regression and/or Main product Flows test 100% 0% Medium New and Old (Regression- related) functionality Product-wide Smoke test 75%* 0% Low New and Old (Regression- related) functionality Product-wide Smoke test 50%* 0% Example *Not covered environments may be covered next release and so on
  56. 56. 5656 Criteria for Unit & Integration Testing Test Coverage Fail Rate GUI-LESS Functionality GUI Functionality* Unit & Integration Testing Test Coverage Fail Rate *Criteria may be not so strict, because GUI functionality can be also manually tested
  57. 57. 5757 Criteria for Unit & Integration Testing Example Integration Testing or Unit-Testing Priority of functionality Minimum Functionality Coverage MaximumFail Rate % High 100% 0%* Medium 0% 0%* *Depends on severity of the problems found in integration/unit testing
  58. 58. 5858 Criteria for Special Types of testing Type of testing* Sufficient? (yes/no) Passed? Conclusions Load/Performance testing (client/server side) NOT READY Security Testing NOT READY UX-Testing READY (Accessibility Testing) NOT READY GENERAL CONCLUSSION: NOT READY * Usually has separate release readiness criteria, but in any case it should be sufficient and passed. Special types of testing, which are obligatory to be conducted and passed
  59. 59. 5959 Release readiness criteria appliance and areas of influence
  60. 60. 6060 Release readiness criteria appliance and areas of influence Release readiness criteria Defines testing activities and product quality sufficient for release Influences testing strategy, testing approaches, and activities needed Defines QA Resources requirements Defines Quality reporting structure and content Helps making conclusion about release readiness
  61. 61. 6161
  62. 62. 6262 For those who don’t sleep yet thank you for being cheerful! 
  63. 63. 6363 Quality Reporting and its connection to release readiness criteria Quality Reporting
  64. 64. 6464 1. Number of Bugs and their severity 2. New Functionality Testing & Results 3. Regression Testing & Results 4. Test Environments Testing & Results 5. Unit & Integration testing & Results 6. Special Types of Testing & Results 7. Concluding Release Readiness Quality Report Structure Quality Reporting
  65. 65. 6565 1. Number of Bugs and their severity 2. New Functionality Testing & Results 3. Regression Testing & Results 4. Test Environments Testing & Results 5. Unit & Integration testing & Results 6. Special Types of Testing & Results 7. Concluding Release Readiness Quality Report Structure Quality Reporting
  66. 66. 6666 All Not Closed Bugs Number of Bugs and their severity
  67. 67. 6767 All Not Closed Bugs Number of Bugs and their severity
  68. 68. 6868 All Not Closed Bugs – By Component Number of Bugs and their severity
  69. 69. 6969 All Not Closed Bugs – Not-Assigned to any Sprint Number of Bugs and their severity
  70. 70. 7070 Number of Bugs and their severity All Not Closed Bugs – Not-Assigned to any Sprint
  71. 71. 7171 Bugs List (for All not-closed bugs) – That fails release readiness criteria Number of Bugs and their severity Bugs List (for All not-closed bugs) – That fails release readiness criteria Assigned to sprints Not-Assigned to sprints
  72. 72. 7272 Number of Bugs and their severity Make a separate release readiness conclusion for this criterion type
  73. 73. 7373 New Functionality Statuses (From Tasks Management System) New Functionality Testing & Results Features Statuses (Current release)
  74. 74. 7474 New Functionality Statuses (From Tasks Management System) New Functionality Testing & Results Features Statuses (Current release) Not-Resolved Features By Components (Current release)
  75. 75. 7575 New Functionality Statuses (From Tasks Management System) New Functionality Testing & Results 1 Test Environments
  76. 76. 7676 New Functionality Statuses (From Tasks Management System) New Functionality Testing & Results 1 2
  77. 77. 7777 New Functionality Statuses (From Tasks Management System) New Functionality Testing & Results 1 2 3
  78. 78. 7878 New Functionality Statuses (From Tasks Management System) New Functionality Testing & Results 1 2 3 4
  79. 79. 7979 New Functionality Statuses (From Tasks Management System) New Functionality Testing & Results 1 2 3 4 Failed Functionalities Details (Optionally)
  80. 80. 8080 New Functionality Testing & Results Make a separate release readiness conclusion for this criterion type
  81. 81. 8181 Regression testing results for the highest priority environment Regression Testing & Results By Components
  82. 82. 8282 Regression testing results for the highest priority environment Regression Testing & Results Failed Functionalities Details (Optionally)
  83. 83. 8383 Regression Testing & Results Make a separate release readiness conclusion for this criterion type
  84. 84. 8484 Test Environments Testing & Results Test plans for test environments of different priorities
  85. 85. 8585 Test Environments Testing & Results Make a separate release readiness conclusion for this criterion type
  86. 86. 8686 GUI-less functionality Unit & Integration testing & Results Type of testing Coverage Fail Percentage Conclusions Unit-test 50% 0% READY Integration test 100% 0% READY GENERAL RELEASE READINESS CONCLUSSION: READY
  87. 87. 8787 GUI-less functionality Unit & Integration testing & Results Type of testing Coverage Fail Percentage Conclusions Unit-test 50% 0% READY Integration test 100% 0% READY GENERAL RELEASE READINESS CONCLUSSION: READY
  88. 88. 8888 GUI-less functionality Unit & Integration testing & Results Type of testing Coverage Fail Percentage Conclusions Unit-test 50% 0% READY Integration test 100% 0% READY GENERAL RELEASE READINESS CONCLUSSION: READY
  89. 89. 8989 GUI-less functionality Unit & Integration testing & Results Type of testing Coverage Fail Percentage Conclusions Unit-test 50% 0% READY Integration test 100% 0% READY GENERAL RELEASE READINESS CONCLUSSION: READY
  90. 90. 9090 Special Types of Testing & Results Type of testing* Sufficient? (yes/no) Passed? Conclusions Load/Performance testing (client/server side) NOT READY Security Testing NOT READY UX-Testing READY (Accessibility Testing) NOT READY GENERAL RELEASE READINESS CONCLUSSION: NOT READY * Usually has separate release readiness criteria, but in any case it should be sufficient and passed.
  91. 91. 9191 Special Types of Testing & Results Type of testing* Sufficient? (yes/no) Passed? Conclusions Load/Performance testing (client/server side) NOT READY Security Testing NOT READY UX-Testing READY (Accessibility Testing) NOT READY GENERAL RELEASE READINESS CONCLUSSION: NOT READY * Usually has separate release readiness criteria, but in any case it should be sufficient and passed.
  92. 92. 9292 Special Types of Testing & Results Type of testing* Sufficient? (yes/no) Passed? Conclusions Load/Performance testing (client/server side) NOT READY Security Testing NOT READY UX-Testing READY (Accessibility Testing) NOT READY GENERAL RELEASE READINESS CONCLUSSION: NOT READY * Usually has separate release readiness criteria, but in any case it should be sufficient and passed.
  93. 93. 9393 Special Types of Testing & Results Type of testing* Sufficient? (yes/no) Passed? Conclusions Load/Performance testing (client/server side) NOT READY Security Testing NOT READY UX-Testing READY (Accessibility Testing) NOT READY GENERAL RELEASE READINESS CONCLUSSION: NOT READY * Usually has separate release readiness criteria, but in any case it should be sufficient and passed.
  94. 94. 9494 Concluding Release Readiness Criterion Status 1. Number of Bugs and their severity NOT READY 2. New Functionality Testing & Results READY 3. Regression Testing & Results READY 4. Test Environments Testing & Results NOT READY 5. Unit & Integration testing & Results READY 6. Special Types of Testing & Results NOT READY GENERAL CONCLUSSION: NOT READY
  95. 95. 9595 Concluding Release Readiness Criterion Status 1. Number of Bugs and their severity NOT READY 2. New Functionality Testing & Results READY 3. Regression Testing & Results READY 4. Test Environments Testing & Results NOT READY 5. Unit & Integration testing & Results READY 6. Special Types of Testing & Results NOT READY GENERAL CONCLUSSION: NOT READY
  96. 96. 9696 Instruments Facilitating Quality Reporting CSV CSV As Gadgets, iFrames, Screenshots, Links plugins
  97. 97. 9797 Thank you! ;) QUESTIONS?

×