The document describes Rational Quality Manager software which helps mitigate business risks, improve efficiency, and provide visibility into metrics. It demonstrates how the software facilitates test management, planning, creation, execution, and reporting through a series of labs. These labs cover activities like requirements tracing, importing requirements from other tools, and executing automated tests from Rational Quality Manager. The goal is to show how the software streamlines quality processes and collaboration across teams.
2. “ Doing it right is no excuse for not meeting the schedule”
3.
4. Run Down Lab 1 – Test Management Lab 2 – Test Planning Lab 3 – Test Creation Lab 4 – Test Execution Lab 5 – Test Reporting Quality Management Lifecycle Lab 6 – Requirements Coverage Lab 7 – Import Requirements from Requisite Pro Lab 8 – Executing Rational Functional Tests from Rational Quality Manager Rational Quality Manager Overview The QM Manager Mary The QM Manager Mary The QM Manager Mary The Tester Tony The Tester Tony
6. The increasing costs of fixing a defect 80% of development costs are spent identifying and correcting defects! During the requirements phase During the design phase Once released as a product During the QA/Testing phase Source: GBS Industry standard study Defect cost derived in assuming it takes 8 hrs to find, fix and repair a defect when found in code and unit test. Defect FFR cost for other phases calculated by using the multiplier on a blended rate of $80/hr. $80/defect $240/defect $960/defect $7,600/defect
7. Process-led Automation yields real savings Examples of automation capabilities Source: GBS Test Practices study over 855 projects Average per project saving with automation and collaboration best practices calculated on a per asset task and process savings Estimated hours saved per project: 4700 hours Integrating end to end processes Developing repeated test process models applicable to future projects Advanced Defect Analysis Developing repeatable industry test solutions Asset Test cases copied Manual scripts copied Manual script parts reused Prevent and Block duplicate Defects Baseline & migrate documentation Baseline artifacts Leveraging component Reuse Dynamic updates of test assets Quantity 290 296 1,178 765 1,154 1,711 870 1,883 Hours saved 141 148 589 Discovery in 4 Hr 1,484 577 855 435 470 Value $11, 600 $11,850 $47,000 $857,000 $46,200 $68,000 $34,800 $37,700
8. IBM® Rational raises the bar for Quality management Scenarios that show the difference Mitigate Business Risk Improve Operational Efficiency Make confident decisions Collaborate Automate Report
9.
10.
11. Make confident decisions What is needed: real time metrics On demand reporting for vital project information customizable by role Rational Quality Manager Process and asset based predictive analytics
12. Full lifecycle support across all types of testing and platforms JAZZ TEAM SERVER Manage Test Lab Create Plan Build Tests Report Results Test Management and Execution Rational Quality Manager Quality Dashboard Open Lifecycle Service Integrations Best Practice Processes homegrown Open Platform Java System z, i SAP .NET Third party vendors IBM Collaborative Application Lifecycle Management Functional Testing Performance Testing Web Service Quality Code Quality Security and Compliance Defect Management Requirements Management
15. Up to date work progress information Task management for individual and team Challenge: Assigning and coordinating test plan ownership and events across distributed teams Solution: Visualize commitments, reduce rework, track tasks and monitor events Testing Individual Task List Team event log Know what others are doing, know what others expect from you
22. Collaborative and adaptive test plan management Test plans that are easy to create and evolve with our projects Structured test plan with multiple user defined sections Track test plan history with version snapshots Individual ownership for every section
31. Question: How many software testers does it take to change a light bulb? Question: How many programmers does it take to change a light bulb? Answer: None. Software testers just noticed that the room was dark. Testers don't fix the problems, they just find them. Answer: What's the problem? The bulb at my desk works fine!
33. Configuration aware testing Test the right cases instead of everything. Plan optimal execution Configuration awareness Less than 20 Combinations Plan for test execution across all of your target environments 800 Total Combinations Pairwise Optimizations 10 different CPU Types Windows® XP Win XP SP2 Win Vista SLES 10 Win 2003 DB2® Oracle® MySql® Derby
34. IBM Rational Test Lab Manager Save 30-40% test time with integrated test lab management Manage Verify that I have the resources required to fulfill my test plan Deploy Deliver the configurations my teams require for test Optimize Analyze patterns to minimize cost and maximize utilization QA Teams spend more than 36% of their time configuring machines to make them ready for testing – IBM Survey
39. Reduce risk with constant access to quality metrics Lifecycle quality perspective to proactively manage risk Performance risks are always visible and quickly resolved Security risks are monitored continuously to ensure business continuity Manual and functional test automation results available Testing of requirements can be tracked to assure business needs are realized Change management and defect tracking fully integrated to assure all changes to production are tested Quality Manager Dashboard
40. On demand reporting Snapshot views of project status from multiple perspectives Customizable reporting enables sharing and communication of vital project information
51. Execution of RFT Tests from Rational Quality Manager JAZZ TEAM SERVER Manage Test Lab Create Plan Build Tests Report Results Test Management and Execution Rational Quality Manager Quality Dashboard Open Lifecycle Service Integrations Best Practice Processes homegrown Open Platform Java System z, i SAP .NET Ability to execute Rational Performance Tester (RPT), Web Service Tests, Security Tests, etc Third party vendors IBM Collaborative Application Lifecycle Management Functional Testing Performance Testing Web Service Quality Code Quality Security and Compliance Defect Management Requirements Management
56. “ Doing it right is no excuse for not meeting the schedule”
57.
58.
59.
Notas del editor
Demonstrate how Rational Quality Manager: Mitigates business risk: Catch defects earlier and keep the team in synch with dynamic process and activity-based workflows Improves operational efficiency: Automate labor-intensive lifecycle processes and determine optimal plans addressing wide range of platforms and requirements Provides greater visibility of metrics: Make reliable decisions with constant access to prioritized metrics tailored for individuals and teams Protect existing investments and deliver greater predictability: Adopt successful deployment patterns and map to operational Key Performance Indicators (KPIs), platforms and requirements
If we don’t catch a bug at the testing phase, then it can take the organisation 8 times as much cost to fix the same bug later. We need a process or some tools to help us to catch these bugs early.
These are numbers that are collected using an Internal GBS Solution collected over 4 years (2005 – 2008) for Test Management capabilities also being incorporated into RQM. Test Cases Copied – number of Test cases in tool that would be copied to create other Test Cases Manual Scripts Copied – Creation of Manual Scripts while starting with a copy of a current script Manual Script Reuse – Reusing portions of Manual Scripts Blocking Defect – identifying and preventing the creation of duplicate defects. This provide cost in terms of it took 4 hours effort to discover it was a duplicate of 10 hours. The longer it is worked, the more costly. Seeded Testware – Migrate Documentation over to tool to seed efforts moving forward for a test project Archived Testware – Completed phases of testing and want to base lining artifacts. The tool supporting this. Leveraging Reuse – This takes advantage of when using reusable components one can make a change and that change propogates to all things using the reusable conmponent.
Collaborate -Promoting team synergy Clearly define roles Keep team in synch with dynamic plans Communicate project status efficiently Accelerate Execution Automate manual tests for rapid cycles Execute locally or remotely Determine optimal plans to save effort and infrastructure Report- Instant project status Customized information Measure progress with dashboard Address needs of business stakeholders
Anyone never worked on a project with requirement change? Fact of life. Our role in the test team is to catch up with those req changes, although they aren’t always communicated on time. Integration with up stream, automated notification. Asset versioning – one click of a button and the whole set of test plans, test cases etc can be versioned/reproduced.
You keep track of test team work, they keep track of it too. Don’t necessarily match. Task list shared between test lead and test team will make life easier, one version of truth, no repeated data entry (or keeping track) Teams know what each other is doing so that no 2 people does the same job, or they can remind each other if things fall through cracks. Centralised test asset registry to enhance reuse.
You want to know what’s going on – current project info (is all requirements covered, how many sev 1 defects are outstanding, etc) as well as Trends (how is my test execution compared to planned)
In Lab 1 you generated one test environment. Read about pairwise optimisations. Will make less configurations for execution.
Talking about execution – test environment management. Not in our labs today but very useful if you have multiple test environments to manage.
Reporting needs to be timely, accurate, and relevant for you to make a decision.
Dashboard can be customised to provide exactly what you need.
RQM provides you with real time information, collected automatically, so that it is always timely and accurate.
Remember this slide from earlier….. Rational Quality Manager is built with an open execution engine with gives you the ability to execute any number of external tools you might use for testing. We provide pre-built adapters for IBMs tools including RFT. RPT, RST, AppScan additional adapters will be provided by partners to execute 3 rd party tools such as HP. If you have homegrown tools you can even build your own adapter.
Mitigate business risk: Faciliate collaboration within the team – everyone knows what is expected of them, and what others are doing Help collaboration across lifecycle – e.g. requirement changes gets flaged Approval process Repeatable process Improves effeciency Faciliate reuse such as key words Automation of tasks Automated data collection Reduce number of configurations Helps to manage (and even automate provisioning) of test environments Provides greater visibility of metrics Dashboard provides relevant information for your decision Real time reporting provides timely and accurate info Protect existing investements and deliver greater predictability 1.
3-day workshop packed with industry case studies, future forward innovation sessions, technical workshops and product information