Software tesing

1. 1
Ten Steps to Test Automation
Success
by Bret Pettichord
Presented by Wen Yin

2. 2
Introduction
• What is software test automation?
 “The management and performance of test
activities, to include the development and
execution of test scripts so as to verify test
requirements, using an automated test tool.”
 Significantly reduce the effort required for
adequate testing;
 Significantly increase the testing which can be
done in limited time.

3. Software Testing Life Cycle.
• Requirement/Design Review.
• Test Planning.
• Test Designing
• Test Environment Setup.
• Test Execution.
• Test Reporting.
• Retesting ..
3

4. Test Selection
• Choosing what and when to automate involves an
analysis of the following :Automate items that are tedious
for manual execution, but relatively easy to automate.
• Items that need to be executed over and over again.
• Items that will increase coverage beyond what will
realistically be done manually
• In addition, the decision depends on the goals of the
organization such as cost goals, efficiency goals, and
risk mitigation goals.
4

5. Automated Test Design and
Development
• Automated test design and development
are tied directly to the interface in which
the tests will be created, the way quality
attributes are applied at the test level, the
elements that are common to automated
tests, and the standards used for creation
of tests.
5

6. 6
Problems in test automation
• Spare time test automation.
• Misunderstanding the requirement.
• Improper Test design.
• Lack of clear goals.
• Lack of experience.
• Reaction to desperation.
• Reluctant to think about testing.
• Unable to reproduce the issues.
• Lack of known about new technologies.
• High turnover.

7. 7
Solution to the problem
• Follow the rules of software development
• Follow the seven steps to test automation
success:
– Improve the Testing Process
– Define Requirement
– Prove the Concept
– Champion Product Testability
– Design for Sustainability
– Plan for Deployment
– Face the Challenges of Success

8. 8
Step 1.
Improve the Testing Process
• Improve test automation documentation
– Explicit test approach (names, data, test design,
expected result)
• Get more computers
• Use advanced technology for in your testing tool.
• Improve the product for easier testing
– Improve the product install program
– Add error scanner to the product
– Identify and report slow functionality as a defect
– Identify and report which are not as per as
Requirements.
– Write test cases for achieve the 100% of test
coverage.

9. 9
Step 2. Define Requirements
• Different parties have different automation
goals.
• Come to agreement on what will count as
success.
• Focus on getting biggest payback, not
trying automate every part of tests.

10. 10
Step 3. Prove the Concept
• Prove the feasibility of test automation as
early as possible;
• A quick, meaningful test suites;
• Also an excellent way to evaluate tools
• Candidates for proof of concept:
– Regression testing
– Configuration tests
– Test bed setup
– Non-GUI testing

11. 11
Step 4.
Champion Product Testability
• Asking early for testability as a product
requirement;
• Getting testability features designed right
into the product;
• Encouraging to include CLI or API;
– GUI test automation is more difficult,
expensive and undependable;
– API and CLI are easier and cheaper;

12. 12
Step 5. Design for Sustainability
• Focus on design of long term sustainability
– test automation efforts are prone to being
dropped.
• Characteristics of a sustainable test suite
– Reviewability
– Maintainability
– Integrity
– Independence
– Repeatability

13. 13
Step 6. Plan for Deployment
• Package the automated tests for others to
use;
• Test your test suite;
• Get others to use your test suite as soon
as it’s ready;
• Make your test suite widely available to
the entire product team.
• Make sure your test suit should be easily
understand to your product team mates.

14. 14
Step 7.
Face the challenges
Success
• Testers are lack of automated testing skill;
• Improvement of test suite over time;
• Timing for when test automation should be
done

15. 15
Summary
• Test automation brings us both hopes and
disappointments.
• Seven Steps to the Success:
– Improve the Testing Process;
– Define Requirements
– Prove the Concept
– Champion Product Testability
– Design for Sustainability
– Plan for Deployment
– Face the Challenges of Success