Lights-Out Testing for Lights-On Business
•Descargar como PPTX, PDF•
1 recomendación•878 vistas
Running automated, unattended, end-to-end tests in parallel at scale is challenging. Fortunately, Lights Out Testing makes it possible to test any business process on demand. During this webinar we discuss how you can get started with automated test execution.
Recomendados
Recomendados
Más contenido relacionado
La actualidad más candente
La actualidad más candente (20)
Similar a Lights-Out Testing for Lights-On Business
Similar a Lights-Out Testing for Lights-On Business (20)
Más de Worksoft
Más de Worksoft (20)
Último
Último (20)
Lights-Out Testing for Lights-On Business
- 1. 1 Lights-Out Testing for Lights-On Business Ty Henson September 20, 2017
- 2. 2 Digital Risk It’s not just about security, hackers, and data theft
- 3. 3 Agenda • Effective automation testing • Creating on-demand automation • The right tool for the job Presented by Ty Henson Worksoft, Senior Solution Architect
- 4. 4 Late Defect Discovery is Expensive and Disruptive! 0 9599 2278 1331 $18 ($0) $180 ($1.7 M) $360 ($820K) $1,800 ($2.3 M) $0 $200 $400 $600 $800 $1,000 $1,200 $1,400 $1,600 $1,800 $2,000 0 2,000 4,000 6,000 8,000 10,000 12,000 Discovered in Requirements/Specs Discovered in Test Execution Discovered in UAT Discovered in Production Defect Correction Cost (5 Project Sample) Defects Cost to correct per defect
- 5. 5 Mainframe Client Server Web 1.0 Web 2.0 / Mobile HTML 5 VR & Biometrics 1980 2000 1990 2020 2010 2030 Modern Day UI Evolution As the way applications are written changes. The way we test must also.
- 6. 6 Business Analysts/QA “Does my Business Work?” Developers/Test Engineers “Does my Software Work?” UI Tests – The Bulk of Business Application Testing 6 End to End (UI) Integration ( API) Unit (Code) UI Testing Remains the Most Challenging to Automate. Last 10% takes 90% of the time!
- 8. 8 1 Discover Business Analysts/Super Users 2 Automate Quality Assurance/Automation Professionals 3 Run IT Operations/Project Management Capture, visualize, document & analyze end-to-end business processes Worksoft Analyze® Build and maintain a reusable portfolio of business process test automation Worksoft Analyze®, Worksoft Certify® Run automation at industrial scale for projects & ongoing operations Worksoft Certify®, Impact, Execution Manager, Business Process Procedure The Worksoft Solution
- 10. 10 Agenda Effective automation testing Cross-Platform End to End • Creating on-demand automation • The right tool for the job
- 11. 11
- 12. 12 • End to End Process • Enter Order • Outbound Delivery • Post Goods Issue • Invoicing Test Data Concepts
- 13. 13 • End to End Process + Add Inventory • Enter Order • Outbound Delivery • Post Goods Issue • Invoicing Test Data Concepts
- 14. 14 • End to End Process + Find or Generate Materials + Add Inventory • Enter Order • Outbound Delivery • Post Goods Issue • Invoicing + Cleanup for Repeatability Test Data Concepts
- 15. 15 Agenda Effective automation testing Cross-Platform End to End Creating on-demand automation Self-sufficient and repeatable • The right tool for the job
- 16. 16 • Hundreds of tests under management across multiple applications • Tests must often be scheduled in sequence with complex dependencies • Difficult to manage distributed and diverse testing resources • Central monitoring can be a challenge • Testing time is strictly limited and closely scrutinized The Trouble with Automation
- 17. 17 UI Automation Challenges Access Orchestration Scale
- 18. 18 1 Discover Business Analysts/Super Users 2 Automate Quality Assurance/Automation Professionals 3 Run IT Operations/Project Management Capture, visualize, document & analyze end-to-end business processes Worksoft Analyze® Build and maintain a reusable portfolio of business process test automation Worksoft Analyze®, Worksoft Certify® Run automation at industrial scale for projects & ongoing operations Worksoft Certify®, Impact, Execution Manager, Business Process Procedure The Worksoft Solution
- 19. 19 Industrial Scale Intelligent Scheduling • Distributable agents to [geographically distributed] physical or virtual workstations • Mass parallel execution ability • Automatic load balanced execution • Dependencies to control intelligent execution Lights Out Testing and Continuous Testing Industrial Scale Intelligent Scheduling and Interoperable Execution Interoperable Execution Providing applications like those above the ability to trigger automation execution • Rest API calls • Command line interface (CLI) And more…
- 20. 20 Running Certify From CI - Jenkins Jenkins builds and creates build number Build Number Call Execution Manager Execution Manager REST Run Certify Tests Get Status Remote Test Lab 1 CI/CD Server EM Agent EM Agent EM Agent On premise Test Lab 2
- 21. 21 Demonstration
- 22. 22 Lights Out Testing (LOT) provides the ability to execute a battery of integrated tests at pre- determined times. These tests will be re-runable and will be based on exception reporting, requiring manual intervention only if the test fails. Tests can be scheduled at predetermined times and leverage: • Off-hour bandwidth • Use of infrastructure and personnel for other tasks • The execution of large, data centric integrated tests during off hours • Elimination of manual validation and audit What is Lights Out Testing (LOT)? “Because we’re covering all of the business processes in an automated fashion, we’re finding defects that also give us a snapshot of the data that’s causing a script to fail. Because we’re now on a 24-hour testing cycle, we can isolate the cause more efficiently, which also results in cost savings.” — Sada Krishnan, IT Project Manager, Reliant
- 23. 23 Cross Platform End to End Automation Bidirectional Communication with Other Applications and capabilities And more… SOA Rest API Mock Services File System Relationa l Queries Microsoft Office Executio n Execution Manager Interoperability
- 24. 24 Quality and Validation for DevOps and Packaged Application Testing SDLC Requirements • Test Cases Documented Architect Develop • Build Unit tests CI & Unit Test • Run Unit Tests CD to Staging Integration • API Functional • API Load Testing • Application Functional UAT • End to End • Requirement validation • Exploratory Testing CD to Prod Smoke • Production Validation Prepare • Test Cases Documented Discover • Business process changes • Integration Realize • End to End • Requirement validation • Exploratory Testing Go Live Run • Production Validation • Developer based testing specific to development of custom applications • Application functional testing common to both Testing SDLC – UI and end user focus Idea Major Developer Testing
- 25. 25 Supporting Continuous Integration and Continuous Delivery Develop Code Check in Backlog Groom Stories Sprint starts CI Continuous Integration CD Continuous Delivery Development Sprints Requirements • Test Cases Documented Architect Develop • Build Unit tests CI & Unit Test • Run Unit Tests CD to Staging Integration • API Functional • API Load Testing • Application Functional UAT • End to End • Requirement validation • Exploratory Testing CD to Prod Smoke • Production Validation Worksoft Execution Manager Application is deployed and connected End-to-end is available Development testing when code is not connected
- 27. 27 Agenda Effective automation testing Cross-Platform End to End Creating on-demand automation Self-sufficient and repeatable The right tool for the job Presented by Ty Henson Worksoft, Senior Solution Architect
- 28. 28 Case Study: US Federal Government Program 10 million+ participants; 400 core processes & 500,000 business process steps tested nightly Virtual Machines (150+)
- 29. 29 Case Study: Global Luxury Goods Manufacturer Enterprise wide automation effort for end-to-end business process validation with Worksoft Certify. Significant reduction in production defects for SAP, Web applications and more. 600 hours of automation running daily on 30+ virtual machines 55,000 hours of manual labor annually replaced 80% business coverage of 500 core processes. SCALE SAVINGS COVERAGE
- 30. 30
Notas del editor
- 2
- Lights-Out Testing for Lights-On Business September 20, 2017 • 10:00 am - 11:00 am CDT What if you could test any business processes on demand, or test all of them every night; how would that help you improve quality? Running automated, unattended, end-to-end tests in parallel at scale is challenging. To ensure application quality, tests typically need to be driven from a User Interface (UI). The computer needs to be on, a specific user needs to be logged in, the screen can’t be locked, and tests need to be orchestrated across multiple devices, in multiple labs – on premise, or in the cloud. This can seem next to impossible to setup and manage. Worksoft eliminates these challenges and more. Join us on September 20th at 10:00 am CDT and learn how to: Automate user like testing with ease Take control of all testing devices and monitor tests and results from a single machine Run tests in remote test labs, on demand and in parallel Schedule tests to run on repeating schedules, or trigger them from your continuous integration (CI) and continuous delivery (CD) platforms
- We have a difficult time collecting meaningful metrics
- Discover – streamlines the knowledge transfer from the business to IT. 60% to 70% of the effort to build automation. The only solution that streamlines.... Gives time back to the business. As a by product, enable you to construct accurate documentation of your business process. Testing solutions designed for software developers (like HP and Tricentis) do not have this functionality. Automate – Because it is so much easier to capture business processes, it‘s possible to achieve high business process coverage. It becomes reasonable to build an automation portfolio of every core business process across the entire enterprise. Run – Because maintenance and automation is so much easier, you can achieve large scale. And because it doesn‘t break, you can just run --- 100 times more automation. Monthly, weekly, even daily at very high velocity.
- Lights-Out Testing for Lights-On Business September 20, 2017 • 10:00 am - 11:00 am CDT What if you could test any business processes on demand, or test all of them every night; how would that help you improve quality? Running automated, unattended, end-to-end tests in parallel at scale is challenging. To ensure application quality, tests typically need to be driven from a User Interface (UI). The computer needs to be on, a specific user needs to be logged in, the screen can’t be locked, and tests need to be orchestrated across multiple devices, in multiple labs – on premise, or in the cloud. This can seem next to impossible to setup and manage. Worksoft eliminates these challenges and more. Join us on September 20th at 10:00 am CDT and learn how to: Automate user like testing with ease Take control of all testing devices and monitor tests and results from a single machine Run tests in remote test labs, on demand and in parallel Schedule tests to run on repeating schedules, or trigger them from your continuous integration (CI) and continuous delivery (CD) platforms
- Lights-Out Testing for Lights-On Business September 20, 2017 • 10:00 am - 11:00 am CDT What if you could test any business processes on demand, or test all of them every night; how would that help you improve quality? Running automated, unattended, end-to-end tests in parallel at scale is challenging. To ensure application quality, tests typically need to be driven from a User Interface (UI). The computer needs to be on, a specific user needs to be logged in, the screen can’t be locked, and tests need to be orchestrated across multiple devices, in multiple labs – on premise, or in the cloud. This can seem next to impossible to setup and manage. Worksoft eliminates these challenges and more. Join us on September 20th at 10:00 am CDT and learn how to: Automate user like testing with ease Take control of all testing devices and monitor tests and results from a single machine Run tests in remote test labs, on demand and in parallel Schedule tests to run on repeating schedules, or trigger them from your continuous integration (CI) and continuous delivery (CD) platforms
- To ensure application quality, tests typically need to be driven from a User Interface (UI). The computer needs to be on, a specific user needs to be logged in, the screen can’t be locked, and tests need to be orchestrated across multiple devices, in multiple labs – on premise, or in the cloud. This can seem next to impossible to setup and manage.
- Discover – streamlines the knowledge transfer from the business to IT. 60% to 70% of the effort to build automation. The only solution that streamlines.... Gives time back to the business. As a by product, enable you to construct accurate documentation of your business process. Testing solutions designed for software developers (like HP and Tricentis) do not have this functionality. Automate – Because it is so much easier to capture business processes, it‘s possible to achieve high business process coverage. It becomes reasonable to build an automation portfolio of every core business process across the entire enterprise. Run – Because maintenance and automation is so much easier, you can achieve large scale. And because it doesn‘t break, you can just run --- 100 times more automation. Monthly, weekly, even daily at very high velocity.
- Lights-Out Testing for Lights-On Business September 20, 2017 • 10:00 am - 11:00 am CDT What if you could test any business processes on demand, or test all of them every night; how would that help you improve quality? Running automated, unattended, end-to-end tests in parallel at scale is challenging. To ensure application quality, tests typically need to be driven from a User Interface (UI). The computer needs to be on, a specific user needs to be logged in, the screen can’t be locked, and tests need to be orchestrated across multiple devices, in multiple labs – on premise, or in the cloud. This can seem next to impossible to setup and manage. Worksoft eliminates these challenges and more. Join us on September 20th at 10:00 am CDT and learn how to: Automate user like testing with ease Take control of all testing devices and monitor tests and results from a single machine Run tests in remote test labs, on demand and in parallel Schedule tests to run on repeating schedules, or trigger them from your continuous integration (CI) and continuous delivery (CD) platforms
- A large U.S. Government agency had an existing testing approach and was in the process of moving to Worksoft Certify. This organization has been able to convert nearly all of their 2,500+ QTP scripts to Worksoft Certify tests. By combining the single-transaction QTP scripts into end-to-end business processes, those 2,500+ QTP scripts were reduced to approximately 300 Worksoft Certify® business processes that can now be tested repeatedly in an automated fashion. Testing that once took weeks to execute can now be completed in a matter of hours. The successful conversion is giving the agency more complete testing coverage and validation that critical processes are being executed correctly.
- A large U.S. Government agency had an existing testing approach and was in the process of moving to Worksoft Certify. This organization has been able to convert nearly all of their 2,500+ QTP scripts to Worksoft Certify tests. By combining the single-transaction QTP scripts into end-to-end business processes, those 2,500+ QTP scripts were reduced to approximately 300 Worksoft Certify® business processes that can now be tested repeatedly in an automated fashion. Testing that once took weeks to execute can now be completed in a matter of hours. The successful conversion is giving the agency more complete testing coverage and validation that critical processes are being executed correctly.