Driving Continuous Delivery with Service Virtualization
•Download as PPTX, PDF•
3 likes•1,295 views
Companies need to look for new ways to work in quality innovative applications in and out of the development and testing lifecycle. By continuously delivering new features and releases more quickly, an organization can better meet the demands of consumers and outmaneuver its competitors. But how to maintain quality in an always moving delivery cycle remains a core challenge. Learn how CA Service Virtualization works and enables testing across the software lifecycle, allowing developers, QA, and performance teams to work in parallel for faster delivery and more reliable outcomes. For more visit http://www.ca.com/us/products/ca-service-virtualization.html
Recommended
Recommended
More Related Content
Viewers also liked
Viewers also liked (11)
More from CA Technologies
More from CA Technologies (20)
Recently uploaded
Recently uploaded (20)
Driving Continuous Delivery with Service Virtualization
- 1. Welcome! Driving Continuous Delivery with Service Virtualization September 21, 2016 © 2016 CA. ALL RIGHTS RESERVED. ALL TRADEMARKS, TRADE NAMES, SERVICE MARKS AND LOGOS REFERENCED HEREIN BELONG TO THEIR RESPECTIVE COMPANIES. NO UNAUTHORIZED USE, COPYING OR DISTRIBUTION PERMITTED. PLEASE NOTE THAT THIS PRESENTATION IS FOR YOUR INFORMATIONAL PURPOSES ONLY DOES NOT SERVE AS ANY TECHNICAL USER GUIDES OR DOCUMENTATION. THERE IS NO DIRECT OR INDIRECT WARRANTY PROVIDED PERTAINING THE PRODUCTS AND ACTUAL USE MAY VARY FROM THE ILLUSTRATIONS PROVIDED.
- 2. 2 © 2016 CA. ALL RIGHTS RESERVED. Agenda PERSPECTIVE INTRO TO SERVICE VIRTUALIZATION AND DEMO THE VALUE OF SERVICE VIRTUALIZATOIN Q AND A 1 2 3 4
- 3. 3 © 2016 CA. ALL RIGHTS RESERVED. Businesses no longer have the luxury of time. Rising customer expectations, competitive threats, and increased consumer choice have turned rapid delivery and iteration of software applications into a competitive differentiator. Optimizing the delivery value chain has become the new means to better business outcomes. TechRadar™: Continuous Software Delivery, Q2 2015, Forrester Research, May 1, 2015 “ ” 2014 Vanson Bourne study commissioned by CA UNPRECEDENTED 94%of executives face increased pressure to release apps more quickly “ The Need for SPEED
- 4. 4 © 2016 CA. ALL RIGHTS RESERVED. No visibility across the app lifecycle Lack of Integrated Tool Sets Poor customer experience Deploy to Production Developers Release Team Operations TESTBUILD DEPLOY Testers OPERATE RE-WORK RE-WORK IDLE TIME Code | Integrate | Build DELAYS defect DELAYS defect Functional & UA Testing defect DELAYS Performance Testing Over Testing/ Poor Coverage/ Manual Process Constrained Environments/ Brittle Stubs & Mocks Developers Deadlocked Limited Access to Test Data / PII Risk Challenges to Delivering Innovations … Continuously of teams experience delays in development and QA due to unavailable dependencies* Over 80% 79% of teams face prohibitive restrictions, time limits or access fees on needed 3rd party services* *Source: voke Market Snapshot TM Report: Service Virtualization – January 2015
- 5. 5 © 2016 CA. ALL RIGHTS RESERVED. “Achieving speed and flexibility – Safely. From Agile to DevOps to Continuous Delivery” Freeform Dynamics Executive Insight Paper in Association with CA Technologies, June 2016 Download the full report at: http://cainc.to/IWWTm3
- 6. 6 © 2016 CA. ALL RIGHTS RESERVED.
- 7. 7 © 2016 CA. ALL RIGHTS RESERVED. Continuous Feedback Pillars of Continuous Delivery Agile Transformation Continuous Build & Integration Continuous Testing Configuration Management Continuous Release & Deployments Source: Blog – Pillars of Continuous Delivery – www.servicevirtulization.com Break into Continuous Delivery into smaller more manageable work-streams. By focusing on areas you can get quick wins in... you can move forward faster.
- 8. 8 © 2016 CA. ALL RIGHTS RESERVED. Optimized Organization for DevOps *Application release automation view Continuous Testing How do You Get There? Testing Technology Adoption and Maturity AGILEMATURITY Silos, manual handovers, waterfall, one release/year, monolithic apps, long term project/resource planning, error prone release processes DevOps, end-to-end delivery, incremental agile/sprint release cadence, multi- component micro apps, automation enabled, the right people with the right skills. Where are you? UI Test Automation Modeling & Test Generation Automation API Test Automation & Service Virtualization Continuous Testing
- 9. 9 © 2016 CA. ALL RIGHTS RESERVED. Industry Research: Gartner Market Guide for API Testing and Service Virtualization Key findings include: – The need for API testing and service virtualization is becoming increasingly important as IT organizations develop bimodal capability to support mobile, digital business transformation initiatives and the Internet of Things (IoT). – Service virtualization enables earlier, continuous, complete and parallel development and testing of software in a highly complex, heterogeneous and distributed environment. It can also reduce overall test lab costs.
- 10. 10 © 2016 CA. ALL RIGHTS RESERVED. Service Virtualization Who Benefits and How? Reduce Infrastructure Costs: Eliminate the need to procure equivalent hardware/software for dependent systems to support production- like load on the system under test. Eliminate Environment Sharing: The ability to isolate the system under test via virtual back ends eliminate environment sharing. This greatly minimizes scheduling, coordination & troubleshooting effort. Scalability : Allow environments to scale to conduct performance, load and endurance test Reduce Transaction Costs : Reduce the cost incurred due to the load supported by third party systems. Eliminate Wait Time: No more waiting for downstream systems to start test cycles and verify defects. Negative Test Coverage : Provide the ability to test application behavior for negative/ exception scenarios. Provide Stable Test Environment : Minimize testing delays due to the lack of a stable middleware or backend environments impacting you ability to develop and execute tests. Eliminate Wait Time : Eliminate waiting on dependent systems to continue development , reproduce defects or fix a defect. Enable Parallel Development : Eliminate waiting for other systems undergoing changes to provide “finished” services. Eliminate Mocking/Stubbing : No more creation/maintaining of brittle stubs and mocks Improve Agility : Easily update virtual service behavior as requirements rapidly evolve Shift Left : The ability to create more test scenarios allow you to catch defects early in the development stages. Development Teams QA and Testing Teams Performance Teams
- 11. 11 © 2016 CA. ALL RIGHTS RESERVED. Leverage Service Virtualization to Drive Continuous Testing ESB Mainframe System of Record ERP SaaS/API Simulate unavailable systems across the software development lifecycle (SDLC), allowing developers, testers, integration, and performance teams to work in parallel. I have everything I need, when I need it! “
- 12. 12 © 2016 CA. ALL RIGHTS RESERVED. Make Test Environments as “Life-Like” as Possible What’s the Difference Between Stubs, Mocks, and Service Virtualization?
- 13. 13 © 2016 CA. ALL RIGHTS RESERVED. Intro to CA Application Test – Included with CA SV! CA Application Test Test Data – TDM API Tests Web UI testsMobile Tests Realistic Performance Continuous Testing - SV Full-Stack Automated Scriptless Testing Complete test coverage across tech stack (e.g. APIs, Web UI, Mobile Devices, Web Services, JMS, MQ, SQL, File-based, etc.) Invoke and verify at each component level across the end-to-end application Portable, executable test suites that are easy to chain into workflows with other tests Easier to Create and maintain REST API tests Collaborate and re-use automated tests Readily execute tests against different environments with different underlying data Continuous Validation using CVE integrated with various notification mechanism CA Application Test 10.0 Not your usual “test automation” suite…CA Application Test shifts testing to left by moving testing closer to the logic.
- 14. 14 © 2016 CA. ALL RIGHTS RESERVED. Web App (Action Servlets, JSP) Port 8080 JBoss 4.2.1 Security Token Service User Control Service Account Control Service Web Services (JAX-WS) EJB3 Database (Derby) Kiosk JMS Other Apps Other Apps Other Apps Virtual Service Port 8001 SV Architecture
- 15. 15 © 2016 CA. ALL RIGHTS RESERVED. DemoView a demo of CA Service Virtualization at: https://www.youtube.com/watch?v=uXSSnS0vHKY
- 16. 16 © 2016 CA. ALL RIGHTS RESERVED. Performance Testing Innovate Faster while Delivering a High Quality Experience Use the same test cases created and optimized for functional testing Simulate backend load by running test thru an API Simulate life like test environments Generate purpose built test data Control outlier conditions Adjust think times Save Millions in infrastructure costs and 3rd party fees Detect Defects earlier in the SDLC Eliminate capacity constraints for performance testing Reduce delays with high-performance masking and subsetting, and automated data discovery Application “X” Test Cases Thousands of transactions Agent
- 17. 17 © 2016 CA. ALL RIGHTS RESERVED. Mainframe Risk Solution Providers Credit Bureau SMS Gateway Providers Teleconference Service Provider Card Processing Services VOIP Phone / Conference Bridges Bill Payment Services Motor Vehicle Records (MVR) System ESB Virtualize Almost Any IT Asset
- 18. 18 © 2016 CA. ALL RIGHTS RESERVED. Real World Results
- 19. 19 © 2016 CA. ALL RIGHTS RESERVED. CA Service Virtualization: Real Value Forrester Total Economic Impact (TEI) Study for CA Service Virtualization Based on three-year, risk-adjusted financial model for the composite organization “So without Service Virtualization, as highly integrated as our systems are, there is no way we could have speeded things up and moved to an Agile methodology.” — Senior manager, software engineering “In order to do performance testing required, we were able to virtualize a lot of back-end systems and hardware simulation, avoiding $1.8 million.” — AVP, quality assurance The Total Economic Impact™ Of CA Service Virtualization, a commissioned November 2015 study conducted by Forrester Consulting on behalf of CA Technologies Service Virtualization can help improve software quality, speed up time-to-market, and reduce costs. ROI 273% NPV $4.30M PAYBACK 3.2 mos. IMPROVED RELIABILITY Identifying 150 defects earlier in QA per release IMPROVED PRODUCTIVITY 640 hours of savings in Dev/QA processes per release
- 20. 20 © 2016 CA. ALL RIGHTS RESERVED. 99% reduction in testing times ------------------- 25% reduction in software defects Business Autotrader sells advertising that allows private and trade buyers and sellers to exchange vehicles. More than 18 million people use Auto- Trader.com each month. Challenge To meet customer demand for new online features and accessible across multiple devices, Autotrader needed to release software updates on a weekly basis. Testing, however, had become complex, costly and time-consuming. Solution CA Service Virtualization enables Autotrader to virtualize and test new services and apps on a multitude of devices, while simulating both apps working normally and while experiencing performance issues. CA Services completed implementation and training in just six weeks. Autotrader Avoids $300,000 in Testing Costs with CA Service Virtualization Autotrader is improving the customer experience with faster time-to-market. “The CA Technologies team blew the competition away with their knowledge and passion.”
- 21. 21 © 2016 CA. ALL RIGHTS RESERVED. Upcoming Events! TechWell STARWest Oct 5 & 6 – RECORDED Virtual Sessions CA World – Nov 14 -18 – Live Simulcasts
- 22. 22 © 2016 CA. ALL RIGHTS RESERVED. CA Continuous Delivery Portfolio Development OperationsTestPlanning Deploy CA Agile Requirements Designer CA Test Data Manager CA Continuous Application Insight CA Application Test CA Release Automation Agile Ops Agile Central CA Service Virtualization CA Release Automation Standard + Continuous Delivery Edition APIM APM
- 23. 23 © 2016 CA. ALL RIGHTS RESERVED. Resources Forrester SV TEI Study – http://bit.ly/CASV-TEI Service Virtualization Today – www.servicevirtualization.com Gartner Market Guide for API Testing and Virtualization – http://bit.ly/Gartner_SV-Guide Key Capabilities of CA Service Virtualization Whitepaper - http://bit.ly/CASV_WP Real Customers. Real Results – Service Virtualization customer success stories www.ca.com/CDResults IT Central Station – Real User Reviews and Comparison Guide https://www.itcentralstation.com/products/ca-service-virtualization CA Service Virtualization Home Page - http://www.ca.com/us/products/ca- service-virtualization.html?intcmp=headernav
- 24. 24 © 2016 CA. ALL RIGHTS RESERVED. © 2016 CA. All rights reserved. Thank you!
Editor's Notes
- We’ll cover how Service Virtualization helps: Replicates production like dependencies for testing Helps you control inputs like response times, so you can do more negative testing Virtualize 3rd party services so they are accessible all the time without fees Reproduces production defects for faster remediation Eliminates scheduling conflicts and enable parallel development
- Today – We live in a digital world, with 24 x 7 access and give it to me know expectations. So what are some of the challenges that stop us from going fast??
- People.. Process… Resources … FEAR.. We like to refer to this to “continuous challenges”.. Not enough time to create all the test cases that are needed for coverage The systems are not available when your ready to test A major change to the initial requirements was mad and all the test cases now need to be recreated Test data is not available - be it a mainframe system or APIs, or some 3rd party vendor’s system Testing keeps getting postponed to keep the project moving forward.. so testing doesn’t happen until the end of the cycle when errors and defects require significantly more re-work than if they’re found early. I love the line if your doing performance testing at the end of release your not really testing but measuring the performance.
- So how do then you do you go fast Safely? This is where Continuous Delivery comes into play. We recently sponsored a report with Freefrom Dynamics that addresses this exact issue. If you want to read more about the move frame DevOps to Continuous Delivery I recommend reading this.
- How.. Really the key is not about doing things faster.. But doing more things better in the time your given. So what is the best approach/where do you start?
- The old adage about how do you eat an elephant – one piece at a time applies here. By breaking into Continuous Delivery into smaller more manageable work-streams you can then start to evaluate where we are and look at the work that needs to be done within each area to move forward. We could spend a week talking about each of these areas but for the purpose of today’s discussion we’re going to focus in on how we achieve “Continuous Testing” So what we’re really talking about when we talk about how Service Virtualization enables Continuous Delivery is how Service Virtualization enables Continuous Testing.
- Continuous testing is the process of executing automated tests as part of the software delivery pipeline to obtain immediate feedback on the business risks associated with a software release candidate. The key word is “automated”. Automation is the key. Every organization is in a different place when it comes to automation. Automation requires new skill sets and can also create new problems. When you shift skill sets from knowing a process to a tool new checks/reviews need to be put in place to ensure the “tool” is working correctly. Orgs early in the process with large manual testing teams usually focus on IT Test Automation. Even the best automation frameworks tend to bring you back to manual test creation, either in the form of script creation or keyword selection. The time spent converting test cases to automated tests can often then outweigh the time saved executing them and maintenance can create a further bottleneck. With optimized test cases and the ability to auto execute more tests in shorter periods the problem then become availability – how then are you hitting all the systems you need to run you tests.. are they available? Do they behave like the real systems? Can you vary/control run conditions? . This is where Service Virtualization comes into play. When the system or requirements change, brittle automated tests must be updated, or otherwise you risk automated test failures and wasteful over-testing. This time spent identifying the impact of a change on tests and updating them can have a huge impact on speed and quality. Service Virtualization creates life like copies of APIs, services and systems that can be used for testing and development without the need to access production systems, purchase hardware/software for test environments or pay 3rp party access services. Without continuous access to the systems and services you need to test its impossible to continuously test.
- So who is service virtualization for? Everyone.
- Service virtualization listens to the conversation two systems are having. This conversation is translated into a recording that is used to replace the live service. Take for example testing a mainframe service. Access maybe limited to a couple of hours a week with service virtualization you can make a copy of that service and then use it whenever you want. This also comes into play when working with 3rd parties. Many times the testing environment provided by the 3rd party is not up to snuff. For example we had a client that was experiences significant delays in regression testing because the response times from the 3rd party by using service virtualization they were able to cut their testing times from 6 hours to 45 minutes.
- This is when a lot of people say well we can use mocks and stubs to do this type of thing. Mocks and stubs are limited to the same types of pre-canned requests and response every time you run the test. How will a mock and stub respond when you start replicating production level loads and pushing thru thousands of transactions per second. Mocks and stubs can’t scale up to the appropriate load levels needed to replicate the production environment. With service virtualization developers don’t need to create mocks and stubs and get access to the environments they need to test very early in the development time which further enhances productivity.
- Enterprise applications are becoming more complex, distributed, and heterogeneous. Application business logic is no longer found only in the UI and the database (as in client/server), but now extends across multiple middle tiers and technologies. This is further complicated when applications consume underlying services from third-parties, or use highly interactive presentation layer technologies. Organizations are also implementing more agile development methods and distributed teams. Yet, use of shareable, reusable test assets between these teams is limited or non-existent. Different tools are often employed, such as code-based unit testing tools for developers that are unusable by QA; and functional UI testing that does not translate errors into repeatable defects for developers to catch bugs earlier. Modern application quality can only be ensured when every layer of the application is tested and verified throughout the software lifecycle. This requires a much higher degree of test automation and collaboration among stakeholders. CA Application Test is not the automated testing solution your QA organization grew up thinking about. It truly automates the processes to be replicated during code creation and allows you to shift testing closer to development. It addresses these challenges and provides complete test coverage, with the ability to invoke and verify the behavior of each component across the end-to-end application. CA Application Test provides automated testability for all of the components in the technology stack. Out of the box, CA Application Test provides industry-leading standards support, with native integration to most J2EE servers, integration suites, and ESBs. Integration with Selenium Builder, a popular open source UI testing tool, enabling end-to-end testing from user interface all the way to backend systems. CA Application Test also builds portable, executable test cases that are easy to extend, modify and maintain, easy to chain into workflows with other tests or suites of tests, and simple to integrate with existing test repositories. Test cases are designed to be shared across different teams and environments – including mobile and cloud environments, with the ability to easily attach prior results and artifacts to extend them, and the ability to readily execute with different underlying data.
- CA Technologies can provide organizations with a comprehensive solution designed to address the issues around isolation and intelligence. CA Service Virtualization addresses the problem of providing intelligent stateful stubs through its ability to observe then simulate the behavior of dependent systems. The use of service virtualization can reduce or eliminate a large amount of manual effort and produces stubs which can be used in many lifecycle phases, including performance testing.
- This is a very small set of examples. You literally can virtualize any IT asset.
- This is a very interesting report CA commissioned Forrester Consulting to conduct a Total Economic Impact™ (TEI) study and examine the potential return on investment (ROI) enterprises may realize by deploying CA Service Virtualization. Forrester interviewed four organizations who had implemented this solution in their enterprise. Taken as a whole, this composite company reported: Early defect detection in QA, leading to $1 million in average annual savings Development and testing efficiencies equating to $306,000 per year in savings Testing environment infrastructure cost avoidance of $2,747,971 Highly recommend downloading and giving a ready. The first few pages summarize the findings. The rest of the report provides a really good summary of the key values and features of service virtualization.
- Avoided $300,000 in test hardware and software costs Cut integration time from three days to three hours Decreased software defects by 25 percent hours
- CA Technologies is ready to help your teams deliver high-quality applications faster than ever before. Using our integrated solutions and open framework, you can easily track, automate and manage all application releases—from planning and requirements to development, testing and deployment. CA Agile Requirements Designer is an end-to-end requirements gathering, test automation and test case design tool which drastically reduces manual testing effort and enables organizations to deliver quality software to market earlier and at less cost. CA Test Data Manager uniquely combines elements of data subsetting, masking and synthetic, on-demand data generation to enable testing teams to meet the agile needs of the organization. CA Application Test enables teams to start API, system and response testing prior to the development of UIs. CA Service Virtualization simulates systems across the SDLC, allowing developers, testers, integration, and performance teams to work in parallel for faster delivery and higher application quality and reliability. CA Release Automation is a proven, enterprise-ready solution that can help build an agile, resilient and scalable continuous delivery pipeline—from development to test to production.
- Thank you for taking the time to meet with us today. With that, I’d like to….. (take questions, turn the time back over to, etc)