Præsentation fra IBM Smarter Business 2012

1. © 2012 IBM Corporation

2. IBM Rational Test Virtualization Solution v8.0

3. Agenda
• Understanding your Customer’s, pain points, challenges and
concerns
• IBM Rational Test Virtualization Solution
– Rational Test Workbench
– Rational Test Virtualization Server
– Rational Performance Test Server
• Summary
– Success Stories
A Smarter
quality
Requirements
management
solution
3
Last

4. Software Quality is a major problem across all industries
• Software is blamed for more major business
problems than any other man-made
product.
• Poor software quality has become one of the
most expensive topics in human history
– $150+ billion per year in U.S.
– $500+ billion per year worldwide.
• Projects cancelled due to poor quality are
15% more costly than successful projects of
the same size and type.
Source: Capers Jones, 2011
Based on 675 companies, 35 government/military groups, 13,500 projects, 50-75 new projects/month, 24 countries, 15 lawsuits
4

5. Cost, complexity and velocity make today’s quality paradigm
impractical
An estimated 60 - 80 percent of the cost of software development is in rework*
Increasing Increasing Balancing
Cost of Quality Development Complexity Quality and Speed
Public Cloud
Private Cloud
Traditional
Routing Web/
Service Collaboration Internet Content EJB Business Testing
Providers Partners
Third-party Shared
Archives Services
Testing costs Services Portals
Messaging
File Services
systems
Directory
Identity
Other costs Data Warehouse Mainframe
Enterprise
Service Bus
Heterogeneous Environments
Outsourcing labor is no longer Product and application Productivity is inhibited as
a sustainable model as global complexity and size test teams can no longer
wages are increasing are increasing keep up with agile
development
* Source:http://www.sei.cmu.edu/about/message/
Last

6. Past Solutions and Limitations
Huge Test Lab Costs Longer Cycle Time Higher Risk
Labor, hardware, Availability of test
Days/weeks wasted
and software costs to environments hinders
waiting on the availability
manage test labs and developers ability to test
of a test environment
environments properly
 Lots of under-utilized and costly
test lab resources
 Development and QA waste a
lot of time on unproductive
activities: installation,
configuration, trial/error, etc.
 A significant portion of the
testing effort is pushed late in
6

7. Agenda
• Understanding your Customer’s, pain points, challenges and
concerns
• IBM Rational Test Virtualization Solution
– Rational Test Workbench
– Rational Test Virtualization Server
– Rational Performance Test Server
• Summary
– Success Stories
A Smarter
quality
Requirements
management
solution
7
Last

8. What is Test Virtualization?
Public Cloud
Private Cloud
App Under Test
Routing App Under Test
Service Collaboration Content EJB Business
Providers Partners
Third-party Shared
Archives Services
Services Portals
& Model
& Model
Messaging
File Services
systems Databases Mainframe
Capture
Capture
Directory applications Third-party
Identity Services
Packaged apps, messaging services, etc.
Enterprise
Data Warehouse Mainframe Service Bus Virtual Services
Heterogeneous Environments
System dependencies are a key challenge in Test Virtualization enables to create “virtual
setting up test environments: services”:
Unavailable/inaccessible: Testing is constrained –Virtual Services simulate the behavior of an entire
due to production schedules, security restrictions, application or system during testing
contention between teams, or because they are still –Virtual Services can run on commodity hardware,
under development private cloud, public cloud
Costly 3rd party access fees: Developing or testing –Each developer, tester can easily have their own test
against Cloud-based or other shared services can environment
result in costly usage fees –Developer and testers continue to use their testing
Impractical hardware-based virtualization: tools (Manual, Web performance, UI test automation)
Systems are either too difficult (mainframes) or remote
(third-party services) to replicate via traditional
hardware-based virtualization approaches
8

9. IBM Rational Test Virtualization Solution
A smarter solution to better quality
• Rational Test Workbench is a desktop solution that
enables testers/developers to:
– Capture and model virtual services Developers &
– Testers
Test services and applications long before their user interfaces
becomes available and do integration testing (SOA, BPM) Rational Test Workbench
• Rational Test Virtualization Server is a server solution
that: Rational Performance Test Server
– Provides a central environment to virtualize heterogeneous
hardware, software and services to provide 24x7 testing
capabilities
– Reduces infrastructure costs of traditional testing
environments
– Virtual Services can be built from the interface definition of
the system for a wide variety of protocols, including HTTP,
web services, SOA, JMS, TIBCO, IBM WebSphere MQ, Oracle, App Under Test
etc.
• Rational Performance Test Server enables Rational Test
Workbench users to reuse test scripts to drive performance
testing
Databases Mainframe
Third-party
– Can be used in combination with Virtual Services applications
Services
– Probe for identification of system bottlenecks Packaged apps, messaging services, etc.
Rational Test Virtualization Server

10. T
h
•Light
e •Fresh
•New
M •Simple
o
…but still
d
unfortunately
e connected to 20+
r years of IT legacy!
n
A
p
p

11. Challenge: Constraints in the development and testing lifecycle
Physical Test Environment
Maintenance Constraints
Server/ Web Services
2hr. access window
Mainframe / MQ/CICS
System Under Test
Volume Constraints
Smart Device / SD-IO
Problem:
Pervasive constraints
on development and
testing limit Volume Constraints
productivity
Database / JDBC

12. Solution : IBM Rational Test Virtualization Solution
Test Virtualization listens to and captures the behavior and characteristics of back-end systems
Physical Test Environment
Maintenance Constraints
Listen / Capture
Server/ Web Services
2hr. access window
Mainframe / MQ/CICS
System Under Test Store
Volume Constraints
Capture
Smart Device / SD-IO
& Model
Web Services
Test Case
Repository
MQ/CICS
Volume Constraints
Smart
Devices Database / JDBC
JDBC
Virtual Environment

13. Solution : IBM Rational Test Virtualization Solution
Test Virtualization enables deployment of virtual services to multiple
environments
Model and Deploy Live / Virtual
System Under Test
Capture Capture Capture
& Model & Model & Model
Web Services Web Services Web Services
Test Case Repository
MQ/CICS MQ/CICS MQ/CICS
Smart Smart Smart
Devices Devices Devices
JDBC JDBC JDBC
AV - FTE AV - SIT AV - UAT

14. IBM Rational Test Virtualization Solution provides benefits across
the software delivery life cycle
Developer uses
virtual services to
unit test code on
Development and Test
their workstation
teams uses virtual services
– no elaborate
for early stage advanced
environment
testing
required
Define
Unit Integration System System Integration User Acceptance Operability
Operability
constrained
systems and Performance
services for
virtualization Later in the cycle, final pre-
The full system or production versions of
components of the system services are swapped in as
Virtual Service
Service Catalog can be performance tested they become available. Final
early in the cycle. Virtual testing is done against real
services can be used when services
components are not
available

15. IBM Rational Test Virtualization Solution is a key enabler for
Continuous Integration Testing
Test Virtualization is an enabler for
continuous Integration Testing Actual Service/App
Virtual Service/App
Services, applications, systems are
introduced into the continuous integration
cycle in a prioritized, controlled fashion.
Incremental Integration Testing

16. IBM Rational Test Virtualization Solution streamlines continuous
integration and testing
• Avoid time spent installing and configuring software just to discover basic
build issues
• Smoke tests can be integrated as part of the continuous integration process
through deployment automation and test virtualization
• Smoke test results are made available to the entire team to shorten
resolution Cloud Environment
CRM
Order Mgr
App Server
Virtual Lab VM
Manager Catalog
Virtual Machines
Build ••Smoke Tests
Smoke Tests
••Sandboxes
Sandboxes
••Self-provisionning
Self-provisionning
Assets Product
Increment

17. Performance Testing with IBM Rational Test Virtualization Solution
1700 New
Configure & Execute Orders Type Virtualize
Control A per second
5 Cancelled 50 Order
Orders per Edits per
second second
1 Heartbeat
per second
Analyse
750 New
Orders Type B
per second
17

18. Implementing Test Virtualization provides the following benefits
Test Virtualization enables:
 Early testing in the product-life-cycle
 Additional component and service layer testing
 Ability to run end-to-end test scenarios
 Identify and fix bugs earlier in the product life cycle.
 Shortened release cycles, quicker time to market
Unit Integration System Systems User Acceptance Operability
Test Test Test Integration Test Test (UAT) Test
Back-end Systems
Traditional SDLC DB System of
SaaS Mainframe
SDLC with Service Virtualization
Record
Unit Integration System Systems User Acceptance Operability
Test Test Test Integration Test Test (UAT) Test
Application Virtualization FM FM FM FM
Virtual Services
Back-end Systems
SR FM
DB System of
SaaS Mainframe
Record

19. IBM Rational Test Virtualization Solution
A Smarter Solution for Better Quality
• Test lab infrastructure costs can be reduced by up to 90%
Significantly Lesser • Labor involved in setting up test environments can be reduced by 80%
+
Test Lab costs
• Reduced or eliminated the cost of invoking 3rd party systems for non-
production use, fee-based web services
• Test environments can be configured in minutes vs weeks
• More testers can be focused on testing, rather than configuring test
environments
Reduced Cycle Time • More regression testing can be done independently from the User
Interface, during development
• Developers have the means to test software earlier at the Service/API
level
Lower Risk • Large teams working on different parts of an application or system can
effectively do parallel development by virtualizing different parts of the
system
19 19

20. IBM Rational Integrated Quality Management Solution
Application Lifecycle Management
Test automation
Manage test Rational Test Workbench Trace test execution
automation to defects
Test Infrastructure Management
Rational Test Virtualization Server
Collaborative
Quality Management Trace test execution to defects
Rational Quality Manager Development
Rational Team Concert
IBM Rational Solution
for Collaborative Lifecycle Management
Requirements
Management
Rational Reqmts Composer
Quality Professional Analyst Developer
Project
Deployment Engineer
Manager
Architect
IBM Services

21. Supported Environments and Technologies
Messaging Protocols SOA, ESB, Others Message Formats
• ActiveMQ • CentraSite • .Net Objects
• Email (SMTP, IMAP) • Oracle Fusion • Bytes
• Files • SCA Domain • COBOL Copybook
• FTP/S • Software AG IS, BPMS • ebXML
• HTTP/S • Sonic ESB • EDI
JMS (JBOSS et al) • TIBCO ActiveMatrix • Fixed Width
IBM WebSphere MQ • UDDI • HL7
• JBoss MQ • Web Services • IATA
• SAP IDoc, BAPI, RFC & XI/PI • WebSphere RR • Java Objects
• Software AG’s IB & IS • WSDL • MIME
• Solace • OAG
• Sonic MQ • BPM • SOAP
• TCP • Databases • Software AG Broker Docs
TIBCO Rendezvous, Smart • Log Files • SWIFT
Sockets & EMS • TIBCO ActiveEnterprise
• Custom • XML (DTD, XSD, WSDL)
• Custom
Note : Custom protocol support can be developed

22. IBM Rational Test Virtualization Solution Workflow
• Using Rational Integration Tester (part
of Rational Test Workbench)
– Define system architecture in “architecture
school”
– Define protocols
• Import specification, e.g. WSDL
for web services
• Record conversations
– Define stubs and data
• Data captured during recording or
supplied in a file, database
– Publish stubs to Rational Test Virtualization
Server (RTVS)
• Dynamically configure message routing
from RTVS web console
• Test against virtual system from tool of
choice
Note : Custom protocol support can be developed
22

23. IBM Rational Test Virtualization Solution: How it all fits together…

24. Agenda
• Understanding your Customer’s, pain points, challenges and
concerns
• IBM Rational Test Virtualization Solution
– Rational Test Workbench
– Rational Test Virtualization Server
– Rational Performance Test Server
• Summary
– Success Stories
A Smarter
quality
Requirements
management
solution
24
Last

25. IBM Rational Test Virtualization Solution has proven measureable results
and business value
Major telecom carrier A leading global financial services
Multiple test releases required additional firm with assets of over $2 trillion
test resources, increasing testing costs Many disparate legacy format to be
 Solution: Virtualized services and created migrated to next gen payments system
reusable test cases across multiple  Solution: Virtualized third-party systems
environments otherwise unavailable for testing
 Results: Reduced testing time by 50%,  Results: Reduced manual testing from 10 days
saving $800K over 3 years to 10 minutes, saving over $7 million to date
Major U.S. insurer Global manufacturer acquires
Recognized manual efforts insufficient competitor
for complex SOA and web services Migrate off rented infrastructure onto
 Solution: Agile middleware solution created company’s standardized middleware platform
to match the legacy systems’ functionality  Solution: Virtualized critical, unavailable systems
 Results: Reduced testing by 95% to 2 hours; during migration
reduced ‘rate filing’ validation by 94%  Results: Fully integrated in 6 months – 2 months
to 320 hours ahead of schedule; saved significant rental costs
and dependencies on third-party systems

26. www.ibm.com/software/rational
© Copyright IBM Corporation 2011. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind,
express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have
the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM
software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities
referenced in these materials may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature
availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines
Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others.
26
Last

27. IBM Rational Test Virtualization Solution
BACKUP
27
Last

28. Better software quality requires a shift in focus
Evolving from Testing to Quality Management
Optimizati
Preventio on
Ent.Quality
Ent. Quality
n Management
Management
Proactice Integration test
Integration test Gapanalysis
Gap analysis
Testability,
Testability, Risk
Risk
Repeatab maintainability assessments
Collaborative
Collaborative maintainability assessments
le quality assurance
quality assurance Definedpolicies
Defined policies Process
Process
Chaotic Testplanning
Test planning Broaderscope
Broader scope and quality gates
and quality gates improvements
improvements
Testautomation
Test automation Security
Security Automated
Automated
Catch& patch
Catch & patch Compliance
Compliance regression
regression
Ad-hoctesting
Ad-hoc testing Accessibility
Accessibility
0 1 2 3 4

29. Application Virtualization Services are
comprised of six iterative phases Deploy
Discover Configure Virtualize Model Execute
 Identify testing  Install and  Execute  Model behavior  Deploy models  Execute
pain-points configure AV specified test of transactions to virtual specified test
 Understand IT software cases  Model negative environment cases
technologies  Configure  Listen and test cases  Configure SUT  Capture test
 Review Use transactions / capture  Model “perfect connections results
cases Protocols transactions storm” test  Capture and
 Initiate ROI  Configure  Build negative cases measure results
Analysis Services test case  Apply  Recommend AV
 Understand  Build additional  Refine ROI production next steps
testing AV test cases metrics to
methodology virtual models
 Use Cases  Configured  AV Images  Modeled  Deployed  Test results
 Test Cases testing  Virtual virtual services virtual services  Virtual
 Pain Points environment Transactions (replica of (Ready to test) performance
  Configured  AV Arch docs prod) test results
High Level
ROI Virtual  ROI  Negative test  Confirmed
Environment cases ROI
 Test cases
* Typical timeframe: Actual timeframe will depend on client’s specific needs

30. Rational Test Workbench – Performance Tester
Comprehensive test planning, authoring, and analysis to identify
and manage the risk of application performance failures
1. Capture and track Business
SLAs in your test plans
Rational Performance Tester
2. Create realistic user
System Under Test
workloads that exercise the
key business transactions
3. Automatically deploy the
environment and schedule Test
Authoring Web App Server dB Server
execution of your workload and Control
Server
4. Identify the root cause of Load Generators
performance problems
5. Communicate results and
areas of non-compliance to
the stakeholders
30

31. What type of environments are supported?
Note: This list is representative and not intended to reflect the full set of supported domains and frameworks
31

32. Today’s High Level QM Segment Architecture
Optimize software quality with a centralized test management hub and integrated full
lifecycle support across any platform and type of testing
IBM Collaborative Application Lifecycle Management
Rational Quality Manager
Products Services
Additional Offerings:
IBM, Third-party, Business Partner, Homegrown, …
32
Last

33. How does RTVS/RTW work?
A component of A component of
RTW RTVS
Rational
Integration Tester Rational Test
Control Panel
Agent Recorder
Server
JDBC HTTP
Provider Proxy
System Under Probe
Test Probe Probe

34. C
a
n
Presentation Tier
d
i
d SOA/BPM B2B
a
t Database ESB Mainframe
e
• Typical multi-tiered environment • Virtualize selected services or entire
• Problems with provisioning/access application
s • Problems with data consistency • Different virtualization models available
• Testers, regardless of test methodology, are
y unaware of virtualisation
s
t 34

35. Payload Data
Payload
35

36. Payload Visualization
Payload
Formatter
36

37. Payload Schema
Payload SOAP XML
SWIFT COBOL Copybook
Formatter
DTD XSD
Schema WSDL HL7
EDI IATA
Text MIME
Byte Array Java Objects
OAG SAP BAP/RFC
FIX .Net Objects
TIBCO ActiveEnterprise
webMethods IB and IS Documents
Custom…
37
37

38. Payload Data
Payload
Formatter
Schema
Test Data
38

39. Payload Transport
Payload
Formatter JMS webMethods
Schema
HTTP/S FTP
NDM Oracle/BEA
Test Data
JDBC Sonic MQ
Transport TCP/UDP PL/SQL
Flat Files Shell commands
TIBCO EMS TIBCO iProcess
TIBCO Rendezvous
IBM WebSphere MQ
Custom Transports…
39

40. N
e
w• Rational Test Workbench GH Tester RIT
– Combined desktop offerings priced on
1
traditional authorized and floating
P metrics
Rational Test Workbench
RIT RFT RPT
r – Green Hat Tester re-branded as Rational
Integration Tester (RIT), not available
o stand alone
2
d – Offering includes RIT, RFT, RPT Rational Performance Test Server
u• Rational Performance Test Server
GH Performance RPT
c – Combines GH Performance and RPT load
capability for application and service
t level performance testing 3 Rational Test Virtualization
S – Priced on a PVU metric
Server
GH VIE RPTS
e• Rational Test Virtualization Server
t – Service virtualization