The document discusses trends in QA testing. It covers topics like the current economic situation's impact on testing, results from industry roundtables on local testing trends, agile software development practices like test-driven development, cloud computing and software-as-a-service, open source testing tools, and virtual software appliances. The presentation provides information on these topics from the perspective of sharing insights and best practices.

1. QA Testing Trends
Your Text here Your Text here
Pini Cohen
EVP & Senior Analyst
Architecture & Infrastructure Strategies
pinicohenstki.blogspot.com
1
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

2. 2
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

3. 3
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

4. Agenda
The current economic situation and testing
STK round tables – word from the field
Agile software development
TDD – Test Driven
Cloud Computing and SAAS
Open Source
VSS – Virtual Software Appliance
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

5. Scenario: Adapting in Healthy Ways, Rather
Than Fixating
Adaptive organizations have a core foundation of values
and principles that keep them from chasing their tails
every time tactical winds blow
Cost
Risk and
Transformation
Quality
Speed
5
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

6. Testing Ratios
Pini Cohen’s work Copyright 2009©STKI
Source: computer economics
Do not remove source or attribution from any graphic or portion of graphic

7. Testing and Quality?
How low can we get?
Price reduction is hearting everybody
Your Text here Your Text here
7
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

8. Agenda
The current economic situation and testing
STK round tables – word from the field
Agile software development
TDD – Test Driven
Cloud Computing and SAAS
Open Source
VSS – Virtual Software Appliance
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

9. STKI Round Table
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

10. Local trends
• Who is responsible for the testing:
– The project manager
– The productiondata center manager
• “Critical security patch is available”. What do we do
now? Complete test? Partial test? Project manager
looks at the system? Non?!
• “To ISO or not to ISO?” this is the question
• Versions vs. Incremental changes?
Pini Cohen’s work Copyright 2009©STKI
10
Do not remove source or attribution from any graphic or portion of graphic

11. Local trends
• When to perform regression tests? End of project?
End of module? Meanwhile?!
• Change management : stopping “test server” caused
production application to stop!!
• Testing (and dev.) vs. Security department :
– Who control the process?
– Who is the responsible?
– Who pays (project? General security budget?)
• Security is up to 15% of development budget
(critical applications)
Pini Cohen’s work Copyright 2009©STKI
11
Do not remove source or attribution from any graphic or portion of graphic

12. Israeli Nearshore
Acknowledging the
Matrix Global
advantage & cost saving
(up to 50%) by outsourcing: Malam (Ma’alot); Ness
Your Text here Your Text here
(EDC); Aman (Tehila)
the transition from PS
Offshore: NTS
to outsourcing
12
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

13. QA Israeli Trends
Existing clients have broaden their scope
Service provides added value – HD employees
transition to QA on-demand (e.g. Calanit-Carmon)
Your Text here Your Text here
Israeli nearshore providers are used as offshore by
global clients due to standards of work & languish
(e.g. Matrix Global)
13
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

14. Agenda
The current economic situation and testing
STK round tables – word from the field
Agile software development
TDD – Test Driven
Cloud Computing and SAAS
Open Source
VSS – Virtual Software Appliance
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

15. New Generation of Knowledge
Workers
• Live in virtual worlds
• Expect immediate results
• Many open threads
• Deliver quickly, in small
increments
• Expect personalization
• Intolerant of disruption
In short: very agile!
http://www.solutionsiq.com/resources/SIQ-
AgileDevelopmentPlatform-Rudd-Young-
Agile2008.ppt
15
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

16. Agile Project Management -
Overview
12
Code
Analysis
Code
Test
Test
Implement
Analysis
9
6
3
12
3 6 9
Source: Cutter
Pini Cohen’s work Copyright 2009©STKI
16
Do not remove source or attribution from any graphic or portion of graphic

17. www.agilesparks.com.
 AgileSparks is an Israeli company whose core and only focus is
Agile. Led by a team of experts with vast experience.
 Helps organizations move to a higher level of Agility and
provides a wall-to-wall solution that includes training and on
the job consulting.
 The only company in Israel recognized by the International
Scrum Alliance and approved to certify Scrum Masters.
 Implemented Agile/Scrum in more than 100 companies in
Israel.
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

18. Agenda
The current economic situation and testing
STK round tables – word from the field
Agile software development
TDD – Test Driven
Cloud Computing and SAAS
Open Source
VSS – Virtual Software Appliance
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

19. Cost of Feedback – Test Driven DEV
Trends
Development
http://losangeles.pm.org/presentations/tdd/TheRoadToTestDrivenDevelopment.ppt
19
19
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

20. DEV
Test-Driven Development Trends
• Pick a Feature
• Write a Test for that Feature
• Run all Tests and see new Test Fail
• Write Code for Feature
• Run all Tests and see all Tests Pass
• Refactor
• Repeat
http://losangeles.pm.org/presentations/tdd/TheRoa
dToTestDrivenDevelopment.ppt
20
Copyright Oversee.net 2008
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

21. Agenda
The current economic situation and testing
STK round tables – word from the field
Agile software development
TDD – Test Driven
Cloud Computing and SAAS
Open Source
VSS – Virtual Software Appliance
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

22. Cloud Computing Modularity
Desktop as a service
Software as a service
(standard applications)
Platform as a service
(custom applications)
Infrastructure as a service
(compute, storage, network)
22
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

23. Amazon EC2
23
Source: http://aws.amazon.com/ec2/#pricing
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

24. HP Software-as-a-Service offerings
Customer service management
STRATEGY APPLICATIONS OPERATIONS
Quality Business Service Business Service IT Service
Management Management Automation Management
Operations Orchestration
Quality
Project & Portfolio
Business
Center
Management
Client
Availability
Center
Automation
Center Service
Center Manager
Performance
CIO Office Operations
Center
Center Release
Control
Data Center
SOA Network Automation
Application
Center Management Center
Security Center
Center
DDM & Universal CMDB
CTO Office SAP, Oracle, SOA, J2EE, .Net
The HP SaaS global web platform
Reporting Document library Security & audit Notification Data access
Offered by HP SaaS Integration supported
today 24
11 May 2009 Cohen’s work Copyright 2009©STKI
Pini
24
Do not remove source or attribution from any graphic or portion of graphic

25. HP SaaS global footprint
EMEA
28 business
North
process monitors
America
2 load farms Asia
43 business
process monitors
6 load farms
Africa
Americas
Australia/ Asia
13 business
process monitors
South
America
• Manages 100 million pieces of data Oceania
Each day
• Monitors 600,000 business processes every 15 minutes
HP SaaS
• Provides customers with an average of 90 alerts
for BTO:
25
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

26. Agenda
The current economic situation and testing
STK round tables – word from the field
Agile software development
TDD – Test Driven
Cloud Computing and SAAS
Open Source
VSS – Virtual Software Appliance
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

27. Why Companies Use Open Source
• Freedom / Flexibility
• Lowers barriers to entry / exit
• Can’t afford to build new applications from
scratch
• Tired of waiting on hold for support
• Speed up development
• Purchase only the functionality needed
• Total Cost of Ownership (TCO)
• ROI is shortened
Source: AnyOpen
Pini Cohen’s work Copyright 2009©STKI
27
Do not remove source or attribution from any graphic or portion of graphic

28. Solution - OSS quality
• Emerging Vendors Utilize OSS
Defects Per Thousands
– Netezza
lines of Code
• Data warehousing appliance
– Commodity hardware (servers, CPUs, storage)
0.00057
– PostgreSQL, Linux
• End user clients utilize OSS
– Retail – in-store appliances
– Travel – web sites, fee schedules,
reservations 0.00009
MySQL Commercial
Source: Reasoning Inc.
Be assured the next generation of
developers/entrepreneurs will build on OSS
Pini Cohen’s work Copyright 2009©STKI 28
Do not remove source or attribution from any graphic or portion of graphic

29. 29
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

30. General
STKI Madad Open
Source
•Lately we have received lots of Open
Source related inquiries – maturity, support,
reference, prices of:
•OpenOffice
•Tomcat
•Jboss
•MySQL
•Drupal
•Nagios
•Subversion
30
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

31. DEV
‘INDUS’ development stack Trends
• Completely Open Source
• Agile best practices
Server
Version Control Subversion
– Continuous Integration
– Test Driven Dev.
Continuous
CruiseControl
Integration
• Java build Best Practices
– IDE Neutral
– Ant Based
Workstation
Subversion Client TortoiseSVN / Subclipse
– Maven 2
CheckStyle
Coding Standards Tool Name Used For URL
Subversion Version Control Server http://subversion.tigris.org/
CruiseControl Continuous Integration http://cruisecontrol.sourceforge.n
Code Coverage EMMA TortoiseSVN Version Control Client http://tortoisesvn.tigris.org/
Subclipse Version Control Client (Eclipse Plugin) http://subclipse.tigris.org/
Checkstyle Java Coding Standards Checker http://checkstyle.sourceforge.net/
Unit Testing JUnit
EMMA Java Code Coverage http://emma.sourceforge.net/
JUnit Java Unit Testing http://www.junit.org/
Ant + Maven2
Build Scripting Ant Java Build Scripting http://ant.apache.org/
Maven Java Dependency Management http://maven.apache.org/
Eclipse Java IDE http://www.eclipse.org/
Eclipse / NetBeans
IDE NetBeans Java IDE http://www.netbeans.org/
JMeter Load Testing http://jakarta.apache.org/jmeter/
NetBeans Profiler Java Profiling http://profiler.netbeans.org/
NetBeans
Performance JMeter
Profiler
Validation
Profiling
Load Testing
Automated Source: www.bcic.org.in/notifications/BCIC-
Selenium BSPIN/Mr.%20Madhusudan%20Rao,%20Satyam.ppt
Functional Testing 31
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

32. Agenda
The current economic situation and testing
STK round tables – word from the field
Agile software development
TDD – Test Driven
Cloud Computing and SAAS
Open Source
VSS – Virtual Software Appliance
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic

33. Why software can be painful
• Assembly required!
• User has to acquire all of the required components of one of the “supported” stacks
• User has to install, configure and maintain everything
• Manually intensive process
• Error prone
• Difficult for solution provider to replicate and support
• Fault tolerance (HA/DR) not always there, implemented in inconsistent fashion (requiring
run books for each process), and/or an expensive add-on
Actual Solution
Database Software
Drivers
OS Patches
Operating System
http://marketopsrepo.vmware.com/usergroup/preso
/Virtual.Appliances.Overview.v3.ppt
Pini Cohen’s work Copyright 2009©STKI
33
Do not remove source or attribution from any graphic or portion of graphic

34. What is a virtual appliance?
• Pre-installed and
preconfigured application
packaged along with an OS
in a virtual machine
• Virtual appliances represent an
evolutionary step in the distribution
of software solutions
• Updates (application – OS –
other) is handballed by the
ISV!
http://marketopsrepo.vmware.com/usergroup/preso/Virtual.Applia
nces.Overview.v3.ppt STKI modifications
Pini Cohen’s work Copyright 2009©STKI
34
Do not remove source or attribution from any graphic or portion of graphic

35. Next Generation Laptops:
Virtualization “Built-in”
–
Will this lead to BYOC
Bring Your Own
Computer?
personal corporate
image
desktop
Hypervisor from Citrix/Intel
Intel Processors
Source: Citrix STKI modifications
Pini Cohen’s work Copyright 2009©STKI
35
Do not remove source or attribution from any graphic or portion of graphic

36. 36
Pini Cohen’s work Copyright 2009©STKI
Do not remove source or attribution from any graphic or portion of graphic