SlideShare una empresa de Scribd logo
1 de 44
Welcome to the 2013

This webinar is presented by Kees Blokland and he will discuss:

‘Going Cloudy? How to test SaaS?’

Join us on Twitter! @esconfs #esconfs
www.eurostarconferences.com
Going Cloudy?
How to test SaaS?
Kees Blokland
Polteq Test Services BV
The Netherlands
ISBN 978-1-937538-38-5
3
searching, recording, accounting, paying, writing, reviewing,
tracking, calculating, developing, listening, analyzing,
transmitting, learning, controlling, purchasing, testing,
alarming, changing, updating, deleting, accessing, rejecting,
correcting, studying, booking, receiving, tracing, protecting,
deciding, managing, teaching, facilitating, identifying,
copying, removing, demonstrating, checking, showing,
selecting, subscribing, unsubscribing, sharing, mailing,
communicating, reading, playing, working, meeting,
gambling, shopping, storing, cross checking, retrieving,
configuring, sketching, saving, accelerating, enhancing,
creating, growing, checking in, checking out, finding out,
reaching, talking, designing, making, verifying, measuring
Develop and Test

Operate and Manage
6

Email
Surf
Transfer

Store
Develop and Test

redundancy, proliferation

limitations

Email
Surf
Transfer

80% unused

storage claim
Operate and Manage
7

environmentally unfriendly
Store
Develop and Test

Email
Surf
Transfer

SOA

internet technology

virtualization

standard software
Operate and Manage
8

bandwidth
Store
searching, recording, accounting, paying, writing,
reviewing, tracking, calculating, developing, listening,
Develop and Test
Email
Surf
analyzing, transmitting, learning, controlling,
Transfer
purchasing, testing, alarming, changing, updating,
deleting, accessing, rejecting, correcting, studying,
booking, receiving, tracing, protecting, deciding,
managing, teaching, facilitating, identifying, copying,
removing, demonstrating, checking, showing,
selecting, subscribing, unsubscribing, sharing,
Operate communicating, reading, playing, working,
Store
mailing, and Manage
meeting, gambling, shopping, storing, cross
9
Essential characteristics
 On-demand service

 Broad network access
 Resource pooling

 Rapid elasticity

Deployment models
– private cloud
– community cloud
– public cloud
– hybrid cloud
Service Models

 Measured service

Software as a Service
Platform as a Service
Infrastructure as a Service

US: National Institute of Standards and Technology
http://www.nist.gov
Standards
Cyber crime

Continuity

Privacy

Legislation

Multi platform

Impact organisation

143
Performance risks

Standards

Security risks Cyber crime
Availability and continuity Continuïty
risks
Functionality risks Privacy
Maintainability risks
Multi platform

Legislation and regulations
risks
Suppliers and Impact organisation
outsourcing
risks

Legislation
Performance risks

Security risks

YOUR
Operational Profile

Availability and continuity
risks
Functionality risks

Other customers

Maintainability risks
Legislation and regulations
risks
14

Suppliers and outsourcing
risks

YOUR
Operational Profile
PLUS
Performance risks

Security risks

The idea:
“it’s safe”

Availability and continuity
risks
Functionality risks

Everything over the web

Maintainability risks
Legislation and regulations
risks
15

Suppliers and outsourcing
risks

Home ground for
hackers
Performance risks

Security risks

No free choice of
device.

Availability and continuity
risks
Functionality risks

Bring Your Own Device

Maintainability risks
Legislation and regulations
risks
16

Suppliers and outsourcing
risks

No control.
Performance risks

Security risks

Planned and
controlled

Availability and continuity
risks
Functionality risks

Updates, patches, fixes, …

Maintainability risks
Legislation and regulations
risks
17

Suppliers and outsourcing
risks

Do I have a
choice?
Performance risks

Security risks

In house.

Availability and continuity
risks
Functionality risks

Where is my data?
And is that OK?

Maintainability risks
Legislation and regulations
risks
18

Suppliers and outsourcing
risks

Somewhere…
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
19

Suppliers and outsourcing
risks
Testing?
Interview
Check
Trial

Proof of concept

Review

20
Testing!
Interview
Check
Trial

Proof of concept

Proef
Proof ofInterview
concept
Testen
Intake
Review

21
Testing during selection
Performance testing
Security testing

Testing for manageability
Availability and continuity
testing
Proef
Proof ofInterview
concept
Testen
Intake

Functional testing
Migration testing
Testing caused by
legislation and regulations

22

Testing in production
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
23

Suppliers and outsourcing
risks

Testing during selection
Performance testing
Security testing

Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations

Testing in production
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
24

Suppliers and outsourcing
risks

Testing during selection
Performance testing
Security testing

Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations

Testing in production
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
25

Suppliers and outsourcing
risks

Testing during selection
Performance testing
Security testing

Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations

Testing in production
Performance risks

Security risks
Availability and continuity
risks

Testing during selection
Performance testing
Security testing

Architecture for manageability
Testing

Functionality risks

Availability and continuity
testing

From “individual” riskstesting
Functional
Maintainability risks
to
Migration testing
Legislation and regulations
“individual” test measures by
Testing caused
risks
26

Suppliers and outsourcing
risks

legislation and regulations

Testing in production
Testing during selection

Selection

Performance testing
Security testing

Testing for manageability

Implementation

Availability and continuity
testing
Functional testing
Migration testing

Production
27

Testing caused by
legislation and regulations

Testing in production
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
28

Suppliers and outsourcing
risks

Testing during selection
Performance testing
Security testing

Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations

Testing in production
Testing during selection
Performance testing

Selection Criteria

Security testing

Testing for manageability
Availability and continuity
testing

Proof of Concept

Functional testing
Migration testing
Testing caused by
legislation and regulations

29

Testing in production
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
30

Suppliers and outsourcing
risks

Testing during selection
Performance testing
Security testing

Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations

Testing in production
Testing during selection
Performance testing

Known measures
tuned and tweaked

Security testing

Testing for manageability
Availability and continuity
testing
Functional testing

New measures developed

Migration testing
Testing caused by
legislation and regulations

31

Testing in production
Testing during selection
YOUR
Operational Profile

Performance testing
Security testing

Testing for manageability

Load Testing

Availability and continuity
testing
Functional testing

YOUR
Operational Profile
PLUS
ACTUAL MOMENT
32

Migration testing
Testing caused by
legislation and regulations

Testing in production
Testing during selection
Performance testing
Load and stress.
Security testing

Testing for manageability

Elasticity

Availability and continuity
testing
Functional testing
Migration testing

Load and elasticity.
33

Testing caused by
legislation and regulations

Testing in production
load test – ‘up’

load test – ‘down’

101
100

boundary values

99

load

path test
extend?

no

yes
200
charged
34

100
charged

boundary values
‘up’
tc 1: use=99, pay 100
tc 2: use=100, pay 100
tc 3: use=101, pay 200
‘down’
tc1: use=101, pay 200
tc2: use=100, pay 100
tc3: use=99, pay 100
Testing during selection
Multiplatform
testing.

Performance testing
Security testing

Testing for manageability

Any device – any platform

Availability and continuity
testing
Functional testing
Migration testing

Multiplatform
testing.
35

Testing caused by
legislation and regulations

Testing in production
3997 distinct Android devices

http://opensignal.com/reports/fragmentation.php
36
Internet Explorer 7

Windows XP

Internet Explorer 8

Windows Vista

Firefox 3.6
Windows 7

Firefox 4
Browsers

Windows 2003 Server

Safari 4
Safari 5

Windows 8

Chrome11

Windows CE

Opera11
Linux

Operating systems

SUN
Computer

Unix
Mac OS Lion

Mac OS Snow Leopard

PC

Macintosh
iPhone ...

Multi-platform testing

iOS

Samsung …
Mobile phones

NOKIA …

Android
ASUS ...

Windows Mobile
Tablet
Devices
37

Blackberry …
MOTOROLA …
Testing during selection
Performance testing
Incidental testing.
Security testing

Legislation + Regulations
=
Test basis

Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing

Compliancy testing.
38

Testing caused by
legislation and regulations

Testing in production
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
39

Suppliers and outsourcing
risks

Testing during selection
Performance testing
Security testing

Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations

Testing in production
Testing during selection

Continuous
End-to-End Test

Performance testing
Security testing

Testing for manageability
Availability and continuity
testing

Functionals
and
non-functionals
40

Functional testing
Migration testing
Testing caused by
legislation and regulations

Testing in production
Standards
Cyber crime

Check

Continuity

Interview
Privacy

Legislation

Proof of concept

Trial
Multi platform

Impact organisation

Intake
Performance risks

Security risks
Availability and continuity
risks

Testing during selection
Performance testing
Security testing

Architecture for manageability
Testing starts early: in selection
Testing

Functionality risks

Availability and continuity
testing

From “individual”widened
Scope of testing Functional testing
is risks
Maintainability risks
to Migration testing
Legislation and regulations
“individual” test measuresby
Testing continues in production
Testing caused
risks
42

Suppliers and outsourcing
risks

legislation and regulations

Testing in production
ISBN 978-1-937538-38-5
43
Thanks for listening!

Go to www.eurostarconferences.com for more information
@esconfs
#esconfs

www.eurostarconferences.com

Más contenido relacionado

Similar a EuroStar Webinar Testing Cloud Services Kees Blokland

Test Management for Cloud-based Applications
Test Management for Cloud-based ApplicationsTest Management for Cloud-based Applications
Test Management for Cloud-based ApplicationsTechWell
 
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin PolNon-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin PolKees Blokland
 
Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...
Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...
Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...TEST Huddle
 
Digital transformation testing.
Digital transformation testing. Digital transformation testing.
Digital transformation testing. Deepak Daniel
 
Delight Your Customers with Four Eyes of Quality: Agile Quality Improvement S...
Delight Your Customers with Four Eyes of Quality: Agile Quality Improvement S...Delight Your Customers with Four Eyes of Quality: Agile Quality Improvement S...
Delight Your Customers with Four Eyes of Quality: Agile Quality Improvement S...Kaali Dass PMP, PhD.
 
How Enterprises Are Modernizing Their Security, Risk Management, & Compliance...
How Enterprises Are Modernizing Their Security, Risk Management, & Compliance...How Enterprises Are Modernizing Their Security, Risk Management, & Compliance...
How Enterprises Are Modernizing Their Security, Risk Management, & Compliance...Amazon Web Services
 
Continuous Delivery for people who do not write code - Matthew Skelton - Conflux
Continuous Delivery for people who do not write code - Matthew Skelton - ConfluxContinuous Delivery for people who do not write code - Matthew Skelton - Conflux
Continuous Delivery for people who do not write code - Matthew Skelton - ConfluxMatthew Skelton
 
CRS Company Overview -Feb 6 2017
CRS Company Overview -Feb 6 2017CRS Company Overview -Feb 6 2017
CRS Company Overview -Feb 6 2017Joseph John
 
Webcast Presentation: Accelerate Continuous Delivery with Development Testing...
Webcast Presentation: Accelerate Continuous Delivery with Development Testing...Webcast Presentation: Accelerate Continuous Delivery with Development Testing...
Webcast Presentation: Accelerate Continuous Delivery with Development Testing...GRUC
 
Emerging Trends in Information Privacy and Security
Emerging Trends in Information Privacy and SecurityEmerging Trends in Information Privacy and Security
Emerging Trends in Information Privacy and SecurityJessica Santamaria
 
Emerging Trends in Information Privacy and Security
Emerging Trends in Information Privacy and SecurityEmerging Trends in Information Privacy and Security
Emerging Trends in Information Privacy and SecurityJessica Santamaria
 
Enterprise under attack dealing with security threats and compliance
Enterprise under attack dealing with security threats and complianceEnterprise under attack dealing with security threats and compliance
Enterprise under attack dealing with security threats and complianceSPAN Infotech (India) Pvt Ltd
 
Testing cloud services - EuroSTAR
Testing cloud services - EuroSTARTesting cloud services - EuroSTAR
Testing cloud services - EuroSTARJeroen Mengerink
 
Quality by Design Course Preview
Quality by Design Course PreviewQuality by Design Course Preview
Quality by Design Course PreviewInvensis Learning
 
Third Party Risk Management
Third Party Risk ManagementThird Party Risk Management
Third Party Risk ManagementEC-Council
 
Application Security Review 5 Dec 09 Final
Application Security Review 5 Dec 09 FinalApplication Security Review 5 Dec 09 Final
Application Security Review 5 Dec 09 FinalManoj Agarwal
 

Similar a EuroStar Webinar Testing Cloud Services Kees Blokland (20)

Test Management for Cloud-based Applications
Test Management for Cloud-based ApplicationsTest Management for Cloud-based Applications
Test Management for Cloud-based Applications
 
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin PolNon-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
 
Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...
Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...
Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...
 
Delivering Secure Projects
Delivering Secure ProjectsDelivering Secure Projects
Delivering Secure Projects
 
Digital transformation testing.
Digital transformation testing. Digital transformation testing.
Digital transformation testing.
 
Delight Your Customers with Four Eyes of Quality: Agile Quality Improvement S...
Delight Your Customers with Four Eyes of Quality: Agile Quality Improvement S...Delight Your Customers with Four Eyes of Quality: Agile Quality Improvement S...
Delight Your Customers with Four Eyes of Quality: Agile Quality Improvement S...
 
How Enterprises Are Modernizing Their Security, Risk Management, & Compliance...
How Enterprises Are Modernizing Their Security, Risk Management, & Compliance...How Enterprises Are Modernizing Their Security, Risk Management, & Compliance...
How Enterprises Are Modernizing Their Security, Risk Management, & Compliance...
 
Continuous Delivery for people who do not write code - Matthew Skelton - Conflux
Continuous Delivery for people who do not write code - Matthew Skelton - ConfluxContinuous Delivery for people who do not write code - Matthew Skelton - Conflux
Continuous Delivery for people who do not write code - Matthew Skelton - Conflux
 
CRS Company Overview -Feb 6 2017
CRS Company Overview -Feb 6 2017CRS Company Overview -Feb 6 2017
CRS Company Overview -Feb 6 2017
 
Webcast Presentation: Accelerate Continuous Delivery with Development Testing...
Webcast Presentation: Accelerate Continuous Delivery with Development Testing...Webcast Presentation: Accelerate Continuous Delivery with Development Testing...
Webcast Presentation: Accelerate Continuous Delivery with Development Testing...
 
Emerging Trends in Information Privacy and Security
Emerging Trends in Information Privacy and SecurityEmerging Trends in Information Privacy and Security
Emerging Trends in Information Privacy and Security
 
Emerging Trends in Information Privacy and Security
Emerging Trends in Information Privacy and SecurityEmerging Trends in Information Privacy and Security
Emerging Trends in Information Privacy and Security
 
Enterprise under attack dealing with security threats and compliance
Enterprise under attack dealing with security threats and complianceEnterprise under attack dealing with security threats and compliance
Enterprise under attack dealing with security threats and compliance
 
Privacy Engineering
Privacy EngineeringPrivacy Engineering
Privacy Engineering
 
Testing cloud services - EuroSTAR
Testing cloud services - EuroSTARTesting cloud services - EuroSTAR
Testing cloud services - EuroSTAR
 
Quality by Design Course Preview
Quality by Design Course PreviewQuality by Design Course Preview
Quality by Design Course Preview
 
Matrix consultancy services
Matrix consultancy servicesMatrix consultancy services
Matrix consultancy services
 
Third Party Risk Management
Third Party Risk ManagementThird Party Risk Management
Third Party Risk Management
 
[Paul Holland] Trends in Software Testing
[Paul Holland] Trends in Software Testing[Paul Holland] Trends in Software Testing
[Paul Holland] Trends in Software Testing
 
Application Security Review 5 Dec 09 Final
Application Security Review 5 Dec 09 FinalApplication Security Review 5 Dec 09 Final
Application Security Review 5 Dec 09 Final
 

Más de Kees Blokland

Introductie boek Testing Cloud Services.
Introductie boek Testing Cloud Services.Introductie boek Testing Cloud Services.
Introductie boek Testing Cloud Services.Kees Blokland
 
Introducing testing cloud services - Transformation to SaaS
Introducing testing cloud services - Transformation to SaaSIntroducing testing cloud services - Transformation to SaaS
Introducing testing cloud services - Transformation to SaaSKees Blokland
 
Product risico analyse in de praktijk (2010) - Kees Blokland
Product risico analyse in de praktijk (2010) - Kees BloklandProduct risico analyse in de praktijk (2010) - Kees Blokland
Product risico analyse in de praktijk (2010) - Kees BloklandKees Blokland
 
Monitoring en control op uitbestede testwerkzaamheden door Kees Blokland.
Monitoring en control op uitbestede testwerkzaamheden door Kees Blokland.Monitoring en control op uitbestede testwerkzaamheden door Kees Blokland.
Monitoring en control op uitbestede testwerkzaamheden door Kees Blokland.Kees Blokland
 
Mistakes Outsourcing Customers Make by Kees Blokland
Mistakes Outsourcing Customers Make by Kees BloklandMistakes Outsourcing Customers Make by Kees Blokland
Mistakes Outsourcing Customers Make by Kees BloklandKees Blokland
 
Metrics for (outsourced) test activities by Kees Blokland
Metrics for (outsourced) test activities by Kees BloklandMetrics for (outsourced) test activities by Kees Blokland
Metrics for (outsourced) test activities by Kees BloklandKees Blokland
 
Useful stepping stones in growth towards Agile testing by Kees Blokland
Useful stepping stones in growth towards Agile testing by Kees BloklandUseful stepping stones in growth towards Agile testing by Kees Blokland
Useful stepping stones in growth towards Agile testing by Kees BloklandKees Blokland
 
Risk Based Testing in Agile context - Kees Blokland
Risk Based Testing in Agile context - Kees BloklandRisk Based Testing in Agile context - Kees Blokland
Risk Based Testing in Agile context - Kees BloklandKees Blokland
 
Useful stepping stones in growth towards Agile testing door Kees Blokland.
Useful stepping stones in growth towards Agile testing door Kees Blokland.Useful stepping stones in growth towards Agile testing door Kees Blokland.
Useful stepping stones in growth towards Agile testing door Kees Blokland.Kees Blokland
 

Más de Kees Blokland (9)

Introductie boek Testing Cloud Services.
Introductie boek Testing Cloud Services.Introductie boek Testing Cloud Services.
Introductie boek Testing Cloud Services.
 
Introducing testing cloud services - Transformation to SaaS
Introducing testing cloud services - Transformation to SaaSIntroducing testing cloud services - Transformation to SaaS
Introducing testing cloud services - Transformation to SaaS
 
Product risico analyse in de praktijk (2010) - Kees Blokland
Product risico analyse in de praktijk (2010) - Kees BloklandProduct risico analyse in de praktijk (2010) - Kees Blokland
Product risico analyse in de praktijk (2010) - Kees Blokland
 
Monitoring en control op uitbestede testwerkzaamheden door Kees Blokland.
Monitoring en control op uitbestede testwerkzaamheden door Kees Blokland.Monitoring en control op uitbestede testwerkzaamheden door Kees Blokland.
Monitoring en control op uitbestede testwerkzaamheden door Kees Blokland.
 
Mistakes Outsourcing Customers Make by Kees Blokland
Mistakes Outsourcing Customers Make by Kees BloklandMistakes Outsourcing Customers Make by Kees Blokland
Mistakes Outsourcing Customers Make by Kees Blokland
 
Metrics for (outsourced) test activities by Kees Blokland
Metrics for (outsourced) test activities by Kees BloklandMetrics for (outsourced) test activities by Kees Blokland
Metrics for (outsourced) test activities by Kees Blokland
 
Useful stepping stones in growth towards Agile testing by Kees Blokland
Useful stepping stones in growth towards Agile testing by Kees BloklandUseful stepping stones in growth towards Agile testing by Kees Blokland
Useful stepping stones in growth towards Agile testing by Kees Blokland
 
Risk Based Testing in Agile context - Kees Blokland
Risk Based Testing in Agile context - Kees BloklandRisk Based Testing in Agile context - Kees Blokland
Risk Based Testing in Agile context - Kees Blokland
 
Useful stepping stones in growth towards Agile testing door Kees Blokland.
Useful stepping stones in growth towards Agile testing door Kees Blokland.Useful stepping stones in growth towards Agile testing door Kees Blokland.
Useful stepping stones in growth towards Agile testing door Kees Blokland.
 

Último

AI mind or machine power point presentation
AI mind or machine power point presentationAI mind or machine power point presentation
AI mind or machine power point presentationyogeshlabana357357
 
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdfMuhammad Subhan
 
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...ScyllaDB
 
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfFIDO Alliance
 
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...FIDO Alliance
 
WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024Lorenzo Miniero
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Patrick Viafore
 
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Paige Cruz
 
Portal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russePortal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russe中 央社
 
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...Skynet Technologies
 
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdfHow Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdfFIDO Alliance
 
Introduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxIntroduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxFIDO Alliance
 
Working together SRE & Platform Engineering
Working together SRE & Platform EngineeringWorking together SRE & Platform Engineering
Working together SRE & Platform EngineeringMarcus Vechiato
 
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfThe Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfFIDO Alliance
 
Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024Hiroshi SHIBATA
 
ERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctBrainSell Technologies
 
JavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuideJavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuidePixlogix Infotech
 
Using IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandUsing IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandIES VE
 
Design Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxDesign Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxFIDO Alliance
 

Último (20)

AI mind or machine power point presentation
AI mind or machine power point presentationAI mind or machine power point presentation
AI mind or machine power point presentation
 
Overview of Hyperledger Foundation
Overview of Hyperledger FoundationOverview of Hyperledger Foundation
Overview of Hyperledger Foundation
 
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
 
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
 
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
 
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
 
WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024
 
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
 
Portal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russePortal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russe
 
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
 
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdfHow Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
 
Introduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxIntroduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptx
 
Working together SRE & Platform Engineering
Working together SRE & Platform EngineeringWorking together SRE & Platform Engineering
Working together SRE & Platform Engineering
 
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfThe Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
 
Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024
 
ERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage Intacct
 
JavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuideJavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate Guide
 
Using IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandUsing IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & Ireland
 
Design Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxDesign Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptx
 

EuroStar Webinar Testing Cloud Services Kees Blokland

  • 1. Welcome to the 2013 This webinar is presented by Kees Blokland and he will discuss: ‘Going Cloudy? How to test SaaS?’ Join us on Twitter! @esconfs #esconfs www.eurostarconferences.com
  • 2. Going Cloudy? How to test SaaS? Kees Blokland Polteq Test Services BV The Netherlands
  • 4.
  • 5. searching, recording, accounting, paying, writing, reviewing, tracking, calculating, developing, listening, analyzing, transmitting, learning, controlling, purchasing, testing, alarming, changing, updating, deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, mailing, communicating, reading, playing, working, meeting, gambling, shopping, storing, cross checking, retrieving, configuring, sketching, saving, accelerating, enhancing, creating, growing, checking in, checking out, finding out, reaching, talking, designing, making, verifying, measuring
  • 6. Develop and Test Operate and Manage 6 Email Surf Transfer Store
  • 7. Develop and Test redundancy, proliferation limitations Email Surf Transfer 80% unused storage claim Operate and Manage 7 environmentally unfriendly Store
  • 8. Develop and Test Email Surf Transfer SOA internet technology virtualization standard software Operate and Manage 8 bandwidth Store
  • 9. searching, recording, accounting, paying, writing, reviewing, tracking, calculating, developing, listening, Develop and Test Email Surf analyzing, transmitting, learning, controlling, Transfer purchasing, testing, alarming, changing, updating, deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, Operate communicating, reading, playing, working, Store mailing, and Manage meeting, gambling, shopping, storing, cross 9
  • 10.
  • 11. Essential characteristics  On-demand service  Broad network access  Resource pooling  Rapid elasticity Deployment models – private cloud – community cloud – public cloud – hybrid cloud Service Models  Measured service Software as a Service Platform as a Service Infrastructure as a Service US: National Institute of Standards and Technology http://www.nist.gov
  • 13. Performance risks Standards Security risks Cyber crime Availability and continuity Continuïty risks Functionality risks Privacy Maintainability risks Multi platform Legislation and regulations risks Suppliers and Impact organisation outsourcing risks Legislation
  • 14. Performance risks Security risks YOUR Operational Profile Availability and continuity risks Functionality risks Other customers Maintainability risks Legislation and regulations risks 14 Suppliers and outsourcing risks YOUR Operational Profile PLUS
  • 15. Performance risks Security risks The idea: “it’s safe” Availability and continuity risks Functionality risks Everything over the web Maintainability risks Legislation and regulations risks 15 Suppliers and outsourcing risks Home ground for hackers
  • 16. Performance risks Security risks No free choice of device. Availability and continuity risks Functionality risks Bring Your Own Device Maintainability risks Legislation and regulations risks 16 Suppliers and outsourcing risks No control.
  • 17. Performance risks Security risks Planned and controlled Availability and continuity risks Functionality risks Updates, patches, fixes, … Maintainability risks Legislation and regulations risks 17 Suppliers and outsourcing risks Do I have a choice?
  • 18. Performance risks Security risks In house. Availability and continuity risks Functionality risks Where is my data? And is that OK? Maintainability risks Legislation and regulations risks 18 Suppliers and outsourcing risks Somewhere…
  • 19. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 19 Suppliers and outsourcing risks
  • 21. Testing! Interview Check Trial Proof of concept Proef Proof ofInterview concept Testen Intake Review 21
  • 22. Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Proef Proof ofInterview concept Testen Intake Functional testing Migration testing Testing caused by legislation and regulations 22 Testing in production
  • 23. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 23 Suppliers and outsourcing risks Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  • 24. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 24 Suppliers and outsourcing risks Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  • 25. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 25 Suppliers and outsourcing risks Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  • 26. Performance risks Security risks Availability and continuity risks Testing during selection Performance testing Security testing Architecture for manageability Testing Functionality risks Availability and continuity testing From “individual” riskstesting Functional Maintainability risks to Migration testing Legislation and regulations “individual” test measures by Testing caused risks 26 Suppliers and outsourcing risks legislation and regulations Testing in production
  • 27. Testing during selection Selection Performance testing Security testing Testing for manageability Implementation Availability and continuity testing Functional testing Migration testing Production 27 Testing caused by legislation and regulations Testing in production
  • 28. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 28 Suppliers and outsourcing risks Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  • 29. Testing during selection Performance testing Selection Criteria Security testing Testing for manageability Availability and continuity testing Proof of Concept Functional testing Migration testing Testing caused by legislation and regulations 29 Testing in production
  • 30. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 30 Suppliers and outsourcing risks Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  • 31. Testing during selection Performance testing Known measures tuned and tweaked Security testing Testing for manageability Availability and continuity testing Functional testing New measures developed Migration testing Testing caused by legislation and regulations 31 Testing in production
  • 32. Testing during selection YOUR Operational Profile Performance testing Security testing Testing for manageability Load Testing Availability and continuity testing Functional testing YOUR Operational Profile PLUS ACTUAL MOMENT 32 Migration testing Testing caused by legislation and regulations Testing in production
  • 33. Testing during selection Performance testing Load and stress. Security testing Testing for manageability Elasticity Availability and continuity testing Functional testing Migration testing Load and elasticity. 33 Testing caused by legislation and regulations Testing in production
  • 34. load test – ‘up’ load test – ‘down’ 101 100 boundary values 99 load path test extend? no yes 200 charged 34 100 charged boundary values ‘up’ tc 1: use=99, pay 100 tc 2: use=100, pay 100 tc 3: use=101, pay 200 ‘down’ tc1: use=101, pay 200 tc2: use=100, pay 100 tc3: use=99, pay 100
  • 35. Testing during selection Multiplatform testing. Performance testing Security testing Testing for manageability Any device – any platform Availability and continuity testing Functional testing Migration testing Multiplatform testing. 35 Testing caused by legislation and regulations Testing in production
  • 36. 3997 distinct Android devices http://opensignal.com/reports/fragmentation.php 36
  • 37. Internet Explorer 7 Windows XP Internet Explorer 8 Windows Vista Firefox 3.6 Windows 7 Firefox 4 Browsers Windows 2003 Server Safari 4 Safari 5 Windows 8 Chrome11 Windows CE Opera11 Linux Operating systems SUN Computer Unix Mac OS Lion Mac OS Snow Leopard PC Macintosh iPhone ... Multi-platform testing iOS Samsung … Mobile phones NOKIA … Android ASUS ... Windows Mobile Tablet Devices 37 Blackberry … MOTOROLA …
  • 38. Testing during selection Performance testing Incidental testing. Security testing Legislation + Regulations = Test basis Testing for manageability Availability and continuity testing Functional testing Migration testing Compliancy testing. 38 Testing caused by legislation and regulations Testing in production
  • 39. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 39 Suppliers and outsourcing risks Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  • 40. Testing during selection Continuous End-to-End Test Performance testing Security testing Testing for manageability Availability and continuity testing Functionals and non-functionals 40 Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  • 41. Standards Cyber crime Check Continuity Interview Privacy Legislation Proof of concept Trial Multi platform Impact organisation Intake
  • 42. Performance risks Security risks Availability and continuity risks Testing during selection Performance testing Security testing Architecture for manageability Testing starts early: in selection Testing Functionality risks Availability and continuity testing From “individual”widened Scope of testing Functional testing is risks Maintainability risks to Migration testing Legislation and regulations “individual” test measuresby Testing continues in production Testing caused risks 42 Suppliers and outsourcing risks legislation and regulations Testing in production
  • 44. Thanks for listening! Go to www.eurostarconferences.com for more information @esconfs #esconfs www.eurostarconferences.com