Generation of Test Scenarios for Non Deterministic and Concurrent Telecommunication Applications Pavel Drobintsev, Vsevolod Kotlyarov, Nikita Voinov, Peter The Great Saint Petersburg Polytechnic University, Saint Petersburg

1. Nikita Voinov
Generation of Test Scenarios
for Non Deterministic and
Concurrent Telecommunication
Applications
14.11.2015
14 November
2015

2. 2
Information and Control System Department of ICST
• Software development methods:
• Model Driven Development (MDD)
• Model Driven Software Development (MDSD)
• Model Driven Engineering (MDE)
• Software testing methods:
• Model Driven Testing (MDT)
• Model Based Testing (MBT)
Introduction

3. 3
Information and Control System Department of ICST
Model Oriented Approach
• Benefits:
• Reduction of software development cost via automation
• Simplification of test development process
• Involving of customer into development process
• Issues:
• A shortage of engineers with MDT expertise
• Different levels of abstraction
• The problem of test suite explosion
• Necessity to customize MDT approaches in projects from
different areas of industry

4. 4
Information and Control System Department of ICST
Fragment of Telecom Project in UCM Notation

5. 5
Information and Control System Department of ICST
Fragment of Multi Concurrent Model in UCM Notation

6. 6
Information and Control System Department of ICST
Verification and Testing Within Single Technology
• Test Coverage criteria
• Functional coverage
• Responsibility coverage
• Branches coverage
• Paths coverage
• Verification techniques (performed by VRS toolset)
• Model checking
• Symbolic verification
• Searching of equivalence classes

7. 7
Information and Control System Department of ICST
Non Deterministic Behavior: active alternative
Direction of the signals in Req1 and Req2: from test to SUT.
Two linear tests shall be used.

8. 8
Information and Control System Department of ICST
Non Deterministic Behavior: passive alternative
Direction of the signals in Req1 and Req2: from SUT to test.
Linear tests can not be used, adding of “alt” construction is required.

9. 9
Information and Control System Department of ICST
Concurrent Behavior: linear traces
Correctness of the test strictly depends on the direction of the signals.

10. 10
Information and Control System Department of ICST
Concurrent Behavior: solution
Par construction can be automatically
added into particular test based on
syntax analysis of high level formal
model.

11. 11
Information and Control System Department of ICST
Concurrent Behavior: example

12. 12
Information and Control System Department of ICST
Results
Project BP number Non
linear BP,
%
Test scenario
number
(Linear)
Test scenario
number
(Linear + non
linear)
Reduce of
test suite,
%
SMTP 30 10 10 8 20
CDMA 205 43 1171 615 48
Satellite
terminal
191 15 396 291 27
Examples of not huge projects: average reduction of test suite with
usage of suggested approach is near 30%

13. Thank You

14. 14
Information and Control System Department of ICST
Proved Model of System Under Test