STAMP Project ActiveEon Use Case presented at Telecom Valley QA/Test Commission 6 Dec. 2018 by Mael Audren, Activeeon Software Engineer.

1. 1
STAMP Activeeon Use Case
Mael AUDREN
Activeeon Software Engineer

2. 2
Software quality

3. 3
Tests usages

4. 4
Tests quality

5. 5
Pull request
● Maven/Gradle
● Sonar
● Dspot
● Descartes
● CI System-tests
● CAMP
STAMP tools
DEV
Release
User
● Create issues
● Botsing

6. 6
Understand mutation testing
?

7. 7
public class AClass {
public int count = 0;
public void count(int i) {
if (i >= 10) {
count++;
}
}
public void reset() {
count = 0;
}
}
Code coverage is not enough
@Test
public void bossSaysMustHaveCodeCoverage() {
AClass a = new AClass();
a.count(0);
a.count(9)
a.count(11);
}

8. 8
public class AClass {
public int count = 0;
public void count(int i) {
if (i >= 10) {
count++;
}
}
public void reset() {
count = 0;
}
}
Test is better with assertions
@Test
public void bossSaysMustHaveAssertions() {
AClass a = new AClass();
a.count(0);
assertEquals(0, a.count)
a.count(12);
assertEquals(1, a.count)
}

9. 9
public class AClass {
public int count = 0;
public void count(int i) {
if (i = 10) {
count++;
}
}
public void reset() {
count = 0;
}
}
Mutation testing ensure test quality
@Test
public void bossSaysMustHaveAssertions() {
AClass a = new AClass();
a.count(0);
assertEquals(0, a.count)
a.count(12);
assertEquals(1, a.count)
}
// The test failed
// Mutant is killed

10. 10
public class AClass {
public int count = 0;
public void count(int i) {
if (i > 10) {
count++;
}
}
public void reset() {
count = 0;
}
}
Mutation testing ensure test quality
@Test
public void bossSaysMustHaveAssertions() {
AClass a = new AClass();
a.count(0);
assertEquals(0, a.count)
a.count(12);
assertEquals(1, a.count)
}
// The test suite is green
// Mutant is not killed

11. 11
Using PIT for mutation testing
PIT
Tests

12. 12
DSpot for tests generation
Pull request
DEV
● Gradle => Build and run tests
● Sonar => Check test coverage and quality gates
● DSpot => Generate non regression tests

13. 13
Descartes to ensure test quality
Pull request
DEV
● Gradle => Build and run tests
● Sonar => Check test coverage and quality gates
● Descartes => Check tests quality

14. 14
Descartes analysis
Not tested
Partially tested
Tested
Pseudo tested

15. 15
Descartes report

16. 16
CAMP for configuration testing
● Testing operating system and version
● Testing java version
● Testing databases

17. 17
Botsing for fixing bugs
New issue
User/Dev
● Botsing => Generate a test that will reproduce the crash
from the stack trace

18. 18
Botsing test

19. 19
Conclusion
● Dspot => Testing in progress
● Descartes => Already have improved our codebase
● CAMP => Testing in progress
● Botsing => Already used but it needs improvement