This session will present the most recent processes implemented by the Jahia QA team to ensure the best possible quality of our products.

1. Software Quality Assurance at Jahia
Anna Afshar – Quality assurance manager
aafshar@jahia.com
© 2002 - 2014 Jahia Solutions Group SA

2. Content
 Life cycle of product releases
Major releases
Minor releases
 Introduction of different infrastructures, tools,
strategies and methodologies on which QA
activities are based
© 2002 - 2014 Jahia Solutions Group SA

3. Life cycle of product releases
© 2002 - 2014 Jahia Solutions Group SA

4. QA activities for major releases
Development
sprint 1
Development
sprint N
Unit Tests development
Test scenarios description
Functional test
Code review
Performance test
QA sprint
QA sprint
Massive functional test
Bug fixes
General Performance test
System test
Migration test
Integration test
Selenium script development
© 2002 - 2014 Jahia Solutions Group SA
Release
management
sprint
Release candidate
No failure within automated test plans
Migration test on copy of jahia.com site
Final release
System test of installers
Final migration package generation
Publish of release information to jahia.com

5. QA activities for minor releases
Sprint
week 1
4
bugfixes and tests
week 2
bugfixes and tests
Selenium development
Maintenance of existing scripts
Administration of QA infrastructure
Analyze of new tools
Development of our own tools
week 3
bugfixes and tests
week
release management
Code review
Release candidate
No failure within automated test plans
Functional test
Migration test on copy of jahia.com site
System test
Final release
Migration test
System test of installers
Performance test
Final migration package generation
Automation of critical test cases Publish of release information to jahia.com
© 2002 - 2014 Jahia Solutions Group SA

6. Introduction of different infrastructures, tools,
strategies and methodologies on which QA
activities are based
© 2002 - 2014 Jahia Solutions Group SA

7. Testing strategies
The overall testing process benefits from the strength of both
approaches :
 Manual testing
 Automation can not replace human intuition, inference and
inductive reasoning
 Automated testing
 Reliable
 Repeatable
 Reusable
 Faster
© 2002 - 2014 Jahia Solutions Group SA

8. Testing process
Developer’s
scenarios
Manual test
Automated tests
on nightly build
Tester’s
scenarios
Customer
jira’s
scenarios
Selenium tests
Junit tests
Performance
tests
Community
members
© 2002 - 2014 Jahia Solutions Group SA

9. QA servers and infrastructures
 8 test servers on which nightly builds are automatically
deployed:
 Supported data bases: Mysql, Oracle, Postgres, Microsoft sql server
 Supported application servers: Tomcat, Websphere, Jboss
 Part of supported operating systems: Debian, CentOS
 Amazon cloud images for remaining supported
environments
© 2002 - 2014 Jahia Solutions Group SA

10. Test automation / Unit Test
 Number of existing tests
1467 jackrabbit unit tests
198 core tests
47 modules tests
 Framework: JUnit
 Nightly execution against each branch
© 2002 - 2014 Jahia Solutions Group SA

11. Test automation / Unit test / Nightly reports
© 2002 - 2014 Jahia Solutions Group SA

12. Test automation / Selenium
 Simulate user interactions with Jahia
Site and content life cycles
Jahia administration
 Run with testNG
 140+ scripts
 Nightly executions against each branch
 Scenarios with different levels of complexity
© 2002 - 2014 Jahia Solutions Group SA

13. Test automation / Selenium / Nightly reports
© 2002 - 2014 Jahia Solutions Group SA

14. Perfomance test
 Jmeter as tool
 Manual and automatic executions
 Tests in cluster and standalone environments:
Contribution performance test
Consultation performance test
Combination of consultation and contribution
© 2002 - 2014 Jahia Solutions Group SA

15. Test automation / Performance / Nightly reports
© 2002 - 2014 Jahia Solutions Group SA

16. Code review
 Manual review using different tools :
Jira
Fisheye
Crucible
SonarQube
© 2002 - 2014 Jahia Solutions Group SA

17. Code review / Jira
© 2002 - 2014 Jahia Solutions Group SA

18. Code review / Fisheye
© 2002 - 2014 Jahia Solutions Group SA

19. Code review / SonarQube
© 2002 - 2014 Jahia Solutions Group SA

20. Code review / Crucible
© 2002 - 2014 Jahia Solutions Group SA

21. Summary
Jahia uses all its capabilities to ensure the
quality of the product for its:
Stability
Scalability
Security
© 2002 - 2014 Jahia Solutions Group SA

22. Thank you!
Contact: qa@jahia.com
© 2002 - 2014 Jahia Solutions Group SA