Engineering Group's Quality Assurance department has developed an infrastructure allowing to monitor the quality of the development processes of software projects and products, which was also needed to achieve the CMMi-DEV lev.3 certification compliance. The infrastructure allows the logical and technical integration of different tools supporting the development and management of software projects, in compliance with the corporate organizational rules, thus granting a high level of flexibility to users, who can choose between open source tools and, if requested, proprietary ones. The cornerstone of this process is Spago4Q, which provides the working groups with the necessary information to trace and develop end-users' requirements, to manage tests and project information, including risks, opportunities, metrics and documents.

1. November 27 - 29, 2012
Orange Labs, Paris-Issy-les-Moulineaux, Paris
An open source infrastructure
supporting the development and quality assessment
of software products and projects at Engineering Group
Daniele Gagliardi
Spago4Q Architect - Engineering Group
www.spago4q.org 1

2. Agenda
✔
The Scenario
✔
The Need
✔
Solution & Results
✔
The Future
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 2

3. Overall Scenario
✔
Continuous quality improvement in Engineering's
projects
✔
Engineering's Infrastructure supporting quality
processes
✔
CMMi-DEV and ISO 9001 certifications, as an
independent criterion to validate the compliance of
processes and infrastructure with quality
standards
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 3

4. Scenario – Engineering's Quality Infrastructure
✔
Corporate tools supporting ALM and PM
✔
Compliant to Corporate information systems and rules;
✔
Role Based Access Control for:
✔
Project managers and Q&A auditors
✔
Customers;
✔
external consultants;
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 4

5. Scenario – Tools adopted
✔
Corporate Project Portal
✔
Built on Liferay and Alfresco
✔
Project Metrics (Function Point and Man-Day, estimates and efforts)
✔
Risks (Threats and Opportunities, as the PMI requires...)
✔
Peer reviews
✔
Documentation
✔
News and project members communications (e.g.: forum, newsletters)
✔
Project roles
✔
ALM (Requirements, Bugs, project Issues,...): Atlassian Jira
✔
Test Management: TestLink
✔
Quality Assurance: Atlassian Jira
✔
Audits
✔
Remarks
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 5

6. Scenario – The Big Picture
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 6

7. The Need – many questions
Where's my reqs
coverage? And Quality?
Which and how many documents
has my project developed? Where are quality
6-months report?
What about
Statistics for SLA
risks?
And Project Review
Meetings?
How can I check the
project issue log?
Naah, this stuff doesn't work!
I will use my favourite
Spreadsheet...
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 7

8. The Need – Lack of a Unified View
✔
Several tools, several data sources
✔
Requirements separated from test cases
✔
Project metrics in a portal, project tasks in a web-app
✔
Profiling informations scattered on several databases (Jira, TestLink,
Project Portal, organization information systems...)
✔
Lack of report automation, various report formats
✔
Flexibility sacrifices control
✔
Concrete risk people abandon the company infrastructure in favour
of self-made solutions:
✔
scattering of project information
✔
impossible to build a repository of lessons learned
✔
lot of work thrown away
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 8

9. The Solution: Spago4Q, a Unified View
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 9

10. The Solution – Samples of analysis
Project Managers:
✔
✔
Test coverage Indicators;
✔
Time Indicators (resolution time, average time-in-status,...);
✔
Dashboard on project risks;
✔
Project metrics (FP and MD): trend on estimates, difference with effort;
✔
Trend on documentation production;
✔
Documentation access control;
✔
Access Control to report content, based on several profiling informations scattered to
several databases (Jira, API Portal, organization information systems...)
Quality Assurance Auditors:
✔
✔
Statistics on each audit (remarks and resolutions);
✔
Ready-to-use statistics on quality audits results to write six-month reports requested by
Engineering's Board of Directors;
Quality Infrastructure Managers
✔
✔
Trend on documentation growth;
✔
Unsuitable use of the infrastructure (disk space matters...)
✔
Infrastructure Monitoring
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 10

11. The Solution – Unified Dashboard
One glance to catch 'em all...
Risks
Tasks & Issues
Reqs & Bugs
Docs
Metrics
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 11

12. The Solution – Unified Dashboard Help
On-line help:
a short PDF guide
downloadable from Spago4Q
to read your dashboards
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 12

13. The Solution – Jira Dashboard
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 13

14. The Solution – Jira Dashboard
Drill-down from requirements to test cases
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 14

15. The Solution – Project Risks
From Project Portal: Risks (Threats and Opportunities, as the PMI
recommends...), current situation and trend, exposition on times and costs
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 15

16. The Solution – Documents
From Project Portal: documentation trend and...
...Need to know who accessed and what did with the documentation?
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 16

17. The Solution – Infrastructure Monitoring
Analysis on storage use...
...and possible incorrect use of infrastructure (e.g. As a personal
backup service...), thanks to QbE (Query by Example) feature
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 17

18. The Solution – Project Review Meetings
Overview...
...past snapshot available!
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 18

19. The Solution – Project Review Meetings
… and details...
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 19

20. The Solution – Quality Audits
Reports on audits and remarks state Analysis with dynamic filters
(6-month or annual review) (enabled/disabled on the legend)...
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 20

21. The Solution: does it meet all my needs?
YEAH!
THIS stuff COULD work,
but...
Yes?
Can I also use my favourite...
Spreadsheet?
Of course!
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 21

22. The Solution – High Adaptability
Reports exportable in various formats for further specialistic analysis
OK, thanks sir!
Gained enough time
to have a holiday...
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 22

23. The Solution – Under the Hood
✔
DWH feeded by Talend jobs ✔
Direct querying on Jira Database
✔
Talend jobs retrieve: ✔
Direct querying on CMS for docs
✔
Profiling infos (Portal & Jira); audits
✔
Jira issues; ✔
A Java interface implemented to
✔
TestLink-Jira integration infos; build a Dynamic Security Context
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 23

24. The Solution – The Shopping List
✔
DWH design (of course...)
✔
ETL development
✔
BIRT reports and JPivot cubes
✔
Java 1-class development...
✔
...and Spago4Q, a twine that bind all together.
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 24

25. The Future - Roadmap
✔
Enhancing reports and KPI
✔
Building KPI for Infrastructure Enhancing Project
✔
New features: integrating a corporate-wide project planning
tool, towards a Complete Project Intelligence Solution!
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 25

26. Contacts
Visit Spago4Q website:
www.spago4q.org
Contact us:
spago4q@eng.it
Download Spago4Q from OW2 Forge:
http://forge.ow2.org/
www.spago4q.org Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported. 26