“Maturity model” (MM) (based on Crosby’s original idea) has been one of the main buzzwords over the past 20 years. A variety of MMs have been created in several application domains, from Software Engineering to Contract Management. Despite several models intending to cover the same domain, their PRMs (Process Reference Models) typically have different scopes, do not always cover the same set of processes, or have different levels of depth, or do not express the same level of granularity when describing concepts. Thus some important questions from the MM users’ viewpoint arise: how to choose the right models for our needs? After selecting those models, how to build a new, tailored MM based on several sources and customized to a specific domain? This paper motivates these important questions and proposes a way to choose, combine and adapt the contents from multiple MMs within a generic-domain approach we call ‘LEGO’ (Living EnGineering prOcess), based upon the well-known kids’ toy that stimulates creativity through combining different bricks. We present three case studies, one of them based upon the development of the Medi SPICE model, illustrating how the proposed approach may be used to develop MCM (Maturity & Capabilty Models) in this context.

1. 5WCSQ – 5° World Congress on Software Quality
Shangai (China), Oct 31-Nov 4, 2011
The LEGO Maturity & Capability Model Approach
Luigi Buglione
Christiane Gresse von Wangenheim
Jean C.R. Hauck
Fergal McCaffery
www.eng.it

2. Engineering At a glance
_ The first Italian ICT player
_ more than 730 M/€ revenues Research and PA & HC Finance Industry TELCO Utilities
Development
_ 1000 clients
_ 6,300 IT specialists System Int. &
Consultancy
% 46 70 54 80 80
Outsourcing % 35 10 27 10
Software
% 19 20 19 10 20
ERP IT Security ECM
Plant Management
Managed Operations Broadband & Media
System
www.eng.it
www.eng.it

3. UFSC At a glance
Federal University of Santa Catarina
Florianópolis/Brazil [http://www.ufsc.br]
• 48 Master courses
• 38 PhD courses
• 62 Undergraduate courses
• EUR 268 million annual budget
• 25,737 Undergraduate students
• 8,543 Graduate students
• 34,280 Students
[http://www.youtube.com/watch?v=V6E1Z5DEuvk]
INCoD is to be a reference institute for excellence in research, validation
and dissemination to support digital convergence. [http://www.incod.ufsc.br]
The Software Quality Group focuses on scientific research, development and
transfer of SE models, methods and tools. [http://www.gqs.ufsc.br]
www.eng.it

4. DKIT At a glance
Dundalk Institute of
Technology is a 90 acre
campus situated between
Dublin and Belfast (each
approximately 50 miles
away).
The Institute consists of 4
Schools:
1. Business & Humanities
2. Informatics & Creative
Arts
3. Engineering
The Regulated Software Research Group which is 4. Health & Science
part of LERO (the Irish Software Engineering
Research Centre) is part of the School of Informatics
& Creative Media
www.eng.it

5. The LEGO Approach Goals of the presentation
 G1. Discuss the daily need to tailor, applied to the
Process Improvement world (not only in the Sw domain)
 G2. Propose the LEGO approach for customizing your
own ‘Maturity & Capability Model (MCM) choosing the
neede element from a plenty of possible choices
 G3. Show few case studies for applying in a smart way
the LEGO approach, using our MCM Repository
5 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

6. The LEGO Approach Agenda
• Introduction
– Customize in the ‘real’ world
– …and in the SPI world
• The LEGO Approach
– The four elements
 MCM Repository
 Process Architecture
 Mappings & Comparisons
 Appraisal Method
• LEGO: the Process and some Case Studies
– The Process
– Three Case Studies
 Project Management
 People Management
 MediSPICE
– First results & Discussion
• Conclusions & Next Steps
• Q&A
6 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

7. Introduction Customize in the ‘real’ world...
7 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

8. Introduction Customize in the SPI world...
... ...
• …but how to customize a MCM and which elements to
take into account?
• …and what about a missing (or improvable) element
in you preferred model, especially for SMEs?
8 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

9. Introduction ‘MM-mania’: SEMQ website
URL: www.semq.eu/leng/proimpsw.htm
URL
9 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

10. Introduction ‘MM-mania’: UFSC/DKIT research
Source: Gresse von Wangenheim C., Hauck J.C.R., Zoucas A. Salviano C.F., McCaffery F., Shull F., Creating Software Process Capability/Maturity
Source
Models. IEEE Software, vol. 27 no. 4, pages 92 -94, July/August 2010.
10 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

11. Introduction ...and our last joint efforts...
11 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

12. Introduction MCM: Representations & Dimensions
Process Appraisals, 4WCSQ, 4th World Congress on Software Quality, Washington D.C. (USA),
Source: Buglione L., An Ecological View on Process Improvement: Some Thoughts for Improving
• Horizontal: MMs going through the whole supply chain
SwEng:ISO/IEC 15504 (SPICE), CMMI, FAA i-CMM, …
15-18 September 2008
• Vertical: MMs focusing on a single perspective/group of processes
Test Mgmt: TMM, TPI, …
Project Mgmt: PM-MM, OPM3, …
• Diagonal: MMs focused on Organizational/Support processes
People CMM, TSP, PSP, …
12 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

13. The LEGO Approach Agenda
• Introduction
– Customize in the ‘real’ world
– …and in the SPI world
• The LEGO Approach
– The philosophy
– The four elements
 MCM Repository
 Process Architecture
 Mappings & Comparisons
 Appraisal Method
• LEGO: the Process and some Case Studies
– The Process
– Three Case Studies
 Project Management
 People Management
 MediSPICE
– First results & Discussion
• Conclusions & Next Steps
• Q&A
13 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

14. The LEGO Approach The Philosophy
LEGO (Living Engineering Process)
14 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

15. The LEGO Approach The Four Elements
1. MCM Repository 2. Process Architecture
3. Mappings & 4. Appraisal Method
Comparisons
15 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

16. The LEGO Approach 1. MCM Repository - www.gqs.ufsc.br/mcm
• Web-based repository
 Java v5.0 on a web platform
 Tomcat v6.0 application server
 MySQL Community Server v5.5
16 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

17. The LEGO Approach 2. Process Architecture
17 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

18. The LEGO Approach 3. Mappings & Comparisons
18 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

19. The LEGO Approach 4. Appraisal Method
19 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

20. The LEGO Approach Agenda
• Introduction
– Customize in the ‘real’ world
– …and in the SPI world
• The LEGO Approach
– The four elements
– MCM Repository
– Process Architecture
– Mappings & Comparisons
– Appraisal Method
• LEGO: the Process and some Case Studies
– The Process
– Three Case Studies
 Project Management
 People Management
 MediSPICE
– First results & Discussion
• Conclusions & Next Steps
• Q&A
20 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

21. LEGO: Process and... The Process
2. 3. 4.
1.
Query the Include new Adapt
Identify goals
MCM repository elements & Adopt
Process Phase Description
1. Identify your clearly identify your needs, moving from the current BPM version
informative/business goals and content.
2. Query the MCM Repository browse the MCM repository, setting up the proper filters in order
to obtain the desired elements (processes; practices; etc.) to be
inserted in the target BPM.
3. Include the selected include the new element(s) in the proper position in the target
element(s) into the target BPM BPM (e.g. process group, maturity level, etc.).
4. Adapt & Adopt the selected according to the process architecture of both process models (the
element(s) target and the source one), the selected elements may need to be
adapted, tailoring such elements as needed.
21 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

22. LEGO: Process and... Three Case Studies
Case Studies Comments/Notes
1. Project Management  Horizontal (CMMI-DEV) vs. Vertical Model (P3M3)
2. People Management  Horizontal (CMMI-DEV) vs. Diagonal Model (P-CMM)
3. Medi SPICE –  A new model based on a H-model
http://medispice.ning.com
22 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

23. LEGO: Process and... Case Study #1: Project Management
# Process Actions Comment/Note
1. Identify your • Increase the scope of the current BPM about  Hp: current BPM is CMMI-DEV
informative/business Project Management processes, including the based (horizontal model)
goals Business Case Development one.
2. Query the MCM • Browse MCM repository, filtering by:  Hp: selected the P3M3 OGC’s
Repository Domain: Project Management ( P3M3) model (vertical model)
Process Business Case Development (ML2 KPA)
3. Include the selected • ‘Mapping & Comparison’ analysis: Business ---
element(s) into the Case Development is a missing process in the
target BPM target BPM
• Position the new process in an existing CMMI
process category ( Project Management)
• Position the new process in one of the
defined CMMI ML ( ML2)
4. Adapt & Adopt the • Re-write and adjust the content of the  Hp: maintained the current BPM
selected element(s) original P3M3 KPA in the CMMI-style, both on process architecture
SPs and GPs parts, filling the ‘Elaboration’
sections for each GP of the new ‘Business Case
Development’ process and modify GPs in the
existing processes where suitable
23 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

24. LEGO: Process and... Case Study #2: People Management
# Process Actions Comment/Note
1. Identify your • Increase the scope & deepness of the current  Hp: current BPM is CMMI-DEV
informative/business BPM about HRM processes, including the based (horizontal model)
goals ‘Training & Development’ one.
2. Query the MCM • Browse MCM repository, filtering by:  Hp: selected the People CMM
Repository Domain: HR management ( People CMM) (P-CMM) model (diagonal model)
Process:‘Training & Development’ (ML2 KPA)
3. Include the selected •‘Mapping & Comparison’ analysis: similarities ---
element(s) into the with CMMI’s Organizational Training (OT) ML3
target BPM process.
•Valuable element(s) to be extracted: some
more ‘Typical work products’ in P-CMM than
currently present in OT
•Position the new elements in an existing
CMMI process category ( Process
Management)
•Position the new elements in one of the
defined CMMI ML ( ML3)
4. Adapt & Adopt the • Re-write and adjust the content of the  Hp: maintained the current BPM
selected element(s) original OT process area including more WPs process architecture
in SG1
• All the ‘development’ part of P-CMM
‘Training & Development’ process is out of
scope in CMMI  create a new SG3 using the
CMMI process architecture style.
24 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

25. LEGO: Process and... Case Study #3: Medi SPICE
# Process Actions Comment/Note
1. Identify your • Increase the scope of the ISO/IEC 15504-5 ---
informative/business PRM and develop a PAM for the Medical
goals Device industry
2. Query the MCM • At the time of the analysis, there was no MM  Hp: selected relevant processes
Repository for ‘Medical Devices’, therefore we analysed from a series of models: 15504-5
other safety-critical PRM/PAMs that had been (horizontal model), Automotive
developed based upon 15504-5 – For SPICE (horizontal model)
example, Automotive Spice for the  Hp: selected a series of standards
Automotive Industry. Browsing ISO/IEC/IEEE from regulatory bodies: IEC
standards list, the filters used were: 62304: 2006 process model
 Domain: medical device software (horizontal model)
 Process: all relevant processes
3. Include the selected • ‘Mapping & Comparison’ analysis: stressed all ---
element(s) into the the missing processes in the initial PRM
target BPM (ISO/IEC 15504-5) (e.g. Safety Management
and Safety Engineering)
• Position the new process(es) in an existing
ISO 15504 process group ( e.g. Risk &
Safety Management Group – continuous view)
•Position the new processes in one of the
defined ISO/IEC 15504-7 ML ( ML2)
4. Adapt & Adopt the • Re-write and adjust the content of the  Hp: maintained the current
selected element(s) original IEC 62304 processes in the ISO ISO/IEC 15504 process
15504-style, both on BPs and PAs parts. architecture
Additionally, we have added a number of new
processes - taken from ISO/IEC 15504-5 with
additional relevant practices incorporated the
medical device regulatory standards or
guidelines
25 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

26. The LEGO Approach Agenda
• Introduction
– Customize in the ‘real’ world
– …and in the SPI world
• The LEGO Approach
– The four elements
– MCM Repository
– Process Architecture
– Mappings & Comparisons
– Appraisal Method
• LEGO: the Process and some Case Studies
– The Process
– Three Case Studies
 Project Management
 People Management
 MediSPICE
– First results & Discussion
• Conclusions & Next Steps
• Q&A
26 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

27. The LEGO Approach Conclusions & Next Steps
• Tailoring, Customizing and SPI
 Continuous need to find for the ‘best fit’, both in the real world as well as in SPI
 A plenty of Maturity & Capability Models (MCM) exist in several domains, the issue is
to know them and to know what to extract, adapt and your for your own needs
• State-of-the-art
 Each MCM has its own process architecture, information and way to describe them
 It doesn’t exist an ‘absolute’ model, each model has a logical boundary as well as its
pros & cons to know for been selected and chosen for building a new model
 Some lessons learned
 A combination of 2+ MCMs is better than running 2+ models in parallel (less effort
and costs)  remember the reference point is your own Management System, not
the MCM (that’s only a process meta-model)
 The LEGO approach
 Four elements to take into account (MCM Repository; Process Architecture; Mapping
& Comparisons; Appraisal Method)
 A 4-steps process for running LEGO and obtain the strengthen of your processes
If you are out to describe the truth, leave elegance to the
tailor. (Albert Einstein)
27 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

28. The LEGO Approach Lessons Learned...
URL:
www.dilbert.com
28 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

29. The LEGO Approach Q&A
感谢您的关注 !
Thanks for your attention!
29 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery

30. The LEGO Approach Our Contact Data
Luigi C. Gresse von Jean Carlo R. Fergal
Buglione Wangenheim Hauck McCaffery
Engineering.IT/ETS UFSC UFSC DKIT
luigi.buglione@eng.it gresse@gmail.com jeanhauck@gmail.com fergal.mccaffery@dkit.ie
30 5WCSQ – Shangai (China), Oct 31-Nov 4, 2011– © 2011 Buglione, Gresse, Hauck, McCaffery