SlideShare una empresa de Scribd logo
1 de 11
Descargar para leer sin conexión
Six Sigma for Software
                                  Dr. Thomas M. Fehlmann
                             Euro Project Office AG, Zeltweg 50
                               CH–8032 Zurich, Switzerland
                                  phone: +41 44 253 1306
                            e-Mail: thomas.fehlmann@e-p-o.com

Abstract
   Six Sigma has been very successfully applied in manufacturing. Is it also applicable to
software, and ICT? Six Sigma is about cost reduction by eliminating defects. Six Sigma uses
the following three principles:
   1. Focus on customers
   2. Process orientation
   3. Leadership based on metrics
   Applying Six Sigma to software development makes software projects transparent to both
management and customers. Transparency requires an important cultural change. As a
result, after transparency is achieved, completing accurate project estimations while meeting
both deadlines and customer requirements becomes a lot easier. This paper will explain to
readers how to:
   - Achieve transparency;
   - Learn how to implement Six Sigma for managing software development projects;
   - Understand the six steps for managing software development projects and listen to an
        explanation of how it impacts software development, software testing, project
        management, and project controlling;
   - Discover the fundamentals for leadership, project management and SW architecture.
   In this paper we refer to a case study where Six Sigma has been successfully applied in
software development.

1. What is Six Sigma? Does it apply to software?
   Since the early 90’ies, Six Sigma has been extensively used for achieving total customer
satisfaction with innovative products at competitive price. Its objectives are to deliver
products when promised, without delivered defects, early life failures, or failures during use.

1.1. The Six Sigma Approach
   Six Sigma [10] is about measuring defects in the
value chain process in order to systematically reduce
                                                                           σ σ
them and therefore the corresponding cost factors.
Sigma (represented as σ) is a statistical term that
measures the deviation from the target set. A process
that executes on 6σ level will yield results within the
tolerance interval with 99.99966% probability.
   Thus 6σ corresponds to only 3.4 defects per 1
million defect opportunities. A defect opportunity is
                                                          tolerance
a measurable process result that is critical to           threshold
customer satisfaction.
   Six Sigma is not team driven like TQM. It is a                     6             6
management approach. Defect metrics are the main
tool for leaders to impact cost and margin.
All metrics are customer driven. A defect is only what affects customer satisfaction. Thus
before you can start Six Sigma you need to know what your customer really needs. Six
Sigma is process – oriented. The term “customer” refers to who is using the output of your
process and this is not always the end–customer. It is thus important to define what “defect”
exactly refers to, when using a Six Sigma approach.

1.2. Benefits using Six Sigma
   In manufacturing industry, hidden costs because of waste and rework in production
processes are a major opportunity for cost savings. In Information and Communication
Industry (ICT) this is even truer. When using every day’s Office applications, everybody
knows how often the
many defects in the
software affect our                Hidden costs
productivity and effec-      in % of turnover
tiveness.     For ICT
projects, defect costs                                Services, Projects, ICT
                                40%
are even more impor-                                       33%
tant. There exist vari-         30%                                Average Organisation
ous estimations that
                                                                        15%
identify hidden cost            20%                                                             Best in class
due to defects in ICT,                                                                          < 5%
depending upon the              10%

industry and applica-
tion area. The famous            0%
                          Sigma 0           1            2          3               4              5             6
CHAOS Report of the
                          DPMO            500‘000      308‘537   66‘807            6‘210          233          3.4
Standish Group [12] (Defects per Million Opportunities)
noted repeatedly that                                          Source: Concepts, Innsbruck; GE; own measurements
only about 20% of all
ICT projects reach their targets. The rest will either be stopped (~30%) or miss important
requirements such as functionality or deadlines (~50%).
   This means that we have an opportunity to get the benefits of ICT for significantly less
cost, up to 30% or better. Indeed, organizations that use such an approach consistently report
cost saving or margin improvements of this size.

1.3. Does it work for software?
   Nevertheless, there were only occasionally attempts to implement Six Sigma for software.
   Applying Six Sigma to software development makes product development and other
projects transparent to both management and customers. However, transparency requires an
important cultural change. We know from experience that bad communication is a major
reason why projects fail, and software projects in particular. We expect from better
transparency that meeting both deadlines and customer requirements becomes easier.
   The major problem with early Six Sigma attempts was that there was no connection of
software metrics to economic success[6].
   Counting mistakes and defects is not a clear indication if the software project is going to
be successful (e.g. [4]). Other metrics like time-to-market and user friendliness are much
more important in many application areas. Sometimes, reliability is of essence, but not
always.
   There is no software metrics that serves all. It depends what kind of software we are
developing or installing.
   Finding good metrics for software development or deployment is a major task in itself.
2. Why do we need Six Sigma For Software?
   Software today is responsible for most of the added value in products, and must be blamed
for many of its failures. Even if the iron hook breaks, it may be the software embedded in the
measurement instrument to blame for not having detected it in time. When in Germany the
high speed intercity express train crashed into an overpass, it was software that didn’t detect
the broken wheel ring well before the accident1.
   Mobile networks are suffering from not being able to provide interconnection to the
Internet and interoperability between their own services. It is the software that fails.
   In e-Commerce and for making Web Services to work, security, reliability and fault
tolerance are of essence. Software and business processes are not cooperating, as they should
to make it profitable.
   Software is so ubiquitous that we must solve the software development problem to address
a lot of other problems the society has.
   The Six Sigma approach is:
               Set the goal – Define
               Define the metrics – Measure
               Measure where you go – Analyse
               Improve your processes while you go – Improve
               Act immediately if going the wrong path – Control
   Throughout this talk, we talk about “software development”, however we not only intend
writing new software, but also software integration, deployment, and maintenance, as long as
it has the character of a project2. This means that there is a goal that can be reached or
missed. Using Six Sigma, we want to measure how much we are going to miss that goal.

3. Implementing Six Sigma for Software
   In our experience with implementing Six Sigma for software we found the following three
principles most useful:
        Principle No 1:
            Measure customer related metrics only
            - Use Combinatory Metrics to cover all topics
        Principle No 2:
            Adjust to moving targets
            - Your goals may need change; accept change and manage it accordingly
        Principle No 3:
            Enforce measurement
            - Do not enforce meeting targets
   The last principle is the most difficult one, because this is against the project manager’s
carnet of duties.
   Indeed, this is what most often goes wrong in software projects: People want to enforce
targets and consequently miss the goals. This is because setting targets that really lead to the
goal is so difficult in software projects. Just consider the ever-lurking dilemma: Should we
make the milestones, or do it right the first time such that we can later use the knowledge
gained to proceed faster? Writing or implementing software is not just an engineering
discipline but in essence it is knowledge transfer.


1
   It should be noted that the Columbia accident was not due to software, but to organisational failure of not
reacting to the problem indications that were indeed abundant. It is an interesting question how much ICT
reliability and organisational culture interact.
2
   Six Sigma for operation of a software – based system has similarities, including Combinatory Metrics.
3.1. Measure customer related metrics only
   The goal of Combinatory Metrics is to assign the value delivered to customers to all the
deliverables produced during a project
   This is not straightforward for things like a concept, a software component, or a test
execution during software development.
   Impact on customer is dependent from success factors that describe what topics do
actually influence the impact on customers. We call these influencing factors “Critical To
Quality” (CTQ).
   Thus we use QFD as a technique to combine metrics for different topics, especially if
those metrics cannot be measured directly.

3.2. Adjust to moving targets
   After having learned how to derive measurable targets from goals using Combinatory
Metrics, we must face the fact that neither goals nor targets are as stable as should be in a
well-controlled development environment. Disturbances such as new requirements, new
insights, new technology, and new risks and threads force us to adapt to moving targets.
   One of the most common misunderstandings is that goals once set are not to be changed.
Six Sigma is not about sacred goal setting. Six Sigma needs a metric system that adjusts to
moving targets.

3.3. Enforce measurement
   Every project manager in the world (if he knows his job) will easily keep to any deadline
you set to him, by reducing scope and quality of the deliverable. Software engineers are less
good in that because they fear rework. Most problems in software development projects arise
from that fundamental discourse. In the end, the customer will not get what he needs.
   The answer to that dilemma is to monitor true work progress using objective evidence for
work completion. This is done using the Six Steps to Completion metric.

4. Successful applications of Six Sigma
  The following section uses references GMC Software AG, a small Swiss-owned niche
company that delivers software for personalized digital printing for a worldwide market.
They serve businesses with large customer bases, but with limited resources. As a niche
company, they are strongly customer oriented. The software is written in a software
development office located in Hradec Králové, Czech Republic.
  Their customers want to combine flexibility with reliability and ease-of-use, thus in 2001,
GMC set the target of reaching CMM 4 for their software development processes.

4.1. Six Steps to Completion
   A deliverable is a uniquely defined and validated work result. The project consists of a
sequence of deliverables.
   Measuring the degree of completion for the deliverables that are needed for the project
goals makes it possible to understand the project’s progress as a whole.
   We can measure time line, cost and quality targets. Every deliverable must go through six
steps. Among these are draft, review, and finalization before approval and usage.
   It is possible to get objective evidence to identify the six development steps by recording
the first draft version, the review findings, the final version, and the distribution list. Even
for complex projects, such an overview is extremely helpful. We calculate a progress index
that indicates overall progress and compare with planned and actual resource consumption.
This metric enables the responsible project manager to assess whether he can meet the
schedule commitments, and thus identifies the measures. The assessment is based on
objective evidence for progress, namely the planned quality assurance activities that must go
with the deliverable.

    Input
     Assignment
     Assignment           Template
                          Template




        Idea
        Idea                Draft
                            Draft                Review
                                                 Review          Finalization
                                                                 Finalization         App-
                                                                                      App-
                                                                                       App-        Operations
                                                                                                   Operations
                                                                                      roval
                                                                                      roval


    Output                       Draft version
                                 Draft version       Review report
                                                     Review report          Release
                                                                            Release           Distribution
                                                                                              Distribution




   Each of the six steps needs a percentage of the total duration. We set3 10% for the idea,
30% for the draft, 15% for review, 20% for finalization, 15% to get approval, and 10% to
make it operational. This progress grid yields progress metrics that can be accumulated for
every project. Note that this metric is about duration and has not much to do with effort.
   The side effect is that you have to plan for review and approval, which is part of quality
assurance. Another side effect is that computing Earned Value and other project
management metrics becomes much more reliable. Quality records from reviews and tests
provide objective evidence for the completion of a task, if the task has a deliverable. Pending
item lists are no longer needed to cope with unfinished tasks [9].
   When using an integrated development with a document management repository, the state
of the deliverable is monitored automatically. GMC’s Czech development office has
integrated all their task management in Bugzilla [2], an open source environment. Reports
and progress metrics are produced automatically, without bothering the developers. Planned
schedules are now met regularly, without pain. The defect count is how many deadlines
committed to customers are missed.

4.2. Quality Function Deployment
   However, meeting deadlines does not yet mean satisfied customers and success on the
market. Six Sigma asks for customer orientation and the corresponding metrics. However,
impact on customers                                         = strong relationship
varies    for    different                                  = medium relationship

deliverables during a                                       = weak relationship

software development Goal Topic Critical To Quality (CTQ)            Impact on Customers
                           (Deliverable)
process.
   Quality      Function
Deployment (QFD, [1])
is the method of choice
when doing Design For
Six Sigma.           QFD
provides tools to analyse
the impact that design
decisions     have     on
customers. We want to
assign the impact value
3
     Initially the percentages were an educated guess but later experience proved it a good approximation.
relative to customers to all the deliverables that are produced during a project.
   This is not straightforward for deliverables like a concept, a software component, or a test
execution during software development. For this reason we use cause–effect matrices that
quantify the impact on customer that is dependent from CTQs. These success factors are the
parameters in the software development process that influences the result and thus have
impact on customers. Such cause–effect influence constitutes a metric for the CTQs.

4.3. A Network of Deployments
   In turn, the CTQs constitute the goal topics on the next topic level. For instance, the
CTQs for fulfilling the Customer’s Needs (CN) are the most important Solution
Characteristics (SC) of the software. The solution characteristics result from the software
development processes. The corresponding CTQs are the Key Process Areas (KPA) of the
Capability Maturity Model (SW–CMM, [13]). Thus we get a chain of QFD deployments:
KPA SC CN. This is the quality deployment chain, which we call the “Enablers”.
   There exist similar chains for the product deployment, or “Realizators”. Cost deployment
for software development depends from Feature Costs (FC) and thus from project costing.
Product Features (PF) impact the Business Objectives (BO) supported by the software, which
in turn impacts Customer’s Needs (CN). The deployment chain reads FC             PF BO
CN.
   The third deployment chain is called the “Deciders”. Here we have influencing factors of
various kinds such as market share, market segmentation, competition, readiness to pay, and
customer perception. Most important is the New Lanchester theory that allows transforming
market share data into a metric for competitive advantage as perceived by the prospects.

                Deciders
                                                                                                                                  Competitive
                                                     Competitor’s                                                                  Analysis
                                                       Benefits
                                                                                                                                                                 Goal:
                        Customer                                                                                                                                 become
                       Questionnaire                                                                                                                             No. One
                                                                                           Customer’s                    Acceptance
    Customer                                                                                Wishes                      Test Coverage
    Segments                                                  New
                                                           Lanchester
                                                                                                                                                    Acceptance
                                                                                                                                                       Tests
                      Customer’s                                                                              Application Test
                      Objectives                                                                                Coverage

   Market                                                                                                                               Application
  Segments
                                                                                                                                          Tests
                                                                                                         Developer’s
                                                                  Customer’s
                                                                                                        Test Coverage
                                                                    Needs

                                                                                                                             Developer’s
                                                                                                                               Tests
                                                                                          Business
                                                  Solution                               Objectives
                                                Characteristics
                   Enablers                                                                                       Product
                                                                                                                                                      Realizators
                                                                                                                  Features
                                                                  “House of
                               Process                            Qualities”
                              Landscape
                                                                               Business Objectives                                      Feature
                                                   SW Development
                                                      Processes                   Deployment                                             Costs

                                                                                                       Feature
               CMM Criteria                                                                          Deployment
                                                                                                                                                             Cause - Effect
  Start:                                                                                                             Cost                                    Measurement
                                      CMM                                                                         Deployment                                 Dependency
  No. 2 Asia
                                   Assessment
  No. 3 US                                                                                                                                      Combinator




   QFD is well established as a technique to combine metrics for different topics, which
cannot be measured directly. However, the QFD deployment matrices are not only good for
design, they also provide a means to carry measurements over from topic to topic.
4.4. Combinatory Metrics
   The QFD matrices are cause–effect mappings between topics. The QFD matrices
originate from Ishikava – diagrams that are used to visualise root cause analysis. Thus they
always have a direction from the CTQs to its impact on the deliverables, not on the contrary4.
   You can consider the matrices as linear mappings that map the solution topic’s profile on
the goal topics. When you choose a particular solution profile then this yields a
corresponding goal’s profile, by applying the linear mapping defined by the matrix. We call
the result “Effective Profile”. This compares with the original profile, the weights that we
have set for the goal topics.
   Combinatory Metrics studies the difference between these two profiles.
                        Cause-Effect Relationship
                             St rong            9
                                                                                    Solution Characteristics
                                                                                                                                                                                                                                                                       Solution Topics
                             Medium             3
                             Weak               1




                                                                                                                                                                                                                                                                         Effective Profile (λi)
                                                                                                                                                                                         Customer's Priorities for
                                                                                                        Keep to XSQL Standard




                                                                                                                                                                                                                                              Moderated Discussion
                                                                                                                                                                                                                     Reliable Functionality
                                                                                                                                                  Agile Programming
                                                                                    Browser Style GUI
                                     Effective Impact




                                                                                                                                                                      Reusable classes




                                                                                                                                                                                                                                                                                                              Selection Crite ria
                                                                                                                                Open Interfaces




                                                                                                                                                                                         Active Portfolio
                                     φ(x)




                                                                                                                                                                                         Management
                                                                                                                                                                                         Extensions
                                                                Goal Profile (ζi)




                                                                                                                                                                                                                                              Forum
                                     Known Goal
                                     Profile y




                                                                                                                                                                                                                                                                         0.6
                                                                                                                                                                                                                                                                                                  0   1                    2        3   4      5
                                                                                                                                b.3

                                                                                                                                                  b.4

                                                                                                                                                                      b.5




                                                                                                                                                                                                                     b.8

                                                                                                                                                                                                                                                 b.9
                                                                                    b.1

                                                                                                        b.2




                                                                                                                                                                                           b.6

                                                                                                                                                                                                        b.7
                     Customer's Needs
                     a.1 Competency to answer inquiries        5.0                                                                                                                                                                                                   173 5.0

                     a.2 Confident iality                      3.8                                                                                                                                                                                                   150 4.4
       Goal Topics




                     a.3 Suit ability for business needs       4.1                                                                                                                                                                                                   149 4.3

                     a.4 Short Development Cycles              3.9                                                                                                                                                                                                   128 3.7

                     a.5 Functionality where you need it       3.6                                                                                                                                                                                                   121 3.5

                     a.6 Social competency                     3.8                                                                                                                                                                                                   130 3.8

                     a.7 Communicat ion                        4.3                                                                                                                                                                                                   131 3.8

                                                       Raw Weight 128 104 93                                                                      143 86                                   118 115 114 161 161
                                                      Optimization                                                                                                                                                                                                                                Unknown Solution
                                                    Solution Profile
                                                                 5
                                                                                    4.0 3.2 2.9 4.4 2.7 3.7 3.6 3.5 5.0                                                                                                                                                                           Profile x
                                                                       4
                     Suitable For Measurement                                                                                                                                                                                                                           Sum (ζ i -λi ) =
                                                                                                                                                                                                                                                                                                          2
                                                                                                                                                                                                                                                                                                                                        0.67
                                                                       3                                                                                                                                                                                                Convergence Factor                                              0.6
                                                                       2
                                                                       1
                                                                       0



   The two profiles coincide if the solution is ideal, that is, if the goal can be exactly reached
with the given solution topics. This is normally not the case. In all other cases profiles
differ; the Convergence Factor being a metric for the difference.
   The formula for the Convergence Factor is the length of the vector difference between
measured weight and derived weight, divided by the number of profile coefficients.
   Let x be the solution profile and φ(x) = <λ1, …, λn> the corresponding effective profile.
Then we may compare φ(x) with the goal profile y = <ζ1, …, ζn>. The corresponding
Convergence Factor is the length of its vector difference y – x divided by the number of
coefficients n, multiplied5 by 5:
                                    5 * ( Σi=1…n (ζi – λi)2 )½ / n

4
   This is a widespread wrong practice in QFD to calculate the profile of the CTQs out of the goal topic’s
weight. Such calculation is mathematically wrong, but often yields results that approximate the solution
sufficiently well [10]. The Convergence Factor must be checked to verify how well the approximation is.
5
  With the factor 5 we measure the length of the difference vector with the same units as the weights itself.
Thus a convergence factor of less than 1 indicates that its difference is tolerable because within the precision
order of the QFD matrices.
A Convergence Factor of zero means complete convergence; up to one it is considered
acceptable. Convergence Factors greater than one indicate a significant difference between
the deployed weight and the measured weight of the topic profile.
   To find the optimum solution profile you first have to find the solution components that
yield something close to the goal profile, and then you may optimize the solution profile.

4.5. Combining Deployments and Measurements
   If you have an actual measurement for the solution topics, you can do the same profile
calculation with the measured profile instead the optimum solution profile:

     Cause-Effect Relationship
          St rong            9
          Medium             3
          Weak               1                                   Solution Characteristics




                                                                                                                                                                                                                                                                               Measured Impact (µi)
                                                                                                                                                                                                                                                      Effective Profile (λi)
                                                                                     Keep to XSQL Standard




                                                                                                                                                                      Customer's Priorities for
                                                                                                                                                                                                                                                                                                                                         Effective




                                                                                                                                                                                                                           Moderated Discussion
                                                                                                                                                                                                  Reliable Functionality
    Convergence Factor

                                                                                                                               Agile Programming
                                                                                                                                                                                                                                                                                                                                         Deviation
                                                                 Browser Style GUI




                                                                                                                                                   Reusable classes




                                                                                                                                                                                                                                                                                                              Se le ction Criteria
                                                                                                             Open Interfaces




                                                                                                                                                                      Active Portfolio
                                                                                                                                                                      Management
                                                                                                                                                                      Extensions
                                             Goal Profile (ζi)




                                                                                                                                                                                                                           Forum


                                                                                                                                                                                                                                                      0.3



                                                                                                                                                                                                                                                                               0.6
                                                                                                                                                                                                                                                                                                      0   1         2                3    4   5
                                                                 b.1




                                                                                                                               b.4

                                                                                                                                                   b.5




                                                                                                                                                                                                  b.8

                                                                                                                                                                                                                              b.9
                                                                                     b.2

                                                                                                             b.3




                                                                                                                                                                        b.6

                                                                                                                                                                                    b.7
     Customer's Needs
     a.1 Competency to answer inquiries     5.0                                                                                                                                                                                                   156 5.0 174 5.0

     a.2 Confident iality                   3.8                                                                                                                                                                                                   126 4.0 147 4.2

     a.3 Suit ability for business needs    4.1                                                                                                                                                                                                   129 4.1 164 4.7

     a.4 Short Development Cycles           3.9                                                                                                                                                                                                   117 3.7 133 3.8

     a.5 Functionality where you need it    3.6                                                                                                                                                                                                   110 3.5 130 3.7

     a.6 Social competency                  3.8                                                                                                                                                                                                   117 3.7 133 3.8

     a.7 Communicat ion                     4.3                                                                                                                                                                                                   128 4.1 135 3.9

                                    Me asurement 4.2 2.5 3.0 5.0 3.2 3.4 4.3 3.8 4.8
                                      Ra w Weight 128 104 93 143 86                                                                                                    118 115 114 161 161
                                                                                                                                                                                                                                                                                                                                     Process
                                     Optimization +24 -16                                                                                          -40 -16                                        -56 -16                                                                                                                            Maturity
                                   S olution Profile 4.7 2.7 2.9 4.4 1.4 3.2 3.6 1.8 4.5
                                                 5
                                                                                                                                                                                                                                                     Sum (ζ i -λi ) =      0.15      2

                                                    4
     Suitable For Measurement                                                                                                                                                                                                                        C onvergence Factor   0.3
                                                    3                                                                                                                                                                                                                      0.76      2
                                                                                                                                                                                                                                                     Sum (ζi-µi ) =
                                                    2                                                                                                                                                                                                Effect. Deviation     0.6
                                                    1                                                                                                                                                                                                                2
                                                                                                                                                                                                                                                     Sum of (µi -λi ) =    0.46
                                                    0                                                                                                                                                                                                Process Maturity Ga p 0.5




   Now we can compare the measured with the optimum solution. This is the means to apply
Six Sigma for Software. Defects for the Combinatory Metrics network are defined as
differences between convergence factors and effective deviations that exceed 1. Although we
have only few defect opportunities, the metric does indeed indicate how well the selected
solutions for software development and for product characteristics meets customer’s needs
and expectations.

4.6. Product Development Process Metrics                                                                                                                                                                                          Sum (ζi -λ i) 2 =                                                                                            4.57
   If we have QFD Combinators with suitable
                                                           C onve rgence Factor                                                                                                                                                                                                                                                                1.0
measurements, we can define two additional metrics
                                                           Sum (ζi-µ i) 2 =                                                                                                                                                                                                                                                                   15.93
similar to the Convergence Factor.
   Let y be the goal profile, x the optimized solution Effect. Dev ia tion                                                                                                                                                                                                                                                                     1.8
profile and x0 the measured solution profile. Then φ(x) Sum of (µi-λi) =
                                                                           2
                                                                                                                                                                                                                                                                                                                                               6.91
is the effective goal profile and φ(x0) the measured Process Ma turity Gap                                                                                                                                                                                                                                                                     1.2
impact profile. With these three vectors we define three metrics:
-   Convergence Factor: The difference between goal profile ζ and effective goal profile
        λ shows how accurate the cause–effect – relationship is. It is a metric for the
        achievement of objectives under ideal conditions.
   - Effective Deviation: The difference between goal profile ζ and measured impact
        profile µ shows how well the target goals are effectively met. It is a metric for the
        achievement of objectives as perceived by others.
   - Process Maturity Gap: the difference between effective goal profile λ and measured
        impact profile µ shows the gap between what your development processes are aiming
        for and what they achieved in the real world. It is a metric for the maturity of your
        development process.
   The tolerance indicators in the above figure are set to green for a value below 1.0, yellow
for a value between 1.0 and 1.5, and red for values above 1.5. Such metrics are useful for Six
Sigma approaches; see [8], [11].

4.7. Bug Count
   The third defect count is about bugs delivered to customers. We compare them to the
number of bugs the quality assurance department had detected in–house for the same release
version.
   As sample count we cite the bug count in the flagship product PrintNet T release 4.1 that
comes to around σ ~ 3. The older product lines dwell around σ ~ 2; however, since the start
of the software process improvement this is a tremendous improvement, where σ was well
below 1, i.e. almost half of all defects were found by the customer.




   The green line indicates the number of bugs found by the customer, the black line is the
number of bug reports created during the alpha-internal and beta test phase (the latter
includes the support people in the sales offices, but not customers) 6.

5. Capability Maturity Model and Six Sigma for Software
   We have three kinds of metrics:
• Progress track – project related
• Combinatory metrics – product related
• Bug count – quality related
   The Six Sigma metrics had been introduced as part of the CMM program, but with Six
Sigma in mind. They were also instrumental to get the ISO 9001:2000 certificate in


6
   Note that this defect count does not include defects found and removed before testing started. There are yet
no size metrics available that allow for a better estimate of how many defects are taken out during developer’s
testing and with code reviews. For the overall σ estimate we assume that development delivers features with a
level of σ ~ 1; however, it may actually be higher.
November 2003. Since all metrics are related to customer’s needs, they serve as well for Six
Sigma.
   Based on these metrics, GMC reaches now a level well above 3σ7.
   Interestingly this corresponds roughly to the CMM – level. In the last self – assessment,
GMC rated in summer 2003 for 3.12, up from 1.57 in winter 2000/2001 according the SW–
CMM scale. There is certainly a relationship between the two metrics, and the relation is
most probably linear, although it cannot be assumed that the relation is exactly one-to-one.
   Another relation is probably of more practical importance: GMC’s business results
improved tremendously during the last year, and this was certainly not a linear relation. It
has more the character of a break-through, as to be expected from a successful Six Sigma
approach. The break-through had been correctly predicted by the New Lanchester theory
[15] that is part of the Combinatory Metrics measurement points.

6. Organizational Considerations and Economic Impact
6.1. Project Office
   Establishing the metrics programme and the Combinatory Metrics network needs certainly
a professional project office that cares for methods and tools and takes part in the project
organisation. Professional project offices are a necessity for any organisation that wants to
master the growing complexity in the ICT world with metrics – based improvement strategies
such as Six Sigma.

6.2. Liability for Software
   Six Sigma metrics for software development allows assessing the risks connected with
ICT. The implication of such ability is far – reaching. For instance, insurers can get
reasonable evidence for the risk actually involved in software and start offering insurance
package. Based on such insurance software manufacturers can start changing their licence
terms and offer guarantees for the proper functioning of the software. Liability can be
defined in terms of Six Sigma metrics. Such ability will change the market and probably
make software engineering indeed the discipline we so often dream about.

6.3. Cost of ICT
   However, before this vision becomes true, the immediate benefit we get from any step
towards Six Sigma For Software is that the cost of ICT can be dramatically reduced. Studies
done in certain areas like e-Government suggest savings of up to 75% of today’s cost level;
experiences with the progress tracking metrics in particular support that finding. This will
not only change the ICT industry but also impact all others that depend from it.

References
[1]     Akao Yoji. et.al: Quality Function Deployment (QFD); Productivity Press 1990, Portland, OR
[2]     Bugzilla Project Home Page http://www.bugzilla.org/
[3]     Cohen, Lou: Quality Function Deployment. How to Make QFD Work for You, Prentice Hall
        PTR 1995, New Jersey, NJ
[4]     Fenton, Norman; Krause, Paul; Neil, Martin: A Probabilistic Model for Software Defect
        Prediction, IEEE Transactions on Software Engineering
[5]     Fehlmann, Thomas: Risk Exposure Measurements on Web Sites, in: 4th European Conference
        on Software Measurement and IT Control, FESMA, May 2001, Heidelberg, Germany
[6]     Fehlmann, Thomas: Business oriented testing in e-Commerce, in: Software Quality and
        Software Testing in Internet Times, April 2002, SQS AG, Köln, Germany

7
    Since size metrics are yet missing, we cannot pretend a higher accuracy so we give no decimals.
[7]    Fehlmann, Thomas: Combinatory Metrics for Software Development, in: 8th International
       Symposium in QFD, September 2002, Munich, Germany
[8]    Fehlmann, Thomas: Strategic management by business metrics: an application of combinatory
       metrics, International Journal of Quality and Reliability Management, Vol. 20, No 1, 2003 pp.
       134–145.
[9]    Fehlmann, Thomas: Metrics for Project Management, in: 14th Annual UK Software Metrics
       Association Tutorials and Conference, August 2003, Wolverhampton, UK.
[10]   Fehlmann, Thomas: Linear Algebra for QFD Combinators, in: 9th International Symposium on
       QFD, December 2003, Orlando, FL
[11]   Snee, Ronald: Leading Six Sigma: A Step-by-Step Guide Based on Experience with GE and
       Other Six Sigma Companies, Financial Times Prentice Hall 2002
[12]   The Standish Group: CHAOS Chronicles v3.0, 1994 – 2003,
       http://www.standishgroup.com/chaos/toc.php
[13]   Humphrey, Watts: Managing the Software Process, Addison Wesley Longman, Reading 1989,
       MA
[14]   Mizuno, Shigeru, and Akao, Yoji (ed. 1994): QFD: The Customer-Driven Approach to Quality
       Planning and Deployment, translated by Glenn Mazur, Tokyo: Asian Productivity Organization
[15]   Taoka, Nobuo: Lanchester Strategy – An Introduction, Lanchester Press Inc 1997

Más contenido relacionado

La actualidad más candente

Impact of Covid-19 on Business and Workforce
Impact of Covid-19 on Business and WorkforceImpact of Covid-19 on Business and Workforce
Impact of Covid-19 on Business and WorkforceMarianne Harness
 
Presentation by rahul ghodke
Presentation by rahul ghodkePresentation by rahul ghodke
Presentation by rahul ghodkePMI_IREP_TP
 
IT Executive Survey: Strategies for Monitoring IT Infrastructure & Services
IT Executive Survey: Strategies for Monitoring IT  Infrastructure & ServicesIT Executive Survey: Strategies for Monitoring IT  Infrastructure & Services
IT Executive Survey: Strategies for Monitoring IT Infrastructure & ServicesCA Technologies
 
An Introduction to Extreme Programming (XP) Development Methodology Process i...
An Introduction to Extreme Programming (XP) Development Methodology Process i...An Introduction to Extreme Programming (XP) Development Methodology Process i...
An Introduction to Extreme Programming (XP) Development Methodology Process i...Salus One Ed
 
Ciso organizational priorities to build a resilient bimodal it
Ciso organizational priorities to build a resilient bimodal itCiso organizational priorities to build a resilient bimodal it
Ciso organizational priorities to build a resilient bimodal itChandra Sekhar Tondepu
 
Presentation by namit
Presentation by namitPresentation by namit
Presentation by namitPMI_IREP_TP
 
Architectured Centered Design
Architectured Centered DesignArchitectured Centered Design
Architectured Centered DesignGlen Alleman
 
Agile software development and challenges
Agile software development and challengesAgile software development and challenges
Agile software development and challengeseSAT Journals
 
PPT_Management of Large and Complex Software Projects
PPT_Management of Large and Complex Software ProjectsPPT_Management of Large and Complex Software Projects
PPT_Management of Large and Complex Software ProjectsSudipta Das
 
Excel In Managing Spreadsheet Risk Presentation
Excel In Managing Spreadsheet Risk PresentationExcel In Managing Spreadsheet Risk Presentation
Excel In Managing Spreadsheet Risk Presentationgreghawes
 
Подборка о рисках ИТ-проектов
Подборка о рисках ИТ-проектовПодборка о рисках ИТ-проектов
Подборка о рисках ИТ-проектовAlexey Ivasyuk
 
ACHIEVING PROJECT SUCCESS THROUGH EFFECTIVE PROJECT REQUIREMENTS ELICITATION
ACHIEVING PROJECT SUCCESS THROUGH EFFECTIVE PROJECT REQUIREMENTS ELICITATIONACHIEVING PROJECT SUCCESS THROUGH EFFECTIVE PROJECT REQUIREMENTS ELICITATION
ACHIEVING PROJECT SUCCESS THROUGH EFFECTIVE PROJECT REQUIREMENTS ELICITATIONWILLIAM YAMOAH
 
Agile software development and challenges
Agile software development and challengesAgile software development and challenges
Agile software development and challengeseSAT Publishing House
 
Pm0011 project planning and scheduling
Pm0011  project planning and schedulingPm0011  project planning and scheduling
Pm0011 project planning and schedulingsmumbahelp
 
Deloitte Tech Trends 2014 Technical Debt
Deloitte Tech Trends 2014 Technical DebtDeloitte Tech Trends 2014 Technical Debt
Deloitte Tech Trends 2014 Technical DebtCAST
 
risk management: a better approach
risk management: a better approachrisk management: a better approach
risk management: a better approachMadhumanti Samaddar
 
IRJET- Risk Management in Residential Project by Primavera Software
IRJET- Risk Management in Residential Project by Primavera SoftwareIRJET- Risk Management in Residential Project by Primavera Software
IRJET- Risk Management in Residential Project by Primavera SoftwareIRJET Journal
 
A potential pitfalls_of_process_modeling_part_a-1
A potential pitfalls_of_process_modeling_part_a-1A potential pitfalls_of_process_modeling_part_a-1
A potential pitfalls_of_process_modeling_part_a-1Jean-François Périé
 
My Scaled Scrum: Integrating Mega Framework and DAD
My Scaled Scrum: Integrating Mega Framework and DADMy Scaled Scrum: Integrating Mega Framework and DAD
My Scaled Scrum: Integrating Mega Framework and DADEswar Publications
 

La actualidad más candente (19)

Impact of Covid-19 on Business and Workforce
Impact of Covid-19 on Business and WorkforceImpact of Covid-19 on Business and Workforce
Impact of Covid-19 on Business and Workforce
 
Presentation by rahul ghodke
Presentation by rahul ghodkePresentation by rahul ghodke
Presentation by rahul ghodke
 
IT Executive Survey: Strategies for Monitoring IT Infrastructure & Services
IT Executive Survey: Strategies for Monitoring IT  Infrastructure & ServicesIT Executive Survey: Strategies for Monitoring IT  Infrastructure & Services
IT Executive Survey: Strategies for Monitoring IT Infrastructure & Services
 
An Introduction to Extreme Programming (XP) Development Methodology Process i...
An Introduction to Extreme Programming (XP) Development Methodology Process i...An Introduction to Extreme Programming (XP) Development Methodology Process i...
An Introduction to Extreme Programming (XP) Development Methodology Process i...
 
Ciso organizational priorities to build a resilient bimodal it
Ciso organizational priorities to build a resilient bimodal itCiso organizational priorities to build a resilient bimodal it
Ciso organizational priorities to build a resilient bimodal it
 
Presentation by namit
Presentation by namitPresentation by namit
Presentation by namit
 
Architectured Centered Design
Architectured Centered DesignArchitectured Centered Design
Architectured Centered Design
 
Agile software development and challenges
Agile software development and challengesAgile software development and challenges
Agile software development and challenges
 
PPT_Management of Large and Complex Software Projects
PPT_Management of Large and Complex Software ProjectsPPT_Management of Large and Complex Software Projects
PPT_Management of Large and Complex Software Projects
 
Excel In Managing Spreadsheet Risk Presentation
Excel In Managing Spreadsheet Risk PresentationExcel In Managing Spreadsheet Risk Presentation
Excel In Managing Spreadsheet Risk Presentation
 
Подборка о рисках ИТ-проектов
Подборка о рисках ИТ-проектовПодборка о рисках ИТ-проектов
Подборка о рисках ИТ-проектов
 
ACHIEVING PROJECT SUCCESS THROUGH EFFECTIVE PROJECT REQUIREMENTS ELICITATION
ACHIEVING PROJECT SUCCESS THROUGH EFFECTIVE PROJECT REQUIREMENTS ELICITATIONACHIEVING PROJECT SUCCESS THROUGH EFFECTIVE PROJECT REQUIREMENTS ELICITATION
ACHIEVING PROJECT SUCCESS THROUGH EFFECTIVE PROJECT REQUIREMENTS ELICITATION
 
Agile software development and challenges
Agile software development and challengesAgile software development and challenges
Agile software development and challenges
 
Pm0011 project planning and scheduling
Pm0011  project planning and schedulingPm0011  project planning and scheduling
Pm0011 project planning and scheduling
 
Deloitte Tech Trends 2014 Technical Debt
Deloitte Tech Trends 2014 Technical DebtDeloitte Tech Trends 2014 Technical Debt
Deloitte Tech Trends 2014 Technical Debt
 
risk management: a better approach
risk management: a better approachrisk management: a better approach
risk management: a better approach
 
IRJET- Risk Management in Residential Project by Primavera Software
IRJET- Risk Management in Residential Project by Primavera SoftwareIRJET- Risk Management in Residential Project by Primavera Software
IRJET- Risk Management in Residential Project by Primavera Software
 
A potential pitfalls_of_process_modeling_part_a-1
A potential pitfalls_of_process_modeling_part_a-1A potential pitfalls_of_process_modeling_part_a-1
A potential pitfalls_of_process_modeling_part_a-1
 
My Scaled Scrum: Integrating Mega Framework and DAD
My Scaled Scrum: Integrating Mega Framework and DADMy Scaled Scrum: Integrating Mega Framework and DAD
My Scaled Scrum: Integrating Mega Framework and DAD
 

Destacado

The MUPPLE competence continuum
The MUPPLE competence continuumThe MUPPLE competence continuum
The MUPPLE competence continuumfridolin.wild
 
Women empowerment in agricultural value chains
Women empowerment in agricultural value chainsWomen empowerment in agricultural value chains
Women empowerment in agricultural value chainsAlexander Decker
 
OFO Presentation
OFO PresentationOFO Presentation
OFO Presentationbekkerd1
 
Financial planning process 1 powerpoint presentation slides ppt templates
Financial planning process 1 powerpoint presentation slides ppt templatesFinancial planning process 1 powerpoint presentation slides ppt templates
Financial planning process 1 powerpoint presentation slides ppt templatesSlideTeam.net
 
Petro marine energy services ltd invitacion
Petro marine energy services ltd invitacionPetro marine energy services ltd invitacion
Petro marine energy services ltd invitacionPetromarine Energy
 
Fundering marieke
Fundering mariekeFundering marieke
Fundering mariekedutch_girl2
 
Twenty Two Interesting Ways To Use Twitter In
Twenty Two Interesting Ways To Use Twitter InTwenty Two Interesting Ways To Use Twitter In
Twenty Two Interesting Ways To Use Twitter InRégis Vansnick
 
Softproof in der Druckvorstufe
Softproof in der DruckvorstufeSoftproof in der Druckvorstufe
Softproof in der DruckvorstufeSIGNUMcom
 

Destacado (19)

Bulletin 3 teacher day
Bulletin 3 teacher dayBulletin 3 teacher day
Bulletin 3 teacher day
 
My Web Side
My Web SideMy Web Side
My Web Side
 
The MUPPLE competence continuum
The MUPPLE competence continuumThe MUPPLE competence continuum
The MUPPLE competence continuum
 
Women empowerment in agricultural value chains
Women empowerment in agricultural value chainsWomen empowerment in agricultural value chains
Women empowerment in agricultural value chains
 
OFO Presentation
OFO PresentationOFO Presentation
OFO Presentation
 
Listing Yahoo Sem
Listing Yahoo SemListing Yahoo Sem
Listing Yahoo Sem
 
Case bbdo
Case bbdoCase bbdo
Case bbdo
 
Funny wedding pictures
Funny wedding picturesFunny wedding pictures
Funny wedding pictures
 
Financial planning process 1 powerpoint presentation slides ppt templates
Financial planning process 1 powerpoint presentation slides ppt templatesFinancial planning process 1 powerpoint presentation slides ppt templates
Financial planning process 1 powerpoint presentation slides ppt templates
 
Fotogimp2
Fotogimp2Fotogimp2
Fotogimp2
 
Innovación disruptiva no temeraria: Proyecto/Modelo EmprendEducador
Innovación disruptiva no temeraria: Proyecto/Modelo EmprendEducadorInnovación disruptiva no temeraria: Proyecto/Modelo EmprendEducador
Innovación disruptiva no temeraria: Proyecto/Modelo EmprendEducador
 
Sun2
Sun2Sun2
Sun2
 
Petro marine energy services ltd invitacion
Petro marine energy services ltd invitacionPetro marine energy services ltd invitacion
Petro marine energy services ltd invitacion
 
Accessing Professional Development Opportunities from OSEP's TA&D Network & B...
Accessing Professional Development Opportunities from OSEP's TA&D Network & B...Accessing Professional Development Opportunities from OSEP's TA&D Network & B...
Accessing Professional Development Opportunities from OSEP's TA&D Network & B...
 
BaCC Flowerdale
BaCC FlowerdaleBaCC Flowerdale
BaCC Flowerdale
 
Fundering marieke
Fundering mariekeFundering marieke
Fundering marieke
 
TSchoolz Powerd by TechCmantiX
TSchoolz Powerd by TechCmantiXTSchoolz Powerd by TechCmantiX
TSchoolz Powerd by TechCmantiX
 
Twenty Two Interesting Ways To Use Twitter In
Twenty Two Interesting Ways To Use Twitter InTwenty Two Interesting Ways To Use Twitter In
Twenty Two Interesting Ways To Use Twitter In
 
Softproof in der Druckvorstufe
Softproof in der DruckvorstufeSoftproof in der Druckvorstufe
Softproof in der Druckvorstufe
 

Similar a Six sigmaforsoftware

IRJET- Quality Audit of Public Building Project by using Six Sigma Techniques
IRJET- Quality Audit of Public Building Project by using Six Sigma TechniquesIRJET- Quality Audit of Public Building Project by using Six Sigma Techniques
IRJET- Quality Audit of Public Building Project by using Six Sigma TechniquesIRJET Journal
 
Introduction Of Six Sigma for IT & BPO by Vision Raval
Introduction Of Six Sigma for IT & BPO by Vision RavalIntroduction Of Six Sigma for IT & BPO by Vision Raval
Introduction Of Six Sigma for IT & BPO by Vision RavalVision Raval
 
Use of six sigma a practical approach
Use of six sigma a practical approachUse of six sigma a practical approach
Use of six sigma a practical approachTapasya123
 
Six Sigma as a Quality and Continuous Improvement Strategy
Six Sigma as a Quality and Continuous Improvement StrategySix Sigma as a Quality and Continuous Improvement Strategy
Six Sigma as a Quality and Continuous Improvement Strategyvivatechijri
 
Six Sigma Final
Six Sigma FinalSix Sigma Final
Six Sigma Finalanubhuti10
 
Secured Cloud ERP
Secured Cloud ERPSecured Cloud ERP
Secured Cloud ERPijbuiiir1
 
IRJET- Quality Improvement in Building Construction using Six Sigma
IRJET-  	  Quality Improvement in Building Construction using Six SigmaIRJET-  	  Quality Improvement in Building Construction using Six Sigma
IRJET- Quality Improvement in Building Construction using Six SigmaIRJET Journal
 
Lecture 13Application of Six Sigmain Service operati.docx
Lecture 13Application of Six Sigmain Service operati.docxLecture 13Application of Six Sigmain Service operati.docx
Lecture 13Application of Six Sigmain Service operati.docxsmile790243
 
IRJET- Application of Lean Six Sigma Principles
IRJET-  	  Application of Lean Six Sigma PrinciplesIRJET-  	  Application of Lean Six Sigma Principles
IRJET- Application of Lean Six Sigma PrinciplesIRJET Journal
 
what is FMEA and six sigma By Ihsanullah mansoor
what is FMEA and six sigma By Ihsanullah mansoorwhat is FMEA and six sigma By Ihsanullah mansoor
what is FMEA and six sigma By Ihsanullah mansoorihsan467
 
FME and Six sigma By Ihsanullah mansoor
FME and Six sigma By Ihsanullah mansoorFME and Six sigma By Ihsanullah mansoor
FME and Six sigma By Ihsanullah mansoorihsan467
 
FMEA and Six sigma By Ihsanullah mansoor
FMEA and Six sigma By Ihsanullah mansoorFMEA and Six sigma By Ihsanullah mansoor
FMEA and Six sigma By Ihsanullah mansoorihsan467
 
Six Sigma and its Methodology
Six Sigma and its Methodology Six Sigma and its Methodology
Six Sigma and its Methodology Ravi Vaishnav
 
Project office automation whitepaper
Project office automation whitepaperProject office automation whitepaper
Project office automation whitepaperComputer Aid, Inc
 
E Rev Max The Sigma Way
E Rev Max The Sigma WayE Rev Max The Sigma Way
E Rev Max The Sigma Waysanjay389
 
Six Sigma and Quality Management System
Six Sigma and  Quality Management SystemSix Sigma and  Quality Management System
Six Sigma and Quality Management SystemMariamKhan120
 
Continuous Delivery Operating Model for Insurers: Building a Software “Value-...
Continuous Delivery Operating Model for Insurers: Building a Software “Value-...Continuous Delivery Operating Model for Insurers: Building a Software “Value-...
Continuous Delivery Operating Model for Insurers: Building a Software “Value-...Cognizant
 

Similar a Six sigmaforsoftware (20)

IRJET- Quality Audit of Public Building Project by using Six Sigma Techniques
IRJET- Quality Audit of Public Building Project by using Six Sigma TechniquesIRJET- Quality Audit of Public Building Project by using Six Sigma Techniques
IRJET- Quality Audit of Public Building Project by using Six Sigma Techniques
 
Introduction Of Six Sigma for IT & BPO by Vision Raval
Introduction Of Six Sigma for IT & BPO by Vision RavalIntroduction Of Six Sigma for IT & BPO by Vision Raval
Introduction Of Six Sigma for IT & BPO by Vision Raval
 
Use of six sigma a practical approach
Use of six sigma a practical approachUse of six sigma a practical approach
Use of six sigma a practical approach
 
Six Sigma as a Quality and Continuous Improvement Strategy
Six Sigma as a Quality and Continuous Improvement StrategySix Sigma as a Quality and Continuous Improvement Strategy
Six Sigma as a Quality and Continuous Improvement Strategy
 
Six Sigma Final
Six Sigma FinalSix Sigma Final
Six Sigma Final
 
Secured Cloud ERP
Secured Cloud ERPSecured Cloud ERP
Secured Cloud ERP
 
AN OVERVIEW ON SIX SIGMA: QUALITY IMPROVEMENT PROGRAM
AN OVERVIEW ON SIX SIGMA: QUALITY IMPROVEMENT PROGRAMAN OVERVIEW ON SIX SIGMA: QUALITY IMPROVEMENT PROGRAM
AN OVERVIEW ON SIX SIGMA: QUALITY IMPROVEMENT PROGRAM
 
IRJET- Quality Improvement in Building Construction using Six Sigma
IRJET-  	  Quality Improvement in Building Construction using Six SigmaIRJET-  	  Quality Improvement in Building Construction using Six Sigma
IRJET- Quality Improvement in Building Construction using Six Sigma
 
Lecture 13Application of Six Sigmain Service operati.docx
Lecture 13Application of Six Sigmain Service operati.docxLecture 13Application of Six Sigmain Service operati.docx
Lecture 13Application of Six Sigmain Service operati.docx
 
IRJET- Application of Lean Six Sigma Principles
IRJET-  	  Application of Lean Six Sigma PrinciplesIRJET-  	  Application of Lean Six Sigma Principles
IRJET- Application of Lean Six Sigma Principles
 
what is FMEA and six sigma By Ihsanullah mansoor
what is FMEA and six sigma By Ihsanullah mansoorwhat is FMEA and six sigma By Ihsanullah mansoor
what is FMEA and six sigma By Ihsanullah mansoor
 
FME and Six sigma By Ihsanullah mansoor
FME and Six sigma By Ihsanullah mansoorFME and Six sigma By Ihsanullah mansoor
FME and Six sigma By Ihsanullah mansoor
 
FMEA and Six sigma By Ihsanullah mansoor
FMEA and Six sigma By Ihsanullah mansoorFMEA and Six sigma By Ihsanullah mansoor
FMEA and Six sigma By Ihsanullah mansoor
 
SIX SIGMA
SIX SIGMASIX SIGMA
SIX SIGMA
 
Six Sigma and its Methodology
Six Sigma and its Methodology Six Sigma and its Methodology
Six Sigma and its Methodology
 
Project office automation whitepaper
Project office automation whitepaperProject office automation whitepaper
Project office automation whitepaper
 
E Rev Max The Sigma Way
E Rev Max The Sigma WayE Rev Max The Sigma Way
E Rev Max The Sigma Way
 
Six Sigma and Quality Management System
Six Sigma and  Quality Management SystemSix Sigma and  Quality Management System
Six Sigma and Quality Management System
 
Six sigma - pimg
Six sigma - pimgSix sigma - pimg
Six sigma - pimg
 
Continuous Delivery Operating Model for Insurers: Building a Software “Value-...
Continuous Delivery Operating Model for Insurers: Building a Software “Value-...Continuous Delivery Operating Model for Insurers: Building a Software “Value-...
Continuous Delivery Operating Model for Insurers: Building a Software “Value-...
 

Último

Manual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance AuditManual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance AuditSkynet Technologies
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...AliaaTarek5
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demoHarshalMandlekar2
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterMydbops
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Scott Andery
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Mark Goldstein
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality AssuranceInflectra
 

Último (20)

Manual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance AuditManual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance Audit
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL Router
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
 

Six sigmaforsoftware

  • 1. Six Sigma for Software Dr. Thomas M. Fehlmann Euro Project Office AG, Zeltweg 50 CH–8032 Zurich, Switzerland phone: +41 44 253 1306 e-Mail: thomas.fehlmann@e-p-o.com Abstract Six Sigma has been very successfully applied in manufacturing. Is it also applicable to software, and ICT? Six Sigma is about cost reduction by eliminating defects. Six Sigma uses the following three principles: 1. Focus on customers 2. Process orientation 3. Leadership based on metrics Applying Six Sigma to software development makes software projects transparent to both management and customers. Transparency requires an important cultural change. As a result, after transparency is achieved, completing accurate project estimations while meeting both deadlines and customer requirements becomes a lot easier. This paper will explain to readers how to: - Achieve transparency; - Learn how to implement Six Sigma for managing software development projects; - Understand the six steps for managing software development projects and listen to an explanation of how it impacts software development, software testing, project management, and project controlling; - Discover the fundamentals for leadership, project management and SW architecture. In this paper we refer to a case study where Six Sigma has been successfully applied in software development. 1. What is Six Sigma? Does it apply to software? Since the early 90’ies, Six Sigma has been extensively used for achieving total customer satisfaction with innovative products at competitive price. Its objectives are to deliver products when promised, without delivered defects, early life failures, or failures during use. 1.1. The Six Sigma Approach Six Sigma [10] is about measuring defects in the value chain process in order to systematically reduce σ σ them and therefore the corresponding cost factors. Sigma (represented as σ) is a statistical term that measures the deviation from the target set. A process that executes on 6σ level will yield results within the tolerance interval with 99.99966% probability. Thus 6σ corresponds to only 3.4 defects per 1 million defect opportunities. A defect opportunity is tolerance a measurable process result that is critical to threshold customer satisfaction. Six Sigma is not team driven like TQM. It is a 6 6 management approach. Defect metrics are the main tool for leaders to impact cost and margin.
  • 2. All metrics are customer driven. A defect is only what affects customer satisfaction. Thus before you can start Six Sigma you need to know what your customer really needs. Six Sigma is process – oriented. The term “customer” refers to who is using the output of your process and this is not always the end–customer. It is thus important to define what “defect” exactly refers to, when using a Six Sigma approach. 1.2. Benefits using Six Sigma In manufacturing industry, hidden costs because of waste and rework in production processes are a major opportunity for cost savings. In Information and Communication Industry (ICT) this is even truer. When using every day’s Office applications, everybody knows how often the many defects in the software affect our Hidden costs productivity and effec- in % of turnover tiveness. For ICT projects, defect costs Services, Projects, ICT 40% are even more impor- 33% tant. There exist vari- 30% Average Organisation ous estimations that 15% identify hidden cost 20% Best in class due to defects in ICT, < 5% depending upon the 10% industry and applica- tion area. The famous 0% Sigma 0 1 2 3 4 5 6 CHAOS Report of the DPMO 500‘000 308‘537 66‘807 6‘210 233 3.4 Standish Group [12] (Defects per Million Opportunities) noted repeatedly that Source: Concepts, Innsbruck; GE; own measurements only about 20% of all ICT projects reach their targets. The rest will either be stopped (~30%) or miss important requirements such as functionality or deadlines (~50%). This means that we have an opportunity to get the benefits of ICT for significantly less cost, up to 30% or better. Indeed, organizations that use such an approach consistently report cost saving or margin improvements of this size. 1.3. Does it work for software? Nevertheless, there were only occasionally attempts to implement Six Sigma for software. Applying Six Sigma to software development makes product development and other projects transparent to both management and customers. However, transparency requires an important cultural change. We know from experience that bad communication is a major reason why projects fail, and software projects in particular. We expect from better transparency that meeting both deadlines and customer requirements becomes easier. The major problem with early Six Sigma attempts was that there was no connection of software metrics to economic success[6]. Counting mistakes and defects is not a clear indication if the software project is going to be successful (e.g. [4]). Other metrics like time-to-market and user friendliness are much more important in many application areas. Sometimes, reliability is of essence, but not always. There is no software metrics that serves all. It depends what kind of software we are developing or installing. Finding good metrics for software development or deployment is a major task in itself.
  • 3. 2. Why do we need Six Sigma For Software? Software today is responsible for most of the added value in products, and must be blamed for many of its failures. Even if the iron hook breaks, it may be the software embedded in the measurement instrument to blame for not having detected it in time. When in Germany the high speed intercity express train crashed into an overpass, it was software that didn’t detect the broken wheel ring well before the accident1. Mobile networks are suffering from not being able to provide interconnection to the Internet and interoperability between their own services. It is the software that fails. In e-Commerce and for making Web Services to work, security, reliability and fault tolerance are of essence. Software and business processes are not cooperating, as they should to make it profitable. Software is so ubiquitous that we must solve the software development problem to address a lot of other problems the society has. The Six Sigma approach is: Set the goal – Define Define the metrics – Measure Measure where you go – Analyse Improve your processes while you go – Improve Act immediately if going the wrong path – Control Throughout this talk, we talk about “software development”, however we not only intend writing new software, but also software integration, deployment, and maintenance, as long as it has the character of a project2. This means that there is a goal that can be reached or missed. Using Six Sigma, we want to measure how much we are going to miss that goal. 3. Implementing Six Sigma for Software In our experience with implementing Six Sigma for software we found the following three principles most useful: Principle No 1: Measure customer related metrics only - Use Combinatory Metrics to cover all topics Principle No 2: Adjust to moving targets - Your goals may need change; accept change and manage it accordingly Principle No 3: Enforce measurement - Do not enforce meeting targets The last principle is the most difficult one, because this is against the project manager’s carnet of duties. Indeed, this is what most often goes wrong in software projects: People want to enforce targets and consequently miss the goals. This is because setting targets that really lead to the goal is so difficult in software projects. Just consider the ever-lurking dilemma: Should we make the milestones, or do it right the first time such that we can later use the knowledge gained to proceed faster? Writing or implementing software is not just an engineering discipline but in essence it is knowledge transfer. 1 It should be noted that the Columbia accident was not due to software, but to organisational failure of not reacting to the problem indications that were indeed abundant. It is an interesting question how much ICT reliability and organisational culture interact. 2 Six Sigma for operation of a software – based system has similarities, including Combinatory Metrics.
  • 4. 3.1. Measure customer related metrics only The goal of Combinatory Metrics is to assign the value delivered to customers to all the deliverables produced during a project This is not straightforward for things like a concept, a software component, or a test execution during software development. Impact on customer is dependent from success factors that describe what topics do actually influence the impact on customers. We call these influencing factors “Critical To Quality” (CTQ). Thus we use QFD as a technique to combine metrics for different topics, especially if those metrics cannot be measured directly. 3.2. Adjust to moving targets After having learned how to derive measurable targets from goals using Combinatory Metrics, we must face the fact that neither goals nor targets are as stable as should be in a well-controlled development environment. Disturbances such as new requirements, new insights, new technology, and new risks and threads force us to adapt to moving targets. One of the most common misunderstandings is that goals once set are not to be changed. Six Sigma is not about sacred goal setting. Six Sigma needs a metric system that adjusts to moving targets. 3.3. Enforce measurement Every project manager in the world (if he knows his job) will easily keep to any deadline you set to him, by reducing scope and quality of the deliverable. Software engineers are less good in that because they fear rework. Most problems in software development projects arise from that fundamental discourse. In the end, the customer will not get what he needs. The answer to that dilemma is to monitor true work progress using objective evidence for work completion. This is done using the Six Steps to Completion metric. 4. Successful applications of Six Sigma The following section uses references GMC Software AG, a small Swiss-owned niche company that delivers software for personalized digital printing for a worldwide market. They serve businesses with large customer bases, but with limited resources. As a niche company, they are strongly customer oriented. The software is written in a software development office located in Hradec Králové, Czech Republic. Their customers want to combine flexibility with reliability and ease-of-use, thus in 2001, GMC set the target of reaching CMM 4 for their software development processes. 4.1. Six Steps to Completion A deliverable is a uniquely defined and validated work result. The project consists of a sequence of deliverables. Measuring the degree of completion for the deliverables that are needed for the project goals makes it possible to understand the project’s progress as a whole. We can measure time line, cost and quality targets. Every deliverable must go through six steps. Among these are draft, review, and finalization before approval and usage. It is possible to get objective evidence to identify the six development steps by recording the first draft version, the review findings, the final version, and the distribution list. Even for complex projects, such an overview is extremely helpful. We calculate a progress index that indicates overall progress and compare with planned and actual resource consumption. This metric enables the responsible project manager to assess whether he can meet the
  • 5. schedule commitments, and thus identifies the measures. The assessment is based on objective evidence for progress, namely the planned quality assurance activities that must go with the deliverable. Input Assignment Assignment Template Template Idea Idea Draft Draft Review Review Finalization Finalization App- App- App- Operations Operations roval roval Output Draft version Draft version Review report Review report Release Release Distribution Distribution Each of the six steps needs a percentage of the total duration. We set3 10% for the idea, 30% for the draft, 15% for review, 20% for finalization, 15% to get approval, and 10% to make it operational. This progress grid yields progress metrics that can be accumulated for every project. Note that this metric is about duration and has not much to do with effort. The side effect is that you have to plan for review and approval, which is part of quality assurance. Another side effect is that computing Earned Value and other project management metrics becomes much more reliable. Quality records from reviews and tests provide objective evidence for the completion of a task, if the task has a deliverable. Pending item lists are no longer needed to cope with unfinished tasks [9]. When using an integrated development with a document management repository, the state of the deliverable is monitored automatically. GMC’s Czech development office has integrated all their task management in Bugzilla [2], an open source environment. Reports and progress metrics are produced automatically, without bothering the developers. Planned schedules are now met regularly, without pain. The defect count is how many deadlines committed to customers are missed. 4.2. Quality Function Deployment However, meeting deadlines does not yet mean satisfied customers and success on the market. Six Sigma asks for customer orientation and the corresponding metrics. However, impact on customers = strong relationship varies for different = medium relationship deliverables during a = weak relationship software development Goal Topic Critical To Quality (CTQ) Impact on Customers (Deliverable) process. Quality Function Deployment (QFD, [1]) is the method of choice when doing Design For Six Sigma. QFD provides tools to analyse the impact that design decisions have on customers. We want to assign the impact value 3 Initially the percentages were an educated guess but later experience proved it a good approximation.
  • 6. relative to customers to all the deliverables that are produced during a project. This is not straightforward for deliverables like a concept, a software component, or a test execution during software development. For this reason we use cause–effect matrices that quantify the impact on customer that is dependent from CTQs. These success factors are the parameters in the software development process that influences the result and thus have impact on customers. Such cause–effect influence constitutes a metric for the CTQs. 4.3. A Network of Deployments In turn, the CTQs constitute the goal topics on the next topic level. For instance, the CTQs for fulfilling the Customer’s Needs (CN) are the most important Solution Characteristics (SC) of the software. The solution characteristics result from the software development processes. The corresponding CTQs are the Key Process Areas (KPA) of the Capability Maturity Model (SW–CMM, [13]). Thus we get a chain of QFD deployments: KPA SC CN. This is the quality deployment chain, which we call the “Enablers”. There exist similar chains for the product deployment, or “Realizators”. Cost deployment for software development depends from Feature Costs (FC) and thus from project costing. Product Features (PF) impact the Business Objectives (BO) supported by the software, which in turn impacts Customer’s Needs (CN). The deployment chain reads FC PF BO CN. The third deployment chain is called the “Deciders”. Here we have influencing factors of various kinds such as market share, market segmentation, competition, readiness to pay, and customer perception. Most important is the New Lanchester theory that allows transforming market share data into a metric for competitive advantage as perceived by the prospects. Deciders Competitive Competitor’s Analysis Benefits Goal: Customer become Questionnaire No. One Customer’s Acceptance Customer Wishes Test Coverage Segments New Lanchester Acceptance Tests Customer’s Application Test Objectives Coverage Market Application Segments Tests Developer’s Customer’s Test Coverage Needs Developer’s Tests Business Solution Objectives Characteristics Enablers Product Realizators Features “House of Process Qualities” Landscape Business Objectives Feature SW Development Processes Deployment Costs Feature CMM Criteria Deployment Cause - Effect Start: Cost Measurement CMM Deployment Dependency No. 2 Asia Assessment No. 3 US Combinator QFD is well established as a technique to combine metrics for different topics, which cannot be measured directly. However, the QFD deployment matrices are not only good for design, they also provide a means to carry measurements over from topic to topic.
  • 7. 4.4. Combinatory Metrics The QFD matrices are cause–effect mappings between topics. The QFD matrices originate from Ishikava – diagrams that are used to visualise root cause analysis. Thus they always have a direction from the CTQs to its impact on the deliverables, not on the contrary4. You can consider the matrices as linear mappings that map the solution topic’s profile on the goal topics. When you choose a particular solution profile then this yields a corresponding goal’s profile, by applying the linear mapping defined by the matrix. We call the result “Effective Profile”. This compares with the original profile, the weights that we have set for the goal topics. Combinatory Metrics studies the difference between these two profiles. Cause-Effect Relationship St rong 9 Solution Characteristics Solution Topics Medium 3 Weak 1 Effective Profile (λi) Customer's Priorities for Keep to XSQL Standard Moderated Discussion Reliable Functionality Agile Programming Browser Style GUI Effective Impact Reusable classes Selection Crite ria Open Interfaces Active Portfolio φ(x) Management Extensions Goal Profile (ζi) Forum Known Goal Profile y 0.6 0 1 2 3 4 5 b.3 b.4 b.5 b.8 b.9 b.1 b.2 b.6 b.7 Customer's Needs a.1 Competency to answer inquiries 5.0 173 5.0 a.2 Confident iality 3.8 150 4.4 Goal Topics a.3 Suit ability for business needs 4.1 149 4.3 a.4 Short Development Cycles 3.9 128 3.7 a.5 Functionality where you need it 3.6 121 3.5 a.6 Social competency 3.8 130 3.8 a.7 Communicat ion 4.3 131 3.8 Raw Weight 128 104 93 143 86 118 115 114 161 161 Optimization Unknown Solution Solution Profile 5 4.0 3.2 2.9 4.4 2.7 3.7 3.6 3.5 5.0 Profile x 4 Suitable For Measurement Sum (ζ i -λi ) = 2 0.67 3 Convergence Factor 0.6 2 1 0 The two profiles coincide if the solution is ideal, that is, if the goal can be exactly reached with the given solution topics. This is normally not the case. In all other cases profiles differ; the Convergence Factor being a metric for the difference. The formula for the Convergence Factor is the length of the vector difference between measured weight and derived weight, divided by the number of profile coefficients. Let x be the solution profile and φ(x) = <λ1, …, λn> the corresponding effective profile. Then we may compare φ(x) with the goal profile y = <ζ1, …, ζn>. The corresponding Convergence Factor is the length of its vector difference y – x divided by the number of coefficients n, multiplied5 by 5: 5 * ( Σi=1…n (ζi – λi)2 )½ / n 4 This is a widespread wrong practice in QFD to calculate the profile of the CTQs out of the goal topic’s weight. Such calculation is mathematically wrong, but often yields results that approximate the solution sufficiently well [10]. The Convergence Factor must be checked to verify how well the approximation is. 5 With the factor 5 we measure the length of the difference vector with the same units as the weights itself. Thus a convergence factor of less than 1 indicates that its difference is tolerable because within the precision order of the QFD matrices.
  • 8. A Convergence Factor of zero means complete convergence; up to one it is considered acceptable. Convergence Factors greater than one indicate a significant difference between the deployed weight and the measured weight of the topic profile. To find the optimum solution profile you first have to find the solution components that yield something close to the goal profile, and then you may optimize the solution profile. 4.5. Combining Deployments and Measurements If you have an actual measurement for the solution topics, you can do the same profile calculation with the measured profile instead the optimum solution profile: Cause-Effect Relationship St rong 9 Medium 3 Weak 1 Solution Characteristics Measured Impact (µi) Effective Profile (λi) Keep to XSQL Standard Customer's Priorities for Effective Moderated Discussion Reliable Functionality Convergence Factor Agile Programming Deviation Browser Style GUI Reusable classes Se le ction Criteria Open Interfaces Active Portfolio Management Extensions Goal Profile (ζi) Forum 0.3 0.6 0 1 2 3 4 5 b.1 b.4 b.5 b.8 b.9 b.2 b.3 b.6 b.7 Customer's Needs a.1 Competency to answer inquiries 5.0 156 5.0 174 5.0 a.2 Confident iality 3.8 126 4.0 147 4.2 a.3 Suit ability for business needs 4.1 129 4.1 164 4.7 a.4 Short Development Cycles 3.9 117 3.7 133 3.8 a.5 Functionality where you need it 3.6 110 3.5 130 3.7 a.6 Social competency 3.8 117 3.7 133 3.8 a.7 Communicat ion 4.3 128 4.1 135 3.9 Me asurement 4.2 2.5 3.0 5.0 3.2 3.4 4.3 3.8 4.8 Ra w Weight 128 104 93 143 86 118 115 114 161 161 Process Optimization +24 -16 -40 -16 -56 -16 Maturity S olution Profile 4.7 2.7 2.9 4.4 1.4 3.2 3.6 1.8 4.5 5 Sum (ζ i -λi ) = 0.15 2 4 Suitable For Measurement C onvergence Factor 0.3 3 0.76 2 Sum (ζi-µi ) = 2 Effect. Deviation 0.6 1 2 Sum of (µi -λi ) = 0.46 0 Process Maturity Ga p 0.5 Now we can compare the measured with the optimum solution. This is the means to apply Six Sigma for Software. Defects for the Combinatory Metrics network are defined as differences between convergence factors and effective deviations that exceed 1. Although we have only few defect opportunities, the metric does indeed indicate how well the selected solutions for software development and for product characteristics meets customer’s needs and expectations. 4.6. Product Development Process Metrics Sum (ζi -λ i) 2 = 4.57 If we have QFD Combinators with suitable C onve rgence Factor 1.0 measurements, we can define two additional metrics Sum (ζi-µ i) 2 = 15.93 similar to the Convergence Factor. Let y be the goal profile, x the optimized solution Effect. Dev ia tion 1.8 profile and x0 the measured solution profile. Then φ(x) Sum of (µi-λi) = 2 6.91 is the effective goal profile and φ(x0) the measured Process Ma turity Gap 1.2 impact profile. With these three vectors we define three metrics:
  • 9. - Convergence Factor: The difference between goal profile ζ and effective goal profile λ shows how accurate the cause–effect – relationship is. It is a metric for the achievement of objectives under ideal conditions. - Effective Deviation: The difference between goal profile ζ and measured impact profile µ shows how well the target goals are effectively met. It is a metric for the achievement of objectives as perceived by others. - Process Maturity Gap: the difference between effective goal profile λ and measured impact profile µ shows the gap between what your development processes are aiming for and what they achieved in the real world. It is a metric for the maturity of your development process. The tolerance indicators in the above figure are set to green for a value below 1.0, yellow for a value between 1.0 and 1.5, and red for values above 1.5. Such metrics are useful for Six Sigma approaches; see [8], [11]. 4.7. Bug Count The third defect count is about bugs delivered to customers. We compare them to the number of bugs the quality assurance department had detected in–house for the same release version. As sample count we cite the bug count in the flagship product PrintNet T release 4.1 that comes to around σ ~ 3. The older product lines dwell around σ ~ 2; however, since the start of the software process improvement this is a tremendous improvement, where σ was well below 1, i.e. almost half of all defects were found by the customer. The green line indicates the number of bugs found by the customer, the black line is the number of bug reports created during the alpha-internal and beta test phase (the latter includes the support people in the sales offices, but not customers) 6. 5. Capability Maturity Model and Six Sigma for Software We have three kinds of metrics: • Progress track – project related • Combinatory metrics – product related • Bug count – quality related The Six Sigma metrics had been introduced as part of the CMM program, but with Six Sigma in mind. They were also instrumental to get the ISO 9001:2000 certificate in 6 Note that this defect count does not include defects found and removed before testing started. There are yet no size metrics available that allow for a better estimate of how many defects are taken out during developer’s testing and with code reviews. For the overall σ estimate we assume that development delivers features with a level of σ ~ 1; however, it may actually be higher.
  • 10. November 2003. Since all metrics are related to customer’s needs, they serve as well for Six Sigma. Based on these metrics, GMC reaches now a level well above 3σ7. Interestingly this corresponds roughly to the CMM – level. In the last self – assessment, GMC rated in summer 2003 for 3.12, up from 1.57 in winter 2000/2001 according the SW– CMM scale. There is certainly a relationship between the two metrics, and the relation is most probably linear, although it cannot be assumed that the relation is exactly one-to-one. Another relation is probably of more practical importance: GMC’s business results improved tremendously during the last year, and this was certainly not a linear relation. It has more the character of a break-through, as to be expected from a successful Six Sigma approach. The break-through had been correctly predicted by the New Lanchester theory [15] that is part of the Combinatory Metrics measurement points. 6. Organizational Considerations and Economic Impact 6.1. Project Office Establishing the metrics programme and the Combinatory Metrics network needs certainly a professional project office that cares for methods and tools and takes part in the project organisation. Professional project offices are a necessity for any organisation that wants to master the growing complexity in the ICT world with metrics – based improvement strategies such as Six Sigma. 6.2. Liability for Software Six Sigma metrics for software development allows assessing the risks connected with ICT. The implication of such ability is far – reaching. For instance, insurers can get reasonable evidence for the risk actually involved in software and start offering insurance package. Based on such insurance software manufacturers can start changing their licence terms and offer guarantees for the proper functioning of the software. Liability can be defined in terms of Six Sigma metrics. Such ability will change the market and probably make software engineering indeed the discipline we so often dream about. 6.3. Cost of ICT However, before this vision becomes true, the immediate benefit we get from any step towards Six Sigma For Software is that the cost of ICT can be dramatically reduced. Studies done in certain areas like e-Government suggest savings of up to 75% of today’s cost level; experiences with the progress tracking metrics in particular support that finding. This will not only change the ICT industry but also impact all others that depend from it. References [1] Akao Yoji. et.al: Quality Function Deployment (QFD); Productivity Press 1990, Portland, OR [2] Bugzilla Project Home Page http://www.bugzilla.org/ [3] Cohen, Lou: Quality Function Deployment. How to Make QFD Work for You, Prentice Hall PTR 1995, New Jersey, NJ [4] Fenton, Norman; Krause, Paul; Neil, Martin: A Probabilistic Model for Software Defect Prediction, IEEE Transactions on Software Engineering [5] Fehlmann, Thomas: Risk Exposure Measurements on Web Sites, in: 4th European Conference on Software Measurement and IT Control, FESMA, May 2001, Heidelberg, Germany [6] Fehlmann, Thomas: Business oriented testing in e-Commerce, in: Software Quality and Software Testing in Internet Times, April 2002, SQS AG, Köln, Germany 7 Since size metrics are yet missing, we cannot pretend a higher accuracy so we give no decimals.
  • 11. [7] Fehlmann, Thomas: Combinatory Metrics for Software Development, in: 8th International Symposium in QFD, September 2002, Munich, Germany [8] Fehlmann, Thomas: Strategic management by business metrics: an application of combinatory metrics, International Journal of Quality and Reliability Management, Vol. 20, No 1, 2003 pp. 134–145. [9] Fehlmann, Thomas: Metrics for Project Management, in: 14th Annual UK Software Metrics Association Tutorials and Conference, August 2003, Wolverhampton, UK. [10] Fehlmann, Thomas: Linear Algebra for QFD Combinators, in: 9th International Symposium on QFD, December 2003, Orlando, FL [11] Snee, Ronald: Leading Six Sigma: A Step-by-Step Guide Based on Experience with GE and Other Six Sigma Companies, Financial Times Prentice Hall 2002 [12] The Standish Group: CHAOS Chronicles v3.0, 1994 – 2003, http://www.standishgroup.com/chaos/toc.php [13] Humphrey, Watts: Managing the Software Process, Addison Wesley Longman, Reading 1989, MA [14] Mizuno, Shigeru, and Akao, Yoji (ed. 1994): QFD: The Customer-Driven Approach to Quality Planning and Deployment, translated by Glenn Mazur, Tokyo: Asian Productivity Organization [15] Taoka, Nobuo: Lanchester Strategy – An Introduction, Lanchester Press Inc 1997