2. Not everything that counts can
be counted, and not everything
can be counted counts.
Albert Einstein
All rights reserved by ACM www.acm-software.com
3. Key Elements of Agile Metrics
§ Measure outcomes, not individual activity
§ Working software is the primary measure of progress
§ Our highest priority is to satisfy the customer through
early and continuous delivery of valuable software
§ Establish data driven decision making culture and trigger a
learning organization via high level of transparency
All rights reserved by ACM www.acm-software.com
4. Examples of Good & Bad Metrics
§ User Satisfaction
§ Revenue / Feature
§ Feature CycleTime
§ Post Production Defect Rate
§ % of Features Completed
§ Release Frequency
§ Lines of Code
§ Hours Worked
§ Number of Defects Found
In Development
All rights reserved by ACM www.acm-software.com
5. 3 Levels For EnhancingVisibility
Organizational Level Metrics
Team Level Metrics
Team Performance
All rights reserved by ACM www.acm-software.com
6. Agile organizations need to use few, Lean metrics to watch their
overall health.These metrics needs to focus on three main areas:
time to market, value and innovation.
Organizational Level Metrics
Time to
Market
Ability to
Innovate
Value
All rights reserved by ACM www.acm-software.com
7. Time to Market Metrics
% of Completion; track completion in project level, epic
level, according to release plan, etc. In order to do so, use
Product Backlog Item level story point rolling estimations.
§ Closed § In Progress § Remaining
50 100 150 200 250 300 350 400 450 500
Call Center
Upgrade
Project
Cloud Call
Center
Project
Call Center
Automation
Story Points
All rights reserved by ACM www.acm-software.com
8. Time to Market Metrics
SmallTask & Project CycleTime (time between the start
date and production); track in portfolio level, business
domain level, etc
01 02 03 04 05 06 07 08 09
Months
Portfolio A avg
Portfolio B avg
Portfolio C avg
10
20
30
40
50
60
70
80
90
100
110
120
Days
All rights reserved by ACM www.acm-software.com
9. Time to Market Metrics
Project Lead Time (time between the request occurrence
date and production); track in portfolio level, business
domain level, etc
01 02 03 04 05 06 07 08 09
Months
Portfolio A avg
Portfolio B avg
Portfolio C avg
10
20
30
40
50
60
70
80
90
100
110
120
Days
All rights reserved by ACM www.acm-software.com
10. Time to Market Metrics
Project Flow (# of delivered projects, throughput); track in
portfolio level, business domain level, etc
01 02 03 04 05 06 07 08 09
25
50
100
125
150
175
200
225
250
275
Number
Months
All rights reserved by ACM www.acm-software.com
11. Time to Market Metrics
SmallTask Flow (# of delivered small tasks, throughput);
track in portfolio level, business domain level, etc
01 02 03 04 05 06 07 08 09
5
20
40
60
80
Number
Months
All rights reserved by ACM www.acm-software.com
12. Value Metrics
Human Capital Allocation; % of resource allocated
(realised) to strategic projects, tactical projects, small
tasks, etc
01 02 03 04 05 06 07 08 09
Strategic
Projects
Tactical
Projects
SmallTasks
10
20
30
40
50
60
70
80
90
100
%
Months
All rights reserved by ACM www.acm-software.com
13. Ability to Innovate Metrics
# of Post Prod Defects; track in portfolio level,
business domain level, etc
01 02 03 04 05 06 07 08 09
25
50
100
125
150
175
200
225
250
275
Number
Months
All rights reserved by ACM www.acm-software.com
14. Ability to Innovate Metrics
Prod Defect Solution Avg.Time; track in portfolio
level, business domain level, etc
Months
01 02 03 04 05 06 07 08 09
10
20
30
40
50
60
70
80
90
100
110
120
Hours
All rights reserved by ACM www.acm-software.com
15. Ability to Innovate Metrics
Innovation Rate; track in portfolio level, business
domain level, etc
01 02 03 04 05 06 07 08 09
10
20
30
40
50
60
70
80
90
%
Months
100
All rights reserved by ACM www.acm-software.com
16. Transparency must be triggered from bottom up via teams.
Therefore, teams should make their Sprint progress visible to
every related parties.
Team Level Metrics
Reliability metrics; planning accuracy ratio,
emergency ratio
Ability to Innovate metrics; defect rate,
innovation rate
Value metrics; customer satisfaction,
team happiness
T2M metrics; project lead time, project cycle
time, small task cycle time, # of small tasks
delivered
All rights reserved by ACM www.acm-software.com
18. Team PerformanceVisibility
Agile performance evaluation tends to enhance KAIZEN and
learning.Therefore, a team oriented performance enhancement
model should be developed that increases the transparency inside
the team and leads to a learning organization.
Method Weight Frequency Owner Supporter
Delivery Success
Component
Quantitative
Metrics 45% Bi Annually Team
Group Product
Leader
Teamwork Component
Kaizen
Achievement 15% Quarterly Team
Group Product
Leader
Self Development
Component
360 Degree
Feedback 20% Quarterly Team Agile Studio
Direct Report
Feedback 20% Bi Annually Team
Group Product
Leader
All rights reserved by ACM www.acm-software.com