Performance Management With Rational Insight - Karthi D
1. Introduction to Performance Measurement with IBM
Rational Insight
Karthikeyan Dakshinamurthy
Senior Software Engineer, Rational Insight Development
2. Businesses are facing an unparalleled rate of change
Manage business Enable business
transformations flexibility
Differentiate Exploit
products globalization
React to Manage regulatory
market shifts mandates
Deliver real
customer innovation
Successful businesses will use software
to drive innovation and competitive differentiation
2
3. Challenges to the effective delivery of software
A history of cost overruns, schedule slips and quality issues
“34% of software projects are deemed
successful costing $300B annually” “49% of budgets suffer overruns and
62% fail to meet their scheduled”
“Only 22% of executives felt that their IT and
business strategy were tightly integrated”
“50% of outsourced projects are
expected to under perform”
30% of project costs are due to rework
and poor execution of requirements”
Growing focus
on business outcomes
“Business leaders and CIOs are under pressure to enable their teams to become
catalysts for change. However, change is outpacing their ability to deliver.
They are reorienting their teams to focus on ROI and quantified
business outcomes and to mitigate risk and reduce costs.”
– IBM CIO Survey, 2008
3
4. Continuous improvement is difficult due to lack timely
information and in-context insight
“2/3 of executives make more than half “77% of managers are aware of
of their decisions based on ‘gut feel’ bad decisions made due to lack
rather than verifiable information” of access to accurate information”
“Poor decisions have generated
revenue 75% or more
below expectations”
Lack of timely information
and in-context insight
Disparate data Lack of relevant, Inability to baseline Inability to measure
sources, formats, timely actionable and benchmark and assess
and definitions information status and progress unobtrusively
4
5. Challenges with current reporting solutions for software
delivery
Lack of connectivity to live data: status data
input manually into PM tools
Disparate data
sources, formats,
and definitions Result: disconnect between planning and execution
Reporting is limited to only part of the ALM
Lack of relevant, lifecycle (e.g. test, requirements…)
timely actionable
information But current Result: Creating blind spots with no way to objectively assess
reporting progress in a collaborative, globally distributed ALM environment
solutions
fall short
Inability to baseline Weak management of report changes
and benchmark
status and progress
Result: Information is outdated, not linked to business outcomes
Inability to measure No framework or best practices to convert data
and assess into information
unobtrusively
Result: Cannot manage performance without clear understanding of
what to measure and benchmark
5
6. Do You Have the Information You Need to Make the Right Decisions?
Activity Models Alerts
management space
Businesses need a mechanism to: Plan Monitor
⌦ Reduce cost of information gathering
⌦ Reduce risk by identifying trends before they
become issues
⌦ Align SSD activities with strategic and
operational objectives
Improve
Dashboards
Value Measures
Key Performance Indicators
But are still struggling with:
⌦ Combining data from heterogeneous sources
engineering space
⌦ Managing by exception
⌦ Analyzing actual progress against planned
objectives and past performance
⌦ Implementing proven and repeatable processes
to achieve expected business results In-house Outsource Packaged App
Projects Projects Projects
6
7. Introducing IBM Rational Insight
Automated project and process
measurement can improve team
productively by 15%
Monitor and analyze project and process
performance Real-time
information in a
Collaborate across disparate development single view across
artifacts and in the context of operational and projects, products
business objectives and geographies
Automate measurement leveraging an open
RESTful and Jazz compliant data integration
architecture
“Until now we were gathering metrics by manual methods.
Report on relevant data with a built-in library Rational Insight simplifies the presentation... Overall great
of industry best practice metrics and tool to have for optimizing project efforts and giving
management a birds eye view of the project performance
dashboards at all stages.”
Drive business innovation and reduce costs
through measures and continuous process
improvement “Through the automation and dashboard capabilities in Insight,
our team is saving over 40 hours a month on our reporting
Built on best in class business intelligence activities. We also can offer new capabilities such as “on-
platform from IBM Cognos demand” dashboards which would have been very labor
intensive to do without Insight”
7
8. IBM Rational Insight Companies that don’t
measure, experience poor
Improved Executive Decision Making staff morale and cannot
accurately estimate cost
Provides at-a-glance, high - Capers Jones (2009)
impact views of complex real-
time information
CxO
Helps quick focus on systems
and software delivery issues Reduce cost and risk by
mapping operational activities to
that need attention and action strategic initiatives
Alignment between actual
results and planned business
goals
Includes executive measures
tailored to your needs:
Cost, Revenue, Time-to-ROI, Key
Performance Indicator (KPI)
specific to Line of Business
8
9. Companies that don’t
IBM Rational Insight measure have “unknown”
Continually Improve Your Process defect removal rate and low
user satisfaction
Evaluate Historical Data for - Capers Jones (2009)
Lessons Learned and Corrective
Action Process Lead
Leverage Industry-leading Drive business innovation and
reduce costs through measured
management techniques with process improvement
ready to use dashboards and
reports
Report on the quality and
performance of your projects with
built-in measures
Measuring Quality, Time-to-Value,
Productivity
You can’t Improve what you don’t Measure
9
10. IBM Rational Insight Only 45% of projects
that do not measure,
Improved Project Level Decision Making deliver products on-
time to market
- Capers Jones (2009)
Get your projects up and running
quickly with library of metrics and
built-in collectors Project Manager
Gain insight into development
Leverage Rational domain projects which span
expertise for systems and organizational and geographic
software development and boundaries
delivery
Monitor the status and progress
of your projects with built-in
measures:
Iteration Velocity, Project Backlog,
Requirements Volatility, Defect
Density…
10
11. Collaborate across disparate development artifacts
In the context of business objectives
Portfolio
Management
CxO
Project
Management Rational
Requirements
Insight
Management
Architecture
Management
Process Lead
Change
Management
Configuration
Management
Build
Management
Quality Project Manager
Management
12. Unify Disparate Data Sources into Objective Dashboards
with Rational Insight
ClearCase Measured Capability
Insight Improvement Framework
(MCIF)
RequisitePro
Best Practice
Guidance
Open Services for Lifecycle
Collaboration
XML
ClearQuest Quality Manager
Single View into Your
Organizational Performance
MS Project TestManager
Team Concert 3rd Party
Partners
12
13. Rational Insight Architecture
Architecture Change
Requirements Management Management Configuration
Project Management Management
Build
Management Management
Portfolio Quality
Management Management
REST API - native REST API – adapter
XML DB
XML – ODBC Mapping | DB Access
Open Data Architecture
DataStream DataStream
Reporting Server
Enterprise Data Warehouse
Industry Proven Reporting Extract, Transform, Load Data Warehouse
Server
Metadata
Self Service
CxO Process Lead Project Manager Report Authoring
14. Rational Insight Performance Measurement Solution
Practitioners work in geographically
distributed teams using
heterogeneous environments
(Rational, Microsoft, HP, etc.)
Data is automatically collected from
tool repositories and aggregated into
the BI reporting data warehouse
Rational
Data Cognos 8.4 BI reporting engine
Warehouse provides report authoring,
management, security, scheduling,
bursting, delivery, etc. May be
extended with additional Cognos
Reportable REST API / XML ODBC components.
Out-of-the-box reports and
dashboards aligned with MCIF
ClearQuest TestManager RQM
performance management initiatives
ClearCase XML RTC
RequisitePro MS Project HP Quality Cntr
15. Rational Insight Architecture – DW Report Execution
Legacy
Products
ClearQuest
ClearCase
RequisitePro
…
Jazz-based
Products
Rational Insight
RTC(ODBC) Reporting Server
R
Rational Insight Data Services
RQM E
WebSphere Application
S
T Rational-branded
…
Cognos Web Portal UI
Server 6.1
S Cognos 8 BI Rational
Telelogic e ODBC
Reporting Services Data Warehouse
Products r
DOORS v Cognos 8 BI
i Data Manager
FocalPoint c
e WebSphere Application
… s Server 6.1
3rd Party
Products
MS Project
…
16. Rational Insight Architecture – Live Data Report Execution
Legacy
Products
ClearQuest
ClearCase
RequisitePro
…
Jazz-based Rational Insight
Products
R Reporting Server
Rational Insight Data Services
RTC(ODBC) E
WebSphere Application
S
RQM T Rational-branded
Cognos Web Portal UI
…
Server 6.1
S Cognos 8 BI Rational
e REST Get Reporting Services
r
Data Warehouse
Telelogic
Products v Cognos 8 BI
i Data Manager
DOORS c
e WebSphere Application
FocalPoint
s Server 6.1
…
3rd Party
Products
MS Project
…
17. Rational Insight Architecture – ETL Process
Legacy
Products
ClearQuest
ClearCase
RequisitePro
…
Jazz-based Rational Enterprise
Products
R Reporting Server
Rational Insight Data Services
RTC(ODBC) E
WebSphere Application
S
RQM T Rational-branded
Cognos Web Portal UI
…
Server 6.1
S Cognos 8 BI Rational
e REST Get Reporting Services ODBC
r
Data Warehouse
Telelogic
Products v Cognos 8 BI
i Data Manager
DOORS c
e WebSphere Application
FocalPoint
s Server 6.1
…
3rd Party
Products
MS Project
…
18. Rational Insight – Data Source/Data Warehouse/Reports
RTC
MS Project …..
ClearQuest RQM
ClearCase
RequisitePro DOORS
Web architecture to retrieve
product data in XML
RSA FocalPoint
(Insight Data Service)
RAM
ETL
Reporting data model isolates the data
warehouse low level table structures from
the report designer. The report designer is
presented with a simplified data structure
with all of the necessary relationships
resolved.
19. Rational Insight Architecture - Reports
Query Studio lets users with
little or no training quickly
design, create and save reports
to meet reporting needs not
covered by the standard,
professional reports created in
dio
y Stu Report Studio.
er
Qu
Re p Report Studio lets report authors create,
ort edit, and distribute a wide range of
Stu
dio professional reports. They can also define
corporate-standard report templates for use
in Query Studio, and edit and modify reports
created in Query Studio.
20. Summary
You cannot IMPROVE what
you cannot MEASURE!
Raise enterprise transparency to
reduce costs and risks by
mapping operational activities to
strategic objectives
Drive business innovation and
reduce costs through measured
and continuous process
improvement
Gain insight into development
projects which span
organizational and geographic
boundaries
20