Results-Based Accountability (RBA) 101 overview for presentations in Syndey Australia 2014 Conference

1. FPSI/RLG 1
The Five W’s and How of
Results-Based Accountability™
Social Outcomes
Measurement Conference
Sydney, AU
Adam Luecking
Results Leadership Group
www.resultsleadership.org
MEASURABLE RESULTS
FOR CLIENTS AND COMMUNITIES

2. MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Agenda
• Results-Based Accountability:
Who, what, when, where, why &
how?
• Questions and Answers

3. MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Why RBA
To implement the 5 conditions of Collective Impact
• Common language
• Shared measurement systems
• Mutually reinforcing activities
• Continuous communication
• Backbone support organization

4. MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Why RBA
To create Measurable Impact
Measurable
Impact
aka
Turning the
Curve

5. MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Why RBA
To know you are making a difference

6. MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Why RBA
To bring precision to your passion
How much did we do?How well did we do it?Is anyone better off?

7. MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Where RBA?

8. MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Who RBA?

9. MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

10. MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

11. MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

12. MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

13. MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
How RBA?
•Introduction to core concepts
•Population Accountability
•Performance Accountability
•Turn the Curve Thinking
•Tie it all Together

14. MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
Two Key Principles for
Achieving Measurable
Impact
1. Starting with ends, working
backwards to means
2. Data-driven,
transparent Decision Making

15. MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
2 -- Kinds of Accountability
3 - Kinds of Performance Measures.
• How much did we do? • How well did we do it? • Is anyone better
off?
7 - Questions from ends to means in less than
an hour (aka. Turn the Curve Thinking)
• Population accountability • Performance accountability
RBA in a Nutshell
2-3-7

16. FPSI/RLG 16
Results-Based
Accountability
is made up of two parts:
about the well-being of
CLIENT POPULATIONS
about the well-being of
WHOLE POPULATIONS
Population Accountability
Performance Accountability
For Communities – Cities – Counties – States - Nations
For Programs – Agencies – and Service Systems
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

17. FPSI/RLG 17
DEFINITIONDEFINITION
SS RESULTRESULT
INDICATORINDICATOR
PERFORMANCE MEASUREPERFORMANCE MEASURE
Children succeeding in school, Safe communities,
Clean environment
Rate of high school graduation, Crime rate, Air quality
index
1. How much did we do?1. How much did we do?
2. How well did we do it?2. How well did we do it?
3. Is anyone better off?3. Is anyone better off?
A condition of well-being for children, adults, families or communities.
A measure which helps quantify the achievement of a result.
A measure of how well a program, agency or service system is working.
POPULATIONPOPULATION
ACCOUNTABILITYACCOUNTABILITY
PERFORMANCEPERFORMANCE
ACCOUNTABILITYACCOUNTABILITY
Three types:Three types:
Language
Discipline[ ]
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

18. FPSI/RLG 18
Why Distinguish Population from
Performance Accountability?
ENDS
MEANS
RESULT
&
INDICATORS
A STRATEGY
&
PERFORMANCE MEASURES
Customer
result
Service
delivery
A question
of
versus
Ends
Means
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

19. FPSI/RLG 19
Interagency
System
Program A
Comprehensive Strategy/Partners
Agency/Program
Performance Measures
Interagency Service System
Performance Measures
ENDMEANS
Indicator
Children Live in Safe
And Stable Homes
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES
1. Doing the
right things?
1. Doing the
right things?
2. Doing those things right?2. Doing those things right?

20. Population
Accountability
FPSI/RLG 20
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

21. FPSI/RLG 21
Population
+ Geographic Area
+ Condition of Well Being
= Result
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

22. Populations?
• All people in Sydney
• All Australians
• All children prenatal to 5 years old
• People with developmental disabilities
• People that enjoy water sports
FPSI/RLG 22
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

23. Geographic Area?
• Australia
• New South Wales
• Sydney
• Glebe
FPSI/RLG 23
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

24. Conditions of
Well Being?
• Healthy
• Safe
• Living with Dignity
• Economically Secure
• Succeeding in School
FPSI/RLG 24
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

25. FPSI/RLG 25
Selecting
Indicators
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

26. FPSI/RLG 26
Criteria for
Selecting Indicators
Communication Power
Proxy Power
Data Power
Does the indicator communicate to a broad range of audiences?
Does the indicator say something of central importance about the result?
Does the indicator bring along the data HERD?
Quality data available on a timely basis.
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

27. FPSI/RLG 27
Choosing Indicators
Worksheet
Result_______________________
Candidate Indicators
Communication
Power
Proxy
Power
Data
Power
H M LMeasure 1
Measure 2
Measure 3
Measure 4
Measure 5
Measure 6
Measure 7
Measure 8
H
Data
Development
Agenda
H M L H M L
H L
H H H
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

28. Performance
Accountability
FPSI/RLG 28
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

29. Selecting
Performance
Measures
FPSI/RLG 29
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

30. FPSI/RLG 30
How
much did
we do?
The Three Kinds of Program Performance Measures
How well
did we do
it?
Is anyone
better off?
Quantity QualityEffectEffort
# %
RBA Guide
Page 7
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

31. FPSI/RLG 31
Selecting Headline Performance Measures
How much did we do?
# Clients/customers served
# Activities
(by type of activity)
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

32. FPSI/RLG 32
Selecting Headline Performance Measures
How much did we do?How well did we do it?
% Common measures
e.g. workload ratio, staff
turnover rate, % staff fully
trained, unit cost
% Activity-specific measures
e.g. % timely intakes, %
accreditation standards met
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

33. RLG 33
Selecting Headline Performance Measures
How well did we do it?
Is anyone better off?
#/% Skills / Knowledge
(e.g. cognitive, social, physical)
#/% Attitude
(e.g. toward language, parenting)
#/% Behavior
(e.g. reading to child at home)
#/% Circumstances
(e.g. child care, transportation)
How much did we do?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

34. FPSI/RLG 34
How much did we do?
Health Plan or Practice
How well did we do it?
Is anyone better off?
Number of
patients
treated
Percent of
patients treated
in less than
1 hour
Quantity Quality
EffectEffort
#
children
fully
immunized
%
children
fully
immunized
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

35. FPSI/RLG 35
How much did we do?
Education
How well did we do it?
Is anyone better off?
Quantity Quality
EffectEffort
Number of
students
Student-teacher
ratio
Number of
high school
graduates
Percent of
high school
graduates
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

36. FPSI/RLG 36
How much did we do?
Fire Department
How well did we do it?
Is anyone better off?
Number of
responses
Response
Time
Number of fire
related deaths
(in catchment)
Rate of
fire deaths
per 100,000
Quantity Quality
EffectEffort
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

37. FPSI/RLG 37
How much did we do?
Not All Performance Measures Are Created Equal
How well did we do it?
Is anyone better off?
Least
Important
Quantity QualityEffectEffort
2nd
Most
Important
3rd
Most
Important
Most
Important
Least
Most
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

38. How much did we
do?
The Matter of Control
How well did we do
it?
Is anyone better off?
Quantity Quality
EffectEffort
LeastControl
PARTNERSHIPS
MostControl
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

39. Turn the Curve
Thinking™
FPSI/RLG 39
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

40. FPSI/RLG 40
Story behind the baseline
Partners (with a role to play in turning the curve)
What Works
Strategy (w/ Budget)
Result or Program:
Data
Baseline
How are
we doing?
Why?
Help?
Options?
Propose
to do?
Turn-the-Curve Thinking™: Talk to Action
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

41. FPSI/RLG 41
Result or Program:____________
Turn-the-Curve Thinking™ Talk to Action
Data Baseline
How are
we doing?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

42. FPSI/RLG 42
The Matter of Baselines
Baselines have two parts: history and forecast
History Forecast
Turning the Curve
OK?
Return* on
Investment
* The “ROI” is not financial, it is Results
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

43. FPSI/RLG 43
Data
Baseline
Result or Program:_____________
Turn-the-Curve Thinking™: Talk to Action
Story behind the baseline Research AgendaWhy?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

44. FPSI/RLG 44
Force Field Analysis
Factors Contributing?
Factors Restricting?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

45. FPSI/RLG 45
The Story Behind the Baseline
 Root Causes (ask “Why?” five
times)
 Positive and negative
 Prioritize – which are the most
important to address to “turn the
curve” of the baseline?
 Research agenda?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

46. FPSI/RLG 46
Data
Baseline
Story behind the baseline
Result or Program:_____________
Research Agenda
Turn-the-Curve Thinking™ Talk to Action
Partners (with a role to play in turning the curve)Help?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

47. FPSI/RLG 47
Partners
 Who are partners who may have
a role to play in turning the
curve?
 Does the story behind the curve
suggest any new partners?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

48. FPSI/RLG 48
Data Baseline
Story behind the baseline
Partners (with a role to play in turning the curve)
Result or Program:______________
Research Agenda
Turn-the-Curve Thinking™: Talk to Action
What Works Research AgendaOptions?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

49. FPSI/RLG 49
What Works
 Options for actions to “turn the
curve”?
 Research-based?
 Low-cost/no-cost?
 Off-the-wall ideas?
 Research agenda?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

50. FPSI/RLG 50
Data Baseline
Story behind the baseline
Partners (with a role to play in turning the curve)
What Works
Result or Program: _______________
Research Agenda
Research Agenda
Turn-the-Curve Thinking™: Talk to Action
Criteria: Leverage; Feasible; Specific; Values
Strategy
Propose
to do?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

51. FPSI/RLG 51
Action Plan
 Leverage: will turn the curve of the
baseline?
 Feasible (a.k.a. “reach”)?
 Specific: who, what, when, where, how?
 Consistent with values?
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

52. Population
and
Performance
Accountability
FPSI/RLG 52
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

53. Results and
Indicators
Result: to which you contribute to most directly.
Indicators:
Story:
Partners:
What would it take?:
Your Role: as part of a larger strategy.
Population Accountability
Program:
Performance measures:
Story:
Partners:
Action plan to get better:
Performance Accountability
Service Systems,
Agencies, Divisions,
Programs and
Performance
Measures
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

54. FPSI/RLG 54
State,
Region, City,
Neighborhood …
E.g., Interagency
Collaboration
Agency
Population
Accountability
Performance
Accountability
Performance
Accountability
Organization
with
“System”
with
Community with a
its clients
its clients
whole population
Population and Performance Accountability: Agency
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

55. A Schematic for Results-Based
Budgeting and Grant Making
RLG/FPSI 55
1.Community Result
2.Indicators
3.Story Behind the Baselines
4.Strategy
Programs
Program A
Program B
Program C
Local __________
Federal __________
Businesses _________
Civic __________
Non-profits _________
Program A
Performance Measures
Story Behind the
Baselines
• Action Plan & Budget
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

56. Management, Budgeting & Strategic Planning
Management
Monthly or quarterly
performance
assessment and action
planning using the
framework./steps.
Use framework / steps
at all levels of
implementation in
the agency.
RLG/FPSI 56
Budgeting
Use the Performance
Report format for
budget hearings and
budget submissions to
present current
performance and what
will be done next year to
improve.
Budget priorities
informed by the
Strategic Plan
Strategic
Planning
Population Level Results &
Indicators, comprehensive
strategy among and all
stakeholders
Agency Level
Each department’s role in
comprehensive strategy.
Agency’s multi-year
priorities.
PopulationAccountability
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

57. Management, Budgeting & Strategic Planning
Management
Monthly or quarterly
performance
assessment and
action planning using
the
framework./steps.
Use framework /
steps at all levels of
implementation in
the agency.
RLG/FPSI 57
Budgeting
Use the Performance
Report format for
budget hearings and
budget submissions to
present current
performance and what
will be done next year to
improve.
Budget priorities
informed by the
Strategic Plan
Strategic
Planning
Population Level Results &
Indicators, comprehensive
strategy among all
stakeholders
Agency Level
Agency’s role in
comprehensive strategy.
Agency’s multi-year
priorities.
Program
Accountability
Program
Accountability
Program
Accountability
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

58. FPSI/RLG 58
Agency/Division/Program
AGENDA
1. New data
2. New story behind the curve
3. New partners
4. New information on what works.
5. Changes to action plan/ budget
6. Adjourn
MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

59. When RBA?
Now!