Outcomes Based Contracting resource - logic model and Results Based Accountability framework. Taken from the draft Partnering in Procurement Document developed by the Western Australian Council of Social Service and WA Health
A PPT on digital India initiative by Government of India
Program Logic
1. Defining and Measuring
Outcomes
Getting Clear on the Basics
Adapted from the Outcomes Based
Contracting Guideline of the Health
Partnership Council project
2. Contracting Language
The first step in defining outcomes is to understand the commonly used terms:
Term Definition as developed from the Health Partnership Council Project in 2014
Inputs Financial, human and material resources used to deliver a service
Outputs The direct services, activities or intervention provided
Output Indicator A measure to quantify the services provided e.g. number of workshops run
Service Outcomes A change that occurs as a direct result of the service. This is likely to be a short to medium
term change; usually a change in skills, knowledge, behaviour, actions or attitudes
Outcome Indicator Information collected to monitor progress towards achievement of an outcome, often
expressed as a percentage
Community Outcomes Benefits for specific groups of people in the community that come about through changes in
the community itself – changes in status or life conditions for organizations, systems,
neighbourhoods, and networks
Impacts The significant, long-term, sustained effect of an activity on the fabric of the community and
well-being of the individuals and families and/or community
3. Program Logic Basics
The Program Logic model diagram below is a commonly used framework that shows a
logical flow from the situation you are trying to address through to the outcome you are
trying to achieve. This framework is also know as Theory of Change and maps the
Contracting Language definitions into a logical flow.
4. Program Logic Basics
To develop a Program Logic
Model, a simple process of
asking “So what?” in relation to
an activity will progressively get
to the heart of the outcome
you are trying to achieve. As
you can see from this example
below, each "so what?"
question digs deeper - from
output (what you do) to
outcome (the difference you
make). It also progresses from
the service outcome, which is
typically short term and related
to the service you provide, to
the community level outcome
which will be supported by a
range of factors beyond your
service.
5. Mapping Program Logic to
Contracting Language
The So What? questions can be mapped onto a Program Logic grid as per below. The Child Health Nurse is
an input, the Output is both the Mother's Group and who attends.
The Service Outcome is a short term outcome directly connected with the service, and the Community
Outcome is a longer term outcome your mothers may experience – it is important to note that a range of
factors outside your service will have support this community outcome.
7. Measuring Outcomes
Outcome measurement is a key tool for evaluation, and ensures that key aspects of
programs can be accurately measured. Evaluation of outcomes enables lessons to
be learnt, strengths to be built upon, and for future planning and policies to be
properly informed.
For some CSOs, measuring outcomes is a new process which requires thought and
planning. How outcomes are evaluated and measured need to be discussed and
agreed WA Health and the CSO at the service agreement planning stage.
Continuing with the mother’s group example, see the next 2 slides for possible
service outcomes indicators, and how to measure them.
8. Measuring Outcomes
Service Outcome Indicator Some options for collecting
this information
1. New mothers feel
connected to people who
share their experience
% increase of women who
report being more connected
with other mothers
On an intake form, ask women a question
such as:
“How much do you agree with this
statement” I feel connected with
other new mothers”
Strongly Disagree/
Disagree/Neutral/Agree/Strongly
Agree
At the end of the program, on the
evaluation form, ask the same question:
“How much do you agree with this
statement” I feel connected with
other new mothers”
Strongly Disagree/
Disagree/Neutral/Agree/Strongly
Agree
9. Measuring Outcomes
Service Outcome Indicator Some options for collecting
this information
1. New mothers report
feeling confident in their
new role as a mother
% increase of women who
report being more confident
after the group
Utilise a pre-post intake form, asking
women a question such as:
“How confident do you feel as a new
mother”
Very Under-confident/ Somewhat
Under-confident /Neutral/Somewhat
Confident/ Very Confident
Six months after the group, contact
group members by phone for a
response to the question “Looking
back, how much do you agree with
the statement that attending the
group has had a lasting impact on
your confidence as a parent?
Strongly Agree/ Agree
/Neutral/Disagree/Strongly
Disagree.
10. Who is responsible for what?
When working with WA government agencies, it is important to note how the
responsibilities are divided both in how inputs, outputs and outcomes are
determined, and who is responsible for achieving them:
Inputs Outputs Output
Indicators
Service
Outcome
Service
Outcome
Indicator
Community
Outcome
Who is responsible for determining these?
Community
Both CSOs and
Service
Government
Organisations
(Negotiable)
(CSOs)
Both CSOs and
Government
(Negotiable)
Both CSOs and
Government
(Negotiable)
Both CSOs and
Government
(Negotiable)
Government
in consultation
with CSO and
consumers/
carers
Who is responsible for achieving these?
Community
Service
Organisations
(CSO
CSOs CSOs CSO CSO Government
11. Over to you
Ideally a Program Logic process is undertaken with staff and Board input
to support an organisation articulating what they do and why.
Allow at least half a day and executive staff and Board members, as well
as consumers and carers if appropriate.
There are many online resources for undertaking this such as;
http://www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html
Check the WACOSS Measuring Outcomes project web page for updates
on our project which helps navigate through the many tools available.