1. UNIVERSIDAD DE LAS FUERZAS
SUBJECT: SOCIO EDUCATIONAL PROJECT
TUTOR: DR. MIGUEL PONCE
THEME: PART III. PROJECT EVALUATION
MONTESDEOCA BENITEZ DIANA PRISCILA
PACHACAMA SIMBAÑA DAYSI ALEXANDRA
2. Part III. Project Evaluation
The goal is to create
projects that can
serve as models of
basics of evaluation,
from types of
ways of collecting
provide guidance in
using evaluation as a
3. What is Project Evaluation?
In the course of
implementing a project
various types of information
In the course of
implementing a project
evaluation provides project
coordinators with well-
documented and considered
evidence to support the
The evaluation can
determine whether or not
the objectives have been
Spotlight on B-WET (Bay
Watershed Education &
Training)is an environmental
education program that
learning through local
competitive grants. The goal
is to support existing
programs, foster new
programs, and encourage
partnerships in providing
For teachers in utilizing
MWEEs in their
(MWEEs) to students as well
as professional development
4. Why is Evaluation Important to
Project Design and Implementation?
• Participants are core to the success of the project depend on the degree to which
participants benefit directly, short-term and long-term, from the experiences or
• Project strengths and weaknesses can be identified through an evaluation.
• This information can be used to re-design the project and increase both
efficiency and effectiveness.
• An evaluation can be used to promote the products and services of the project
within and outside of the agency based on evaluation results will be viewed as
more substantial and justifiable.
• Evaluation results are often used in the process of determining if a project should
be continued, scaled backed, discontinued, or enhanced.Funding
• Projects evolve over time. An evaluation can help clarify the purposes of the
project, allowing decision-makers to examine project components against well-
thought out criteria.
• An evaluation will provide opportunities for skillbuilding and learning. These
insights can be used to inform a strategic examination of projects and programs
by identifying priorities, overlap, gaps, and model programs.
• Based on experiences with the project and information taken from research
literature, the evaluation provides an opportunity to revisit the theory behind the
Clarifying Project Theory
• Project is going and what it has been able to accomplish compared to
expectations. Taking stock is more than accumulating information about the
project – it is learning through the project
5. Planning an Evaluation
• Should be reexamined and used
as a road map for planning the
evaluation. With the logic model
and the associated performance
objectives in hand, evaluation
planners will be able to
articulate how the project is
supposed to work.
Step 1. Reexamine the
issue, audience, and project
• Project managers, resource
managers, staff members,
volunteers, participants, and
community members all have a
stake in the overall success of
Step 2. Establish the
planning team (including
stakeholders, audience, and
• If the purpose is to assess the
extent to which a program is
operating as planned or to
collect evidence of progress
toward the outcomes identified
in the TOP model then a process
or implementation evaluation is
called for on.
Step 3. Identify a purpose
for the evaluation
6. Step 4. Focus on project
This type of evaluation focuses on
what services are provided and to
whom and how. The intent is to
strengthen the program by providing
feedback on its implementation,
progress, and success.
Process evaluation can be used to:
*Gather information/data about an
audience’s reaction to project
activities or products/ materials.
*Gather information/data about
problems with project delivery and
assess progress towards outcomes of
a project during implementation
Implementation evaluation include:
*Are the project resources (time,
money, expertise) being utilized as
*Are the intended activities, products,
or services being provided? What
promotional strategies worked or
*How extensively is the audience
engaged in project activities?
*Do participants perceive immediate
benefits from their participation in the
7. Step 5. Assess project
outcomes and impacts
Three levels of the programming staircase
(knowledge, attitudes, skills, and aspirations
(KASA) The project team should select levels of
evaluation based on the type of information
needed to evaluate the project accurately
Results of an outcome evaluation
provide the information
necessary to make decisions
about the continuation, revision,
or expansion of the project.
Outcome evaluation include:
*Did the participants increase
awareness, knowledge, and or
assesses the extent to
which those project
targets are reached.
*Did participants change their
opinions, attitudes, or viewpoints
as intended a result of the KASAs
learned during their participation
in the project? (Practice). Have
targeted social, economic, or
improved as a result of KASA
8. Step 6. Clarify the time frame in
which the activities and impacts
(outcomes) are expected to
•The evaluation timeline must be
integrated into the project
implementation timeline and
• Planning and implementing an
evaluation can take several
•Sufficient care must be given to
the development of the
evaluation timeline to ensure
Step 7. Perform a literature
•Research into evaluation
processes, practices, and
standards is useful. This is
particularly true if the
evaluation team does not
include an outside evaluation
•In designing an evaluation it is
helpful to identify the related
literature and use this literature
as a touchstone.
•Existing sources of information
(previous evaluations, census
data, reports, budgets, etc.)
should be tapped.
Step 8. Select data collection
methods and develop questions
based on the evaluation goals
•The evaluation team has
determined why an evaluation
is being conducted, who will
conduct it, what will be
evaluated, who will be
evaluated, and when the
evaluation will take place.
•Each of these decisions begins
to define the type of evaluation
and the data collection
9. Data Collection
Step 9. Determine the audience sample
-The preferred method for selecting
a subset is random sampling – a
procedure that reduces sample bias
by selecting a sample that
accurately reflects the population.
-A sample represents the
population if every person in the
population has an equal chance of
-To reduce sampling errors, make
the sample as large as possible in
terms of time and money.
-Basic questions: *How many
audiences do you wish to sample?
*How many individuals do you hope
to assess? *How can you best reach
the audience to collect data?
Step 10. Design and pilot the data collection instrument
-To consider a series of questions to
design the data collection
instrument: How important is
statistical precision? How important
is in-depth information about one
or more aspects of the project?
How will data collection be
standardized? Is contact
information on target audience(s)
available? What method of data
collection would the audience be
most receptive to? How many
questions can be asked?
-To design an instrument that is
appealing to the eye, simple to use,
contains complete and explicit
instructions, and collects the
Step 11. Gather and record data
-The evaluation team will need to
determine how data will be
collected and recorded, and by
-A system of coding and recording
the data must be developed to
ensure easy and accurate data
-May be necessary to train
interviewers, focus group
facilitators, and/or observers.
10. Data Analysis and Reporting
Step 14. Synthesize information and create a report
-After the data have been collected and analyzed, an
evaluation report must be written.
-There are standard components to any evaluation report,
for example, the report must include a description of the
evaluation methods used.
-The report must include a discussion of the problems
encountered and errors made with the design and
implementation of data collection instruments or tools.
Step 13. Manage data
-After reading the evaluation report, decision-makers, other
stakeholders, and other evaluators may generate questions
that can be answered by revisiting the data.
-It is important to develop a plan for continued access to
-If data are to be retained for some period of time, the
project team must also make certain that the
confidentiality and anonymity of respondents is
Step 12. Perform data analysis
-Have a plan in place for how to analyze, synthesize, store,
and manage the data before starting the data collection.
-Develop a plan to guarantee an unbiased analysis and
reporting of the data.
-Always start analyzing the collected data with a review of
the evaluation goals and objectives.
-Make copies of all data, and store a master copy of the
original data in a safe place.
-For qualitative data, anticipate responses (the pilot test
will help with this), and have a plan for categorizing and
coding the data.
11. Who Should Conduct the
evaluation planning process decision will need to be made
planning process, the decision will need to be made hire
an outside evaluator.
the decision may have been made for the team
managers require contract an outside evaluator
13. educators used
the program could
gathering the same
type of evaluation
feedback form is
others believe it is a
Does evaluation really matter?
14. Evaluation Costs
size and complexity of
5 to 15%
existing data has
16. Part III Wrap-Up
Evaluation should be built
into the plans
for a project
from the start