Part III. Project evaluation

UNIVERSIDAD DE LAS FUERZAS
SUBJECT: SOCIO EDUCATIONAL PROJECT
TUTOR: DR. MIGUEL PONCE
THEME: PART III. PROJECT EVALUATION
STUDENTS:
MONTESDEOCA BENITEZ DIANA PRISCILA
PACHACAMA SIMBAÑA DAYSI ALEXANDRA
Part III. Project Evaluation
Introduction
The goal is to create
effective education
projects that can
serve as models of
excellence.
Development the
basics of evaluation,
outlining everything
from types of
evaluations and
ways of collecting
information project
evaluation and
provide guidance in
using evaluation as a
project
improvement tool
What is Project Evaluation?
In the course of
implementing a project
various types of information
are gathered.
In the course of
implementing a project
evaluation provides project
coordinators with well-
documented and considered
evidence to support the
decision-making process.
The evaluation can
determine whether or not
the objectives have been
met.
Spotlight on B-WET (Bay
Watershed Education &
Training)is an environmental
education program that
supports experiential
learning through local
competitive grants. The goal
is to support existing
programs, foster new
programs, and encourage
partnerships in providing
“meaningful.
For teachers in utilizing
MWEEs in their
environmental experiences”
(MWEEs) to students as well
as professional development
opportunities
Why is Evaluation Important to
Project Design and Implementation?
• Participants are core to the success of the project depend on the degree to which
participants benefit directly, short-term and long-term, from the experiences or
services
Participants
• Project strengths and weaknesses can be identified through an evaluation.
• This information can be used to re-design the project and increase both
efficiency and effectiveness.
Project Improvement
• An evaluation can be used to promote the products and services of the project
within and outside of the agency based on evaluation results will be viewed as
more substantial and justifiable.
Public Relations
• Evaluation results are often used in the process of determining if a project should
be continued, scaled backed, discontinued, or enhanced.Funding
• Projects evolve over time. An evaluation can help clarify the purposes of the
project, allowing decision-makers to examine project components against well-
thought out criteria.
Improved Delivery
• An evaluation will provide opportunities for skillbuilding and learning. These
insights can be used to inform a strategic examination of projects and programs
by identifying priorities, overlap, gaps, and model programs.
Capacity Building
• Based on experiences with the project and information taken from research
literature, the evaluation provides an opportunity to revisit the theory behind the
project.
Clarifying Project Theory
• Project is going and what it has been able to accomplish compared to
expectations. Taking stock is more than accumulating information about the
project – it is learning through the project
Taking Stock
Planning an Evaluation
Planning
• Should be reexamined and used
as a road map for planning the
evaluation. With the logic model
and the associated performance
objectives in hand, evaluation
planners will be able to
articulate how the project is
supposed to work.
Step 1. Reexamine the
issue, audience, and project
objectives
• Project managers, resource
managers, staff members,
volunteers, participants, and
community members all have a
stake in the overall success of
the project
Step 2. Establish the
planning team (including
stakeholders, audience, and
evaluators)
• If the purpose is to assess the
extent to which a program is
operating as planned or to
collect evidence of progress
toward the outcomes identified
in the TOP model then a process
or implementation evaluation is
called for on.
Step 3. Identify a purpose
for the evaluation
Step 4. Focus on project
improvement
This type of evaluation focuses on
what services are provided and to
whom and how. The intent is to
strengthen the program by providing
feedback on its implementation,
progress, and success.
Process evaluation can be used to:
*Gather information/data about an
audience’s reaction to project
activities or products/ materials.
*Gather information/data about
problems with project delivery and
assess progress towards outcomes of
a project during implementation
Implementation evaluation include:
*Are the project resources (time,
money, expertise) being utilized as
planned? (Resources)
*Are the intended activities, products,
or services being provided? What
promotional strategies worked or
failed? (Activities)
*How extensively is the audience
engaged in project activities?
(Participation)
*Do participants perceive immediate
benefits from their participation in the
activities? (Reactions
Step 5. Assess project
outcomes and impacts
Three levels of the programming staircase
(knowledge, attitudes, skills, and aspirations
(KASA) The project team should select levels of
evaluation based on the type of information
needed to evaluate the project accurately
Results of an outcome evaluation
provide the information
necessary to make decisions
about the continuation, revision,
or expansion of the project.
Outcome evaluation include:
*Did the participants increase
awareness, knowledge, and or
problem-solving skills?
Outcome evaluation
assesses the extent to
which those project
targets are reached.
*Did participants change their
opinions, attitudes, or viewpoints
as intended a result of the KASAs
learned during their participation
in the project? (Practice). Have
targeted social, economic, or
environmental conditions
improved as a result of KASA
Step 6. Clarify the time frame in
which the activities and impacts
(outcomes) are expected to
occur
•The evaluation timeline must be
integrated into the project
implementation timeline and
vice versa.
• Planning and implementing an
evaluation can take several
months.
•Sufficient care must be given to
the development of the
evaluation timeline to ensure
effectiveness.
Step 7. Perform a literature
search
•Research into evaluation
processes, practices, and
standards is useful. This is
particularly true if the
evaluation team does not
include an outside evaluation
expert.
•In designing an evaluation it is
helpful to identify the related
literature and use this literature
as a touchstone.
•Existing sources of information
(previous evaluations, census
data, reports, budgets, etc.)
should be tapped.
Step 8. Select data collection
methods and develop questions
based on the evaluation goals
and objectives
•The evaluation team has
determined why an evaluation
is being conducted, who will
conduct it, what will be
evaluated, who will be
evaluated, and when the
evaluation will take place.
•Each of these decisions begins
to define the type of evaluation
and the data collection
instruments.
Data Collection
Step 9. Determine the audience sample
-The preferred method for selecting
a subset is random sampling – a
procedure that reduces sample bias
by selecting a sample that
accurately reflects the population.
-A sample represents the
population if every person in the
population has an equal chance of
being selected.
-To reduce sampling errors, make
the sample as large as possible in
terms of time and money.
-Basic questions: *How many
audiences do you wish to sample?
*How many individuals do you hope
to assess? *How can you best reach
the audience to collect data?
Step 10. Design and pilot the data collection instrument
-To consider a series of questions to
design the data collection
instrument: How important is
statistical precision? How important
is in-depth information about one
or more aspects of the project?
How will data collection be
standardized? Is contact
information on target audience(s)
available? What method of data
collection would the audience be
most receptive to? How many
questions can be asked?
-To design an instrument that is
appealing to the eye, simple to use,
contains complete and explicit
instructions, and collects the
desired data.
Step 11. Gather and record data
-The evaluation team will need to
determine how data will be
collected and recorded, and by
whom.
-A system of coding and recording
the data must be developed to
ensure easy and accurate data
analysis.
-May be necessary to train
interviewers, focus group
facilitators, and/or observers.
Data Analysis and Reporting
Step 14. Synthesize information and create a report
-After the data have been collected and analyzed, an
evaluation report must be written.
-There are standard components to any evaluation report,
for example, the report must include a description of the
evaluation methods used.
-The report must include a discussion of the problems
encountered and errors made with the design and
implementation of data collection instruments or tools.
Step 13. Manage data
-After reading the evaluation report, decision-makers, other
stakeholders, and other evaluators may generate questions
that can be answered by revisiting the data.
-It is important to develop a plan for continued access to
uncorrupted data.
-If data are to be retained for some period of time, the
project team must also make certain that the
confidentiality and anonymity of respondents is
maintained.
Step 12. Perform data analysis
-Have a plan in place for how to analyze, synthesize, store,
and manage the data before starting the data collection.
-Develop a plan to guarantee an unbiased analysis and
reporting of the data.
-Always start analyzing the collected data with a review of
the evaluation goals and objectives.
-Make copies of all data, and store a master copy of the
original data in a safe place.
-For qualitative data, anticipate responses (the pilot test
will help with this), and have a plan for categorizing and
coding the data.
Who Should Conduct the
Evaluation?
evaluation planning process decision will need to be made
planning process, the decision will need to be made hire
an outside evaluator.
the decision may have been made for the team
managers require contract an outside evaluator
Outside
evaluator
objective
third-party
fresh
perspective
professional evaluator
components
evaluation
in-house
expertise
outside evaluator should be
responsible for data analysis
and interpretation
educators used
feedback forms
the program could
be improved.
this way
commented, don´t
need more
information
gathering the same
type of evaluation
data
feedback form is
“an evaluation,”
others believe it is a
pre-test/post-test.
Does evaluation really matter?
Evaluation Costs
size and complexity of
the project
Recommended
5 to 15%
evaluation costs
evaluation
existing data has
its pitfalls
Ethics
participants are
not
embarrassed
Respectful data
collection is not
enough
respondents
understand that
they are
participating
Part III Wrap-Up
Evaluation should be built
into the plans
for a project
from the start
Project
evaluation
make decisions
investment of
time and
resources
Evaluation
results
justify
worthwhile
projects
to provide
more effective,
better targeted
1 de 16

Recomendados

How to-develop-a-monitoring-and-evaluation-plan por
How to-develop-a-monitoring-and-evaluation-planHow to-develop-a-monitoring-and-evaluation-plan
How to-develop-a-monitoring-and-evaluation-planHussain Bux Korejo
1.5K vistas17 diapositivas
Project M&E (unit 1-4) por
Project M&E (unit 1-4)Project M&E (unit 1-4)
Project M&E (unit 1-4)Regmi Milan
5.1K vistas34 diapositivas
Introduction to monitoring and evaluation Ungaluk Program 2015 por
Introduction to monitoring and evaluation Ungaluk Program 2015Introduction to monitoring and evaluation Ungaluk Program 2015
Introduction to monitoring and evaluation Ungaluk Program 2015Martin Comeau
1.7K vistas40 diapositivas
Collaborative 2 ingrid margarita and sandra por
Collaborative 2 ingrid margarita and sandraCollaborative 2 ingrid margarita and sandra
Collaborative 2 ingrid margarita and sandraSandra Guevara
131 vistas15 diapositivas
Project Monitoring and Evaluation por
Project Monitoring and Evaluation Project Monitoring and Evaluation
Project Monitoring and Evaluation Central University of Karnataka Kalaburagi
935 vistas14 diapositivas
Monitoring and evaluation por
Monitoring and evaluationMonitoring and evaluation
Monitoring and evaluationSudipta Barman
951 vistas35 diapositivas

Más contenido relacionado

La actualidad más candente

Developing-Monitoring-And-Evaluation-Framework-for-Budget-Work-Projects por
Developing-Monitoring-And-Evaluation-Framework-for-Budget-Work-ProjectsDeveloping-Monitoring-And-Evaluation-Framework-for-Budget-Work-Projects
Developing-Monitoring-And-Evaluation-Framework-for-Budget-Work-ProjectsNIDHI SEN
482 vistas82 diapositivas
Monitoring and evaluation Learning and Development por
Monitoring and evaluation Learning and DevelopmentMonitoring and evaluation Learning and Development
Monitoring and evaluation Learning and DevelopmentSESH SUKHDEO
2.8K vistas29 diapositivas
Project monitoring and evaluation by Samuel Obino Mokaya por
Project monitoring and evaluation by Samuel Obino MokayaProject monitoring and evaluation by Samuel Obino Mokaya
Project monitoring and evaluation by Samuel Obino MokayaDiscover JKUAT
6.5K vistas30 diapositivas
6 M&E - Monitoring and Evaluation of Aid Projects por
6 M&E - Monitoring and Evaluation of Aid Projects6 M&E - Monitoring and Evaluation of Aid Projects
6 M&E - Monitoring and Evaluation of Aid ProjectsTony
4K vistas38 diapositivas
THE ROLE OF THE BAORD IN MONITORING AND EVALUATION por
THE ROLE OF THE BAORD IN MONITORING AND EVALUATION THE ROLE OF THE BAORD IN MONITORING AND EVALUATION
THE ROLE OF THE BAORD IN MONITORING AND EVALUATION Mwiza Helen
1.9K vistas88 diapositivas
TTIPEC: Monitoring and Evaluation (Session 1) por
TTIPEC: Monitoring and Evaluation (Session 1)TTIPEC: Monitoring and Evaluation (Session 1)
TTIPEC: Monitoring and Evaluation (Session 1)Research to Action
5K vistas40 diapositivas

La actualidad más candente(20)

Developing-Monitoring-And-Evaluation-Framework-for-Budget-Work-Projects por NIDHI SEN
Developing-Monitoring-And-Evaluation-Framework-for-Budget-Work-ProjectsDeveloping-Monitoring-And-Evaluation-Framework-for-Budget-Work-Projects
Developing-Monitoring-And-Evaluation-Framework-for-Budget-Work-Projects
NIDHI SEN482 vistas
Monitoring and evaluation Learning and Development por SESH SUKHDEO
Monitoring and evaluation Learning and DevelopmentMonitoring and evaluation Learning and Development
Monitoring and evaluation Learning and Development
SESH SUKHDEO2.8K vistas
Project monitoring and evaluation by Samuel Obino Mokaya por Discover JKUAT
Project monitoring and evaluation by Samuel Obino MokayaProject monitoring and evaluation by Samuel Obino Mokaya
Project monitoring and evaluation by Samuel Obino Mokaya
Discover JKUAT6.5K vistas
6 M&E - Monitoring and Evaluation of Aid Projects por Tony
6 M&E - Monitoring and Evaluation of Aid Projects6 M&E - Monitoring and Evaluation of Aid Projects
6 M&E - Monitoring and Evaluation of Aid Projects
Tony 4K vistas
THE ROLE OF THE BAORD IN MONITORING AND EVALUATION por Mwiza Helen
THE ROLE OF THE BAORD IN MONITORING AND EVALUATION THE ROLE OF THE BAORD IN MONITORING AND EVALUATION
THE ROLE OF THE BAORD IN MONITORING AND EVALUATION
Mwiza Helen1.9K vistas
13 project monitoring and evaluation por rajkpandey2000
13 project monitoring and evaluation13 project monitoring and evaluation
13 project monitoring and evaluation
rajkpandey20007.3K vistas
Monitoring and Evaluation for Project management. por Muthuraj K
Monitoring and Evaluation for Project management.Monitoring and Evaluation for Project management.
Monitoring and Evaluation for Project management.
Muthuraj K3.2K vistas
Monotoring and evaluation principles and theories por commochally
Monotoring and evaluation  principles and theoriesMonotoring and evaluation  principles and theories
Monotoring and evaluation principles and theories
commochally6.7K vistas
CPE Monitoring and Evaluation por Samuel Baker
CPE Monitoring and EvaluationCPE Monitoring and Evaluation
CPE Monitoring and Evaluation
Samuel Baker2.3K vistas
Monitoring evaluation por Carlo Magno
Monitoring evaluationMonitoring evaluation
Monitoring evaluation
Carlo Magno1.9K vistas
Monitoring and evaluation of human rights projects por Inka Pibilova
Monitoring and evaluation of human rights projectsMonitoring and evaluation of human rights projects
Monitoring and evaluation of human rights projects
Inka Pibilova3.6K vistas
Almm monitoring and evaluation tools draft[1]acm por Alberto Mico
Almm monitoring and evaluation tools draft[1]acmAlmm monitoring and evaluation tools draft[1]acm
Almm monitoring and evaluation tools draft[1]acm
Alberto Mico925 vistas
An Introduction to Monitoring & Evaluation por Robin Beveridge
An Introduction to Monitoring & EvaluationAn Introduction to Monitoring & Evaluation
An Introduction to Monitoring & Evaluation
Robin Beveridge786 vistas
Module 7: Monitoring and Evaluation Dima course content por Michael Kenny
Module 7: Monitoring and Evaluation Dima course contentModule 7: Monitoring and Evaluation Dima course content
Module 7: Monitoring and Evaluation Dima course content
Michael Kenny121 vistas

Similar a Part III. Project evaluation

Project evaluation por
Project evaluationProject evaluation
Project evaluationPriscila Montesdeoca
167 vistas15 diapositivas
Collaborative work 2 Part 1 por
Collaborative work 2 Part 1Collaborative work 2 Part 1
Collaborative work 2 Part 1Fc2017
77 vistas16 diapositivas
Community engagement - what constitutes success por
Community engagement - what constitutes successCommunity engagement - what constitutes success
Community engagement - what constitutes successcontentli
588 vistas21 diapositivas
What is program evaluation lecture 100207 [compatibility mode] por
What is program evaluation lecture   100207 [compatibility mode]What is program evaluation lecture   100207 [compatibility mode]
What is program evaluation lecture 100207 [compatibility mode]Jennifer Morrow
5.3K vistas35 diapositivas
Projectmonitoring 1.pptx por
Projectmonitoring 1.pptxProjectmonitoring 1.pptx
Projectmonitoring 1.pptxMichaelJeo
5 vistas4 diapositivas
EDUCATIONAL PLANNING AND MANAGEMENT EDUC 712.pptx por
EDUCATIONAL PLANNING AND MANAGEMENT EDUC 712.pptxEDUCATIONAL PLANNING AND MANAGEMENT EDUC 712.pptx
EDUCATIONAL PLANNING AND MANAGEMENT EDUC 712.pptxwelfredoyu2
7 vistas31 diapositivas

Similar a Part III. Project evaluation(20)

Collaborative work 2 Part 1 por Fc2017
Collaborative work 2 Part 1Collaborative work 2 Part 1
Collaborative work 2 Part 1
Fc201777 vistas
Community engagement - what constitutes success por contentli
Community engagement - what constitutes successCommunity engagement - what constitutes success
Community engagement - what constitutes success
contentli588 vistas
What is program evaluation lecture 100207 [compatibility mode] por Jennifer Morrow
What is program evaluation lecture   100207 [compatibility mode]What is program evaluation lecture   100207 [compatibility mode]
What is program evaluation lecture 100207 [compatibility mode]
Jennifer Morrow5.3K vistas
Projectmonitoring 1.pptx por MichaelJeo
Projectmonitoring 1.pptxProjectmonitoring 1.pptx
Projectmonitoring 1.pptx
MichaelJeo5 vistas
EDUCATIONAL PLANNING AND MANAGEMENT EDUC 712.pptx por welfredoyu2
EDUCATIONAL PLANNING AND MANAGEMENT EDUC 712.pptxEDUCATIONAL PLANNING AND MANAGEMENT EDUC 712.pptx
EDUCATIONAL PLANNING AND MANAGEMENT EDUC 712.pptx
welfredoyu27 vistas
E. Socio-Educationa Project - Interactive Activity Group 3 por ESPE - UFA
E. Socio-Educationa Project - Interactive Activity Group 3E. Socio-Educationa Project - Interactive Activity Group 3
E. Socio-Educationa Project - Interactive Activity Group 3
ESPE - UFA79 vistas
Seda emdedding learning technologies evaluating and sustainability3 por BrianKilpatrick
Seda emdedding learning technologies   evaluating and sustainability3Seda emdedding learning technologies   evaluating and sustainability3
Seda emdedding learning technologies evaluating and sustainability3
BrianKilpatrick185 vistas
Performance Management to Program Evaluation: Creating a Complementary Connec... por nicholes21
Performance Management to Program Evaluation: Creating a Complementary Connec...Performance Management to Program Evaluation: Creating a Complementary Connec...
Performance Management to Program Evaluation: Creating a Complementary Connec...
nicholes21896 vistas
PDE Week 5: Developing an Evaluation Plan por kpravera
PDE Week 5: Developing an Evaluation PlanPDE Week 5: Developing an Evaluation Plan
PDE Week 5: Developing an Evaluation Plan
kpravera1.2K vistas
6. international-pen-guidance-notes-for-centres monitoring-and-evaluation por Folasayo Ayegbayo
6. international-pen-guidance-notes-for-centres monitoring-and-evaluation6. international-pen-guidance-notes-for-centres monitoring-and-evaluation
6. international-pen-guidance-notes-for-centres monitoring-and-evaluation
Folasayo Ayegbayo120 vistas
Botor_project_research_methodology_2016 por Shayne Botor
Botor_project_research_methodology_2016Botor_project_research_methodology_2016
Botor_project_research_methodology_2016
Shayne Botor234 vistas

Más de Priscila Montesdeoca

Iso 9001 2000 por
Iso 9001 2000Iso 9001 2000
Iso 9001 2000Priscila Montesdeoca
46 vistas21 diapositivas
ISO 9001 2000 por
ISO 9001 2000ISO 9001 2000
ISO 9001 2000Priscila Montesdeoca
19 vistas21 diapositivas
ISO 9001 2000 por
ISO 9001 2000ISO 9001 2000
ISO 9001 2000Priscila Montesdeoca
21 vistas21 diapositivas
Total Quality Management - Diana Priscila Montesdeoca Benitez por
Total Quality Management - Diana Priscila Montesdeoca BenitezTotal Quality Management - Diana Priscila Montesdeoca Benitez
Total Quality Management - Diana Priscila Montesdeoca BenitezPriscila Montesdeoca
81 vistas18 diapositivas
Interactive activity1 tqm_diana priscila montesdeoca benitez por
Interactive activity1 tqm_diana priscila montesdeoca benitezInteractive activity1 tqm_diana priscila montesdeoca benitez
Interactive activity1 tqm_diana priscila montesdeoca benitezPriscila Montesdeoca
35 vistas18 diapositivas
Design of quality management system in the Santa Maria center through the app... por
Design of quality management system in the Santa Maria center through the app...Design of quality management system in the Santa Maria center through the app...
Design of quality management system in the Santa Maria center through the app...Priscila Montesdeoca
57 vistas17 diapositivas

Último

A Guide to Applying for the Wells Mountain Initiative Scholarship 2023 por
A Guide to Applying for the Wells Mountain Initiative Scholarship 2023A Guide to Applying for the Wells Mountain Initiative Scholarship 2023
A Guide to Applying for the Wells Mountain Initiative Scholarship 2023Excellence Foundation for South Sudan
82 vistas26 diapositivas
NodeJS and ExpressJS.pdf por
NodeJS and ExpressJS.pdfNodeJS and ExpressJS.pdf
NodeJS and ExpressJS.pdfArthyR3
48 vistas17 diapositivas
PRELIMS ANSWER.pptx por
PRELIMS ANSWER.pptxPRELIMS ANSWER.pptx
PRELIMS ANSWER.pptxsouravkrpodder
50 vistas60 diapositivas
Collective Bargaining and Understanding a Teacher Contract(16793704.1).pptx por
Collective Bargaining and Understanding a Teacher Contract(16793704.1).pptxCollective Bargaining and Understanding a Teacher Contract(16793704.1).pptx
Collective Bargaining and Understanding a Teacher Contract(16793704.1).pptxCenter for Integrated Training & Education
106 vistas57 diapositivas
Career Building in AI - Technologies, Trends and Opportunities por
Career Building in AI - Technologies, Trends and OpportunitiesCareer Building in AI - Technologies, Trends and Opportunities
Career Building in AI - Technologies, Trends and OpportunitiesWebStackAcademy
45 vistas44 diapositivas
Creative Restart 2023: Leonard Savage - The Permanent Brief: Unearthing unobv... por
Creative Restart 2023: Leonard Savage - The Permanent Brief: Unearthing unobv...Creative Restart 2023: Leonard Savage - The Permanent Brief: Unearthing unobv...
Creative Restart 2023: Leonard Savage - The Permanent Brief: Unearthing unobv...Taste
55 vistas21 diapositivas

Último(20)

NodeJS and ExpressJS.pdf por ArthyR3
NodeJS and ExpressJS.pdfNodeJS and ExpressJS.pdf
NodeJS and ExpressJS.pdf
ArthyR348 vistas
Career Building in AI - Technologies, Trends and Opportunities por WebStackAcademy
Career Building in AI - Technologies, Trends and OpportunitiesCareer Building in AI - Technologies, Trends and Opportunities
Career Building in AI - Technologies, Trends and Opportunities
WebStackAcademy45 vistas
Creative Restart 2023: Leonard Savage - The Permanent Brief: Unearthing unobv... por Taste
Creative Restart 2023: Leonard Savage - The Permanent Brief: Unearthing unobv...Creative Restart 2023: Leonard Savage - The Permanent Brief: Unearthing unobv...
Creative Restart 2023: Leonard Savage - The Permanent Brief: Unearthing unobv...
Taste55 vistas
The Accursed House by Émile Gaboriau por DivyaSheta
The Accursed House  by Émile GaboriauThe Accursed House  by Émile Gaboriau
The Accursed House by Émile Gaboriau
DivyaSheta251 vistas
CUNY IT Picciano.pptx por apicciano
CUNY IT Picciano.pptxCUNY IT Picciano.pptx
CUNY IT Picciano.pptx
apicciano64 vistas
Narration lesson plan por TARIQ KHAN
Narration lesson planNarration lesson plan
Narration lesson plan
TARIQ KHAN75 vistas
The Future of Micro-credentials: Is Small Really Beautiful? por Mark Brown
The Future of Micro-credentials:  Is Small Really Beautiful?The Future of Micro-credentials:  Is Small Really Beautiful?
The Future of Micro-credentials: Is Small Really Beautiful?
Mark Brown75 vistas
Payment Integration using Braintree Connector | MuleSoft Mysore Meetup #37 por MysoreMuleSoftMeetup
Payment Integration using Braintree Connector | MuleSoft Mysore Meetup #37Payment Integration using Braintree Connector | MuleSoft Mysore Meetup #37
Payment Integration using Braintree Connector | MuleSoft Mysore Meetup #37
Pharmaceutical Analysis PPT (BP 102T) por yakshpharmacy009
Pharmaceutical Analysis PPT (BP 102T) Pharmaceutical Analysis PPT (BP 102T)
Pharmaceutical Analysis PPT (BP 102T)
yakshpharmacy009108 vistas

Part III. Project evaluation

  • 1. UNIVERSIDAD DE LAS FUERZAS SUBJECT: SOCIO EDUCATIONAL PROJECT TUTOR: DR. MIGUEL PONCE THEME: PART III. PROJECT EVALUATION STUDENTS: MONTESDEOCA BENITEZ DIANA PRISCILA PACHACAMA SIMBAÑA DAYSI ALEXANDRA
  • 2. Part III. Project Evaluation Introduction The goal is to create effective education projects that can serve as models of excellence. Development the basics of evaluation, outlining everything from types of evaluations and ways of collecting information project evaluation and provide guidance in using evaluation as a project improvement tool
  • 3. What is Project Evaluation? In the course of implementing a project various types of information are gathered. In the course of implementing a project evaluation provides project coordinators with well- documented and considered evidence to support the decision-making process. The evaluation can determine whether or not the objectives have been met. Spotlight on B-WET (Bay Watershed Education & Training)is an environmental education program that supports experiential learning through local competitive grants. The goal is to support existing programs, foster new programs, and encourage partnerships in providing “meaningful. For teachers in utilizing MWEEs in their environmental experiences” (MWEEs) to students as well as professional development opportunities
  • 4. Why is Evaluation Important to Project Design and Implementation? • Participants are core to the success of the project depend on the degree to which participants benefit directly, short-term and long-term, from the experiences or services Participants • Project strengths and weaknesses can be identified through an evaluation. • This information can be used to re-design the project and increase both efficiency and effectiveness. Project Improvement • An evaluation can be used to promote the products and services of the project within and outside of the agency based on evaluation results will be viewed as more substantial and justifiable. Public Relations • Evaluation results are often used in the process of determining if a project should be continued, scaled backed, discontinued, or enhanced.Funding • Projects evolve over time. An evaluation can help clarify the purposes of the project, allowing decision-makers to examine project components against well- thought out criteria. Improved Delivery • An evaluation will provide opportunities for skillbuilding and learning. These insights can be used to inform a strategic examination of projects and programs by identifying priorities, overlap, gaps, and model programs. Capacity Building • Based on experiences with the project and information taken from research literature, the evaluation provides an opportunity to revisit the theory behind the project. Clarifying Project Theory • Project is going and what it has been able to accomplish compared to expectations. Taking stock is more than accumulating information about the project – it is learning through the project Taking Stock
  • 5. Planning an Evaluation Planning • Should be reexamined and used as a road map for planning the evaluation. With the logic model and the associated performance objectives in hand, evaluation planners will be able to articulate how the project is supposed to work. Step 1. Reexamine the issue, audience, and project objectives • Project managers, resource managers, staff members, volunteers, participants, and community members all have a stake in the overall success of the project Step 2. Establish the planning team (including stakeholders, audience, and evaluators) • If the purpose is to assess the extent to which a program is operating as planned or to collect evidence of progress toward the outcomes identified in the TOP model then a process or implementation evaluation is called for on. Step 3. Identify a purpose for the evaluation
  • 6. Step 4. Focus on project improvement This type of evaluation focuses on what services are provided and to whom and how. The intent is to strengthen the program by providing feedback on its implementation, progress, and success. Process evaluation can be used to: *Gather information/data about an audience’s reaction to project activities or products/ materials. *Gather information/data about problems with project delivery and assess progress towards outcomes of a project during implementation Implementation evaluation include: *Are the project resources (time, money, expertise) being utilized as planned? (Resources) *Are the intended activities, products, or services being provided? What promotional strategies worked or failed? (Activities) *How extensively is the audience engaged in project activities? (Participation) *Do participants perceive immediate benefits from their participation in the activities? (Reactions
  • 7. Step 5. Assess project outcomes and impacts Three levels of the programming staircase (knowledge, attitudes, skills, and aspirations (KASA) The project team should select levels of evaluation based on the type of information needed to evaluate the project accurately Results of an outcome evaluation provide the information necessary to make decisions about the continuation, revision, or expansion of the project. Outcome evaluation include: *Did the participants increase awareness, knowledge, and or problem-solving skills? Outcome evaluation assesses the extent to which those project targets are reached. *Did participants change their opinions, attitudes, or viewpoints as intended a result of the KASAs learned during their participation in the project? (Practice). Have targeted social, economic, or environmental conditions improved as a result of KASA
  • 8. Step 6. Clarify the time frame in which the activities and impacts (outcomes) are expected to occur •The evaluation timeline must be integrated into the project implementation timeline and vice versa. • Planning and implementing an evaluation can take several months. •Sufficient care must be given to the development of the evaluation timeline to ensure effectiveness. Step 7. Perform a literature search •Research into evaluation processes, practices, and standards is useful. This is particularly true if the evaluation team does not include an outside evaluation expert. •In designing an evaluation it is helpful to identify the related literature and use this literature as a touchstone. •Existing sources of information (previous evaluations, census data, reports, budgets, etc.) should be tapped. Step 8. Select data collection methods and develop questions based on the evaluation goals and objectives •The evaluation team has determined why an evaluation is being conducted, who will conduct it, what will be evaluated, who will be evaluated, and when the evaluation will take place. •Each of these decisions begins to define the type of evaluation and the data collection instruments.
  • 9. Data Collection Step 9. Determine the audience sample -The preferred method for selecting a subset is random sampling – a procedure that reduces sample bias by selecting a sample that accurately reflects the population. -A sample represents the population if every person in the population has an equal chance of being selected. -To reduce sampling errors, make the sample as large as possible in terms of time and money. -Basic questions: *How many audiences do you wish to sample? *How many individuals do you hope to assess? *How can you best reach the audience to collect data? Step 10. Design and pilot the data collection instrument -To consider a series of questions to design the data collection instrument: How important is statistical precision? How important is in-depth information about one or more aspects of the project? How will data collection be standardized? Is contact information on target audience(s) available? What method of data collection would the audience be most receptive to? How many questions can be asked? -To design an instrument that is appealing to the eye, simple to use, contains complete and explicit instructions, and collects the desired data. Step 11. Gather and record data -The evaluation team will need to determine how data will be collected and recorded, and by whom. -A system of coding and recording the data must be developed to ensure easy and accurate data analysis. -May be necessary to train interviewers, focus group facilitators, and/or observers.
  • 10. Data Analysis and Reporting Step 14. Synthesize information and create a report -After the data have been collected and analyzed, an evaluation report must be written. -There are standard components to any evaluation report, for example, the report must include a description of the evaluation methods used. -The report must include a discussion of the problems encountered and errors made with the design and implementation of data collection instruments or tools. Step 13. Manage data -After reading the evaluation report, decision-makers, other stakeholders, and other evaluators may generate questions that can be answered by revisiting the data. -It is important to develop a plan for continued access to uncorrupted data. -If data are to be retained for some period of time, the project team must also make certain that the confidentiality and anonymity of respondents is maintained. Step 12. Perform data analysis -Have a plan in place for how to analyze, synthesize, store, and manage the data before starting the data collection. -Develop a plan to guarantee an unbiased analysis and reporting of the data. -Always start analyzing the collected data with a review of the evaluation goals and objectives. -Make copies of all data, and store a master copy of the original data in a safe place. -For qualitative data, anticipate responses (the pilot test will help with this), and have a plan for categorizing and coding the data.
  • 11. Who Should Conduct the Evaluation? evaluation planning process decision will need to be made planning process, the decision will need to be made hire an outside evaluator. the decision may have been made for the team managers require contract an outside evaluator
  • 13. educators used feedback forms the program could be improved. this way commented, don´t need more information gathering the same type of evaluation data feedback form is “an evaluation,” others believe it is a pre-test/post-test. Does evaluation really matter?
  • 14. Evaluation Costs size and complexity of the project Recommended 5 to 15% evaluation costs evaluation existing data has its pitfalls
  • 15. Ethics participants are not embarrassed Respectful data collection is not enough respondents understand that they are participating
  • 16. Part III Wrap-Up Evaluation should be built into the plans for a project from the start Project evaluation make decisions investment of time and resources Evaluation results justify worthwhile projects to provide more effective, better targeted