SlideShare a Scribd company logo
1 of 16
How Rigorous Evaluations Support Program
            Implementation

           Donna Smith-Moncrieffe
      National Crime Prevention Centre
         Kids Not Cons Conference
             March 21-23, 2012
                   Toronto
Summary of the Presentation

 NCPC Mandate


 Evaluations at NCPC
       Elements of a Rigorous Evaluation



 How Rigorous Evaluations Support Program Implementation?


           Learning from Results
           Fidelity: Understanding How to Implement the Program
           Logic Model: Understanding How Activities Lead to Results



 Summary




                                                                        2
3
NCPC’s Elements of a Rigorous Evaluation




                                           4
Rigorous Evaluations Can Be Beneficial for
Project Development and Implementation




                                             5
How Rigorous Evaluations Support Program
Implementation




                                           6
Learning from Results




                        7
# 1 Learning From Results




                            8
# 1 Learning From Results Cont’d




                                   9
Program Fidelity




                   10
#2: Fidelity: Understanding How to Implement
the Program




                                               11
# 2: Fidelity
Relationship Between Fidelity & Type of Program




                              Highest Level of
                                  Fidelity




                                         Moderate Levels
                                           of Fidelity




                                                 Low Levels of
                                                    Fidelity


                                                                 12
Logic Model: Understanding How Program
Activities Lead to Results




                                         13
# 3: Logic Models




                    14
Summary

● Projects can improve implementation by using the following strategies and/
  or tools:


    - Learning from the results (especially if the results are shared and used
        during the evaluation)
    - Using a fidelity tool
    - Frequently referring to the logic model to ensure that the target group,
        activities and outcomes are “logically” related
    -
● Obtaining Value for Money results (cost effectiveness of programming) and
  using tools to increase accountability contribute to long term benefits
  including:


    - Using the budget to enhance program management
    - Program sustainability
    - Increased probability of future funding
                                                                                 15
Thank You




                           Contact:

         Donna Smith-Moncrieffe, BSc. Crim Dip, MSc.
                   Senior Evaluation Advisor
    Public Safety Canada, National Crime Prevention Centre
                Policy, Research and Evaluation
                        Tel: 416-952-0423
                       Fax: 416-952-0483
          Email: donna.smith-moncrieffe@ps-sp.gc.ca
   Web : www.PublicSafety.gc.ca | www.SecuritePublique.gc.ca



                                                               16

More Related Content

Similar to Ps sp-#581705-1-how rigorous program evaluation supports program implementation

Evaluation introduction
Evaluation introductionEvaluation introduction
Evaluation introduction
Nathan Loynes
 
Running head PROJECT MANAGEMENT.1PROJECT MANAGEMENT.2.docx
Running head PROJECT MANAGEMENT.1PROJECT MANAGEMENT.2.docxRunning head PROJECT MANAGEMENT.1PROJECT MANAGEMENT.2.docx
Running head PROJECT MANAGEMENT.1PROJECT MANAGEMENT.2.docx
toltonkendal
 
importance of resources allocation in formal method of software engineering ...
 importance of resources allocation in formal method of software engineering ... importance of resources allocation in formal method of software engineering ...
importance of resources allocation in formal method of software engineering ...
Abdul Naqashbandi
 

Similar to Ps sp-#581705-1-how rigorous program evaluation supports program implementation (20)

Work shop project management
Work shop project managementWork shop project management
Work shop project management
 
Adam Suchley - Predictive Delivery Assurance - APM Assurance SIG Conference 2018
Adam Suchley - Predictive Delivery Assurance - APM Assurance SIG Conference 2018Adam Suchley - Predictive Delivery Assurance - APM Assurance SIG Conference 2018
Adam Suchley - Predictive Delivery Assurance - APM Assurance SIG Conference 2018
 
PMP - Project Initiation Template for Professionals
PMP - Project Initiation Template for ProfessionalsPMP - Project Initiation Template for Professionals
PMP - Project Initiation Template for Professionals
 
How to Implement & Manage an Energy Management Program
How to Implement & Manage an Energy Management ProgramHow to Implement & Manage an Energy Management Program
How to Implement & Manage an Energy Management Program
 
Evaluation introduction
Evaluation introductionEvaluation introduction
Evaluation introduction
 
Free video lecture bca
Free video lecture bcaFree video lecture bca
Free video lecture bca
 
Breaking the Project Failure Cycle
Breaking the Project Failure CycleBreaking the Project Failure Cycle
Breaking the Project Failure Cycle
 
Predictive project analytics: Will your project be successful?
Predictive project analytics: Will your project be successful?Predictive project analytics: Will your project be successful?
Predictive project analytics: Will your project be successful?
 
Florence Kalipa_latest
Florence Kalipa_latestFlorence Kalipa_latest
Florence Kalipa_latest
 
Disaster Risk Management
Disaster Risk ManagementDisaster Risk Management
Disaster Risk Management
 
Elements of Effective Practice - Design, Management & Evaluation
Elements of Effective Practice - Design, Management & EvaluationElements of Effective Practice - Design, Management & Evaluation
Elements of Effective Practice - Design, Management & Evaluation
 
Running head PROJECT MANAGEMENT.1PROJECT MANAGEMENT.2.docx
Running head PROJECT MANAGEMENT.1PROJECT MANAGEMENT.2.docxRunning head PROJECT MANAGEMENT.1PROJECT MANAGEMENT.2.docx
Running head PROJECT MANAGEMENT.1PROJECT MANAGEMENT.2.docx
 
Program Management 2.0: Risk Management
Program Management 2.0: Risk ManagementProgram Management 2.0: Risk Management
Program Management 2.0: Risk Management
 
concept of evaluation "Character insight"
concept of evaluation "Character insight"concept of evaluation "Character insight"
concept of evaluation "Character insight"
 
Ben Mkt 347 Week 4
Ben Mkt 347 Week 4Ben Mkt 347 Week 4
Ben Mkt 347 Week 4
 
importance of resources allocation in formal method of software engineering ...
 importance of resources allocation in formal method of software engineering ... importance of resources allocation in formal method of software engineering ...
importance of resources allocation in formal method of software engineering ...
 
12 Step Program and 12 Reasons why PRojects Fail
12 Step Program and 12 Reasons why PRojects Fail12 Step Program and 12 Reasons why PRojects Fail
12 Step Program and 12 Reasons why PRojects Fail
 
Developing Standards for Enterprise Schedule Quality
Developing Standards for Enterprise Schedule QualityDeveloping Standards for Enterprise Schedule Quality
Developing Standards for Enterprise Schedule Quality
 
Improving Accountability
Improving AccountabilityImproving Accountability
Improving Accountability
 
Challenging Aspects of Modern Project Management
Challenging Aspects of Modern Project ManagementChallenging Aspects of Modern Project Management
Challenging Aspects of Modern Project Management
 

Recently uploaded

Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 

Recently uploaded (20)

80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
Spatium Project Simulation student brief
Spatium Project Simulation student briefSpatium Project Simulation student brief
Spatium Project Simulation student brief
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the Classroom
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 

Ps sp-#581705-1-how rigorous program evaluation supports program implementation

  • 1. How Rigorous Evaluations Support Program Implementation Donna Smith-Moncrieffe National Crime Prevention Centre Kids Not Cons Conference March 21-23, 2012 Toronto
  • 2. Summary of the Presentation  NCPC Mandate  Evaluations at NCPC  Elements of a Rigorous Evaluation  How Rigorous Evaluations Support Program Implementation?  Learning from Results  Fidelity: Understanding How to Implement the Program  Logic Model: Understanding How Activities Lead to Results  Summary 2
  • 3. 3
  • 4. NCPC’s Elements of a Rigorous Evaluation 4
  • 5. Rigorous Evaluations Can Be Beneficial for Project Development and Implementation 5
  • 6. How Rigorous Evaluations Support Program Implementation 6
  • 8. # 1 Learning From Results 8
  • 9. # 1 Learning From Results Cont’d 9
  • 11. #2: Fidelity: Understanding How to Implement the Program 11
  • 12. # 2: Fidelity Relationship Between Fidelity & Type of Program Highest Level of Fidelity Moderate Levels of Fidelity Low Levels of Fidelity 12
  • 13. Logic Model: Understanding How Program Activities Lead to Results 13
  • 14. # 3: Logic Models 14
  • 15. Summary ● Projects can improve implementation by using the following strategies and/ or tools: - Learning from the results (especially if the results are shared and used during the evaluation) - Using a fidelity tool - Frequently referring to the logic model to ensure that the target group, activities and outcomes are “logically” related - ● Obtaining Value for Money results (cost effectiveness of programming) and using tools to increase accountability contribute to long term benefits including: - Using the budget to enhance program management - Program sustainability - Increased probability of future funding 15
  • 16. Thank You Contact: Donna Smith-Moncrieffe, BSc. Crim Dip, MSc. Senior Evaluation Advisor Public Safety Canada, National Crime Prevention Centre Policy, Research and Evaluation Tel: 416-952-0423 Fax: 416-952-0483 Email: donna.smith-moncrieffe@ps-sp.gc.ca Web : www.PublicSafety.gc.ca | www.SecuritePublique.gc.ca 16