SlideShare una empresa de Scribd logo
1
Looking Forward to the Future
of Federal Evaluation Efforts:
Addressing Identified Challenges
April 28, 2015
Eastern Evaluation Research Society
“Let’s Get Real: Evaluation Challenges and Solutions”
38th Annual EERS Conference in Galloway, NJ
Nicholas Hart
U.S. Office of Management and Budget (OMB)
Challenges in Federal Evaluation
• Encouraging production and use (supply/demand)
– Building and maintaining support from agency leaders
– Providing evaluations in a timely manner for decisions
– Facilitating access to data the government already collects
(and ensuring quality)
• Identifying appropriate level of flexibility for initiatives
given mixed capacity across Federal agencies
• Engaging stakeholders within agencies, Congress, and
the public
• Linking existing efforts, especially performance
measurement mandates with evaluation efforts
2
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
Administration Proposals for FY 2016
1. Funding
– New fund requests
– New set-aside requests
– Contract flexibility
2. Rapid Evaluation
– Behavioral Insights
– Improving Data Access
3. Use
– Program Scaling
– “Tiered Evidence” for Grants
3
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
Funding Proposals
• Sample of new evaluation funding requests:
– Double funding for early education and childhood evaluation
– Triples funding for Ed’s First in the World Fund (+$200m)
– Create American Technical Training Fund to evaluate job-
training models (+$200m)
– New Child Support Research Fund (+$1b/10 years)
– First time proposals for energy assistance evaluation and
innovation funding (+$200m)
– Early intervention demonstration projects for the Social
Security Disability Insurance program (+$400m)
– MCC economic development approaches (+$350m)
– PEPFAR Impact Fund for AIDS data collection and program
evaluation (+$300m)
4
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
Funding Proposals
• Set-aside authority:
– Funding set-aside requests for select Education, HHS,
and Labor programs
• Funding Flexibility
– Increase funding flexibility for evaluation and survey
contracts.
– Would apply to HHS (ASPE, ACF), DOL (eval, BLS), DOJ
(NIJ, BJS), Commerce (Census), and HUD (OPDR).
5
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
Rapid Evaluation Proposals
• Behavioral Insights
– Team focused on assessing behaviorally-informed
interventions using low-cost RCTs
• Access to Administrative Data
– Expanding access
– Invest in infrastructure
– Plan for future improvements
6
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
Evaluation Use
• Program Scaling
– DOL re-employment services
– HUD’s Jobs-Plus program
– Apprenticeships
• “Tiered Evidence” approaches
– ED’s Investing in Innovation Fund (i3)
– USAID’s Global Development Lab
– Social Innovation Fund (SIF)
– ED’s Leveraging What Works grants
7
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
What’s not included
• Framework for integration of evaluation
activities with performance measurement or
strategic planning efforts
• Evaluation directives or mandates
• Baseline capacity survey or analysis
• Uniform approaches
• Explicit methodological preferences
• PRA modifications
8
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
Thank you.
Nicholas Hart
nhart@omb.eop.gov
www.whitehouse.gov/omb
9
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart

Más contenido relacionado

La actualidad más candente

Measuring Progress: Indicators, Data Sources and Assessment | Laszlo Pinter, ...
Measuring Progress: Indicators, Data Sources and Assessment | Laszlo Pinter, ...Measuring Progress: Indicators, Data Sources and Assessment | Laszlo Pinter, ...
Measuring Progress: Indicators, Data Sources and Assessment | Laszlo Pinter, ...NAP Global Network
 
Small grants, big opportunities: Using the small grants mechanism to build l...
Small grants, big opportunities: Using the small grants mechanism  to build l...Small grants, big opportunities: Using the small grants mechanism  to build l...
Small grants, big opportunities: Using the small grants mechanism to build l...MEASURE Evaluation
 
The dog who caught the car: There’s more PEPFAR data than ever before, now what?
The dog who caught the car: There’s more PEPFAR data than ever before, now what?The dog who caught the car: There’s more PEPFAR data than ever before, now what?
The dog who caught the car: There’s more PEPFAR data than ever before, now what?MEASURE Evaluation
 
Improving Health Information Systems in Uganda: The HIS Stages of Continuous ...
Improving Health Information Systems in Uganda: The HIS Stages of Continuous ...Improving Health Information Systems in Uganda: The HIS Stages of Continuous ...
Improving Health Information Systems in Uganda: The HIS Stages of Continuous ...MEASURE Evaluation
 
Molly Irwin - Evidence informed policy making - 27 June 2017
Molly Irwin - Evidence informed policy making - 27 June 2017Molly Irwin - Evidence informed policy making - 27 June 2017
Molly Irwin - Evidence informed policy making - 27 June 2017OECD Governance
 
LASYR Slides IEEE event 07 APR 2021
LASYR Slides IEEE event 07 APR 2021LASYR Slides IEEE event 07 APR 2021
LASYR Slides IEEE event 07 APR 2021Sean Manion PhD
 
RDC Xinjie Cui - Data Interoperability_II
RDC Xinjie Cui - Data Interoperability_IIRDC Xinjie Cui - Data Interoperability_II
RDC Xinjie Cui - Data Interoperability_IICASRAI
 
Report by PEMPAL performance budgeting working group - Naida Carsimamovic - W...
Report by PEMPAL performance budgeting working group - Naida Carsimamovic - W...Report by PEMPAL performance budgeting working group - Naida Carsimamovic - W...
Report by PEMPAL performance budgeting working group - Naida Carsimamovic - W...OECD Governance
 
Measure for Measure: The role of metrics in assessing research performance - ...
Measure for Measure: The role of metrics in assessing research performance - ...Measure for Measure: The role of metrics in assessing research performance - ...
Measure for Measure: The role of metrics in assessing research performance - ...Michael Habib
 
NIH 101: Tips and Tools for New & Early-Stage Researchers
NIH 101: Tips and Tools for New & Early-Stage ResearchersNIH 101: Tips and Tools for New & Early-Stage Researchers
NIH 101: Tips and Tools for New & Early-Stage ResearchersNorbert Tavares, Ph.D.
 
ARL Collections Presentation: Moneyball, the Extra 2%, and What Baseball Mana...
ARL Collections Presentation: Moneyball, the Extra 2%, and What Baseball Mana...ARL Collections Presentation: Moneyball, the Extra 2%, and What Baseball Mana...
ARL Collections Presentation: Moneyball, the Extra 2%, and What Baseball Mana...Greg Raschke
 
Jisc learninganalytics dec2016
Jisc learninganalytics dec2016Jisc learninganalytics dec2016
Jisc learninganalytics dec2016Paul Bailey
 
Enabling smaller independent publishers to participate in Open Access agreeme...
Enabling smaller independent publishers to participate in Open Access agreeme...Enabling smaller independent publishers to participate in Open Access agreeme...
Enabling smaller independent publishers to participate in Open Access agreeme...Alicia Wise
 
Ask an NIH Program Officer: Tips and Tools for New & Early-Stage Researchers
Ask an NIH Program Officer: Tips and Tools for New & Early-Stage ResearchersAsk an NIH Program Officer: Tips and Tools for New & Early-Stage Researchers
Ask an NIH Program Officer: Tips and Tools for New & Early-Stage ResearchersNorbert Tavares, Ph.D.
 
Monitoring Scale-up of Health Practices and Interventions
Monitoring Scale-up of Health Practices and InterventionsMonitoring Scale-up of Health Practices and Interventions
Monitoring Scale-up of Health Practices and InterventionsMEASURE Evaluation
 
Jisc learning analytics MASHEIN Jan 2017
Jisc learning analytics MASHEIN Jan 2017Jisc learning analytics MASHEIN Jan 2017
Jisc learning analytics MASHEIN Jan 2017Paul Bailey
 

La actualidad más candente (20)

Measuring Progress: Indicators, Data Sources and Assessment | Laszlo Pinter, ...
Measuring Progress: Indicators, Data Sources and Assessment | Laszlo Pinter, ...Measuring Progress: Indicators, Data Sources and Assessment | Laszlo Pinter, ...
Measuring Progress: Indicators, Data Sources and Assessment | Laszlo Pinter, ...
 
Small grants, big opportunities: Using the small grants mechanism to build l...
Small grants, big opportunities: Using the small grants mechanism  to build l...Small grants, big opportunities: Using the small grants mechanism  to build l...
Small grants, big opportunities: Using the small grants mechanism to build l...
 
The dog who caught the car: There’s more PEPFAR data than ever before, now what?
The dog who caught the car: There’s more PEPFAR data than ever before, now what?The dog who caught the car: There’s more PEPFAR data than ever before, now what?
The dog who caught the car: There’s more PEPFAR data than ever before, now what?
 
Roth "Tools to support systematic review research"
Roth "Tools to support systematic review research"Roth "Tools to support systematic review research"
Roth "Tools to support systematic review research"
 
Improving Health Information Systems in Uganda: The HIS Stages of Continuous ...
Improving Health Information Systems in Uganda: The HIS Stages of Continuous ...Improving Health Information Systems in Uganda: The HIS Stages of Continuous ...
Improving Health Information Systems in Uganda: The HIS Stages of Continuous ...
 
Molly Irwin - Evidence informed policy making - 27 June 2017
Molly Irwin - Evidence informed policy making - 27 June 2017Molly Irwin - Evidence informed policy making - 27 June 2017
Molly Irwin - Evidence informed policy making - 27 June 2017
 
LASYR Slides IEEE event 07 APR 2021
LASYR Slides IEEE event 07 APR 2021LASYR Slides IEEE event 07 APR 2021
LASYR Slides IEEE event 07 APR 2021
 
RDC Xinjie Cui - Data Interoperability_II
RDC Xinjie Cui - Data Interoperability_IIRDC Xinjie Cui - Data Interoperability_II
RDC Xinjie Cui - Data Interoperability_II
 
Integrated Approaches for SDGs planning
Integrated Approaches for SDGs planning Integrated Approaches for SDGs planning
Integrated Approaches for SDGs planning
 
Report by PEMPAL performance budgeting working group - Naida Carsimamovic - W...
Report by PEMPAL performance budgeting working group - Naida Carsimamovic - W...Report by PEMPAL performance budgeting working group - Naida Carsimamovic - W...
Report by PEMPAL performance budgeting working group - Naida Carsimamovic - W...
 
Measure for Measure: The role of metrics in assessing research performance - ...
Measure for Measure: The role of metrics in assessing research performance - ...Measure for Measure: The role of metrics in assessing research performance - ...
Measure for Measure: The role of metrics in assessing research performance - ...
 
NIH 101: Tips and Tools for New & Early-Stage Researchers
NIH 101: Tips and Tools for New & Early-Stage ResearchersNIH 101: Tips and Tools for New & Early-Stage Researchers
NIH 101: Tips and Tools for New & Early-Stage Researchers
 
2_resume_2016.11
2_resume_2016.112_resume_2016.11
2_resume_2016.11
 
ARL Collections Presentation: Moneyball, the Extra 2%, and What Baseball Mana...
ARL Collections Presentation: Moneyball, the Extra 2%, and What Baseball Mana...ARL Collections Presentation: Moneyball, the Extra 2%, and What Baseball Mana...
ARL Collections Presentation: Moneyball, the Extra 2%, and What Baseball Mana...
 
Jisc learninganalytics dec2016
Jisc learninganalytics dec2016Jisc learninganalytics dec2016
Jisc learninganalytics dec2016
 
Enabling smaller independent publishers to participate in Open Access agreeme...
Enabling smaller independent publishers to participate in Open Access agreeme...Enabling smaller independent publishers to participate in Open Access agreeme...
Enabling smaller independent publishers to participate in Open Access agreeme...
 
Ask an NIH Program Officer: Tips and Tools for New & Early-Stage Researchers
Ask an NIH Program Officer: Tips and Tools for New & Early-Stage ResearchersAsk an NIH Program Officer: Tips and Tools for New & Early-Stage Researchers
Ask an NIH Program Officer: Tips and Tools for New & Early-Stage Researchers
 
Falk-Krzesinski, "Administrator (Institutional Use of the Data): Data-informe...
Falk-Krzesinski, "Administrator (Institutional Use of the Data): Data-informe...Falk-Krzesinski, "Administrator (Institutional Use of the Data): Data-informe...
Falk-Krzesinski, "Administrator (Institutional Use of the Data): Data-informe...
 
Monitoring Scale-up of Health Practices and Interventions
Monitoring Scale-up of Health Practices and InterventionsMonitoring Scale-up of Health Practices and Interventions
Monitoring Scale-up of Health Practices and Interventions
 
Jisc learning analytics MASHEIN Jan 2017
Jisc learning analytics MASHEIN Jan 2017Jisc learning analytics MASHEIN Jan 2017
Jisc learning analytics MASHEIN Jan 2017
 

Destacado

Hart and Newcomer -- Change, Continuity and Lessons Unlearned: A Tale of Two ...
Hart and Newcomer -- Change, Continuity and Lessons Unlearned: A Tale of Two ...Hart and Newcomer -- Change, Continuity and Lessons Unlearned: A Tale of Two ...
Hart and Newcomer -- Change, Continuity and Lessons Unlearned: A Tale of Two ...Nick Hart, Ph.D.
 
Determinants of Evaluation Supply at the US EPA: A Case Study of the RCRA Ha...
Determinants of Evaluation Supply at the US EPA:  A Case Study of the RCRA Ha...Determinants of Evaluation Supply at the US EPA:  A Case Study of the RCRA Ha...
Determinants of Evaluation Supply at the US EPA: A Case Study of the RCRA Ha...Nick Hart, Ph.D.
 
Hart & Newcomer 2015 -- Change and Continuity: Lessons Learned from the Bush ...
Hart & Newcomer 2015 -- Change and Continuity: Lessons Learned from the Bush ...Hart & Newcomer 2015 -- Change and Continuity: Lessons Learned from the Bush ...
Hart & Newcomer 2015 -- Change and Continuity: Lessons Learned from the Bush ...Nick Hart, Ph.D.
 
Sijil Tinggi Muamalat 2 - Prinsip Asas Perniagaan: Tn. Hj. Yahya
Sijil Tinggi Muamalat 2 - Prinsip Asas Perniagaan: Tn. Hj. YahyaSijil Tinggi Muamalat 2 - Prinsip Asas Perniagaan: Tn. Hj. Yahya
Sijil Tinggi Muamalat 2 - Prinsip Asas Perniagaan: Tn. Hj. YahyaIzzuddin Norrahman
 
Using Evidence and Evaluation in Federal Budget Decisions
Using Evidence and Evaluation in Federal Budget DecisionsUsing Evidence and Evaluation in Federal Budget Decisions
Using Evidence and Evaluation in Federal Budget DecisionsNick Hart, Ph.D.
 
No a la discriminación
No a la discriminaciónNo a la discriminación
No a la discriminaciónofemary
 
Insights from Program Evaluation for Retrospective Reviews of regulations
Insights from Program Evaluation for Retrospective Reviews of regulationsInsights from Program Evaluation for Retrospective Reviews of regulations
Insights from Program Evaluation for Retrospective Reviews of regulationsNick Hart, Ph.D.
 
Hart 2014 -- Overseeing the Enforcers (Delivered on Nov. 6, 2014)
Hart 2014  -- Overseeing the Enforcers (Delivered on Nov. 6, 2014)Hart 2014  -- Overseeing the Enforcers (Delivered on Nov. 6, 2014)
Hart 2014 -- Overseeing the Enforcers (Delivered on Nov. 6, 2014)Nick Hart, Ph.D.
 
Envisioning Solutions to Problem Scenarios in Evaluation (AEA 2014)
Envisioning Solutions to Problem Scenarios in Evaluation (AEA 2014)Envisioning Solutions to Problem Scenarios in Evaluation (AEA 2014)
Envisioning Solutions to Problem Scenarios in Evaluation (AEA 2014)Nick Hart, Ph.D.
 

Destacado (10)

Hart and Newcomer -- Change, Continuity and Lessons Unlearned: A Tale of Two ...
Hart and Newcomer -- Change, Continuity and Lessons Unlearned: A Tale of Two ...Hart and Newcomer -- Change, Continuity and Lessons Unlearned: A Tale of Two ...
Hart and Newcomer -- Change, Continuity and Lessons Unlearned: A Tale of Two ...
 
Determinants of Evaluation Supply at the US EPA: A Case Study of the RCRA Ha...
Determinants of Evaluation Supply at the US EPA:  A Case Study of the RCRA Ha...Determinants of Evaluation Supply at the US EPA:  A Case Study of the RCRA Ha...
Determinants of Evaluation Supply at the US EPA: A Case Study of the RCRA Ha...
 
Hart & Newcomer 2015 -- Change and Continuity: Lessons Learned from the Bush ...
Hart & Newcomer 2015 -- Change and Continuity: Lessons Learned from the Bush ...Hart & Newcomer 2015 -- Change and Continuity: Lessons Learned from the Bush ...
Hart & Newcomer 2015 -- Change and Continuity: Lessons Learned from the Bush ...
 
Sejarah android
Sejarah androidSejarah android
Sejarah android
 
Sijil Tinggi Muamalat 2 - Prinsip Asas Perniagaan: Tn. Hj. Yahya
Sijil Tinggi Muamalat 2 - Prinsip Asas Perniagaan: Tn. Hj. YahyaSijil Tinggi Muamalat 2 - Prinsip Asas Perniagaan: Tn. Hj. Yahya
Sijil Tinggi Muamalat 2 - Prinsip Asas Perniagaan: Tn. Hj. Yahya
 
Using Evidence and Evaluation in Federal Budget Decisions
Using Evidence and Evaluation in Federal Budget DecisionsUsing Evidence and Evaluation in Federal Budget Decisions
Using Evidence and Evaluation in Federal Budget Decisions
 
No a la discriminación
No a la discriminaciónNo a la discriminación
No a la discriminación
 
Insights from Program Evaluation for Retrospective Reviews of regulations
Insights from Program Evaluation for Retrospective Reviews of regulationsInsights from Program Evaluation for Retrospective Reviews of regulations
Insights from Program Evaluation for Retrospective Reviews of regulations
 
Hart 2014 -- Overseeing the Enforcers (Delivered on Nov. 6, 2014)
Hart 2014  -- Overseeing the Enforcers (Delivered on Nov. 6, 2014)Hart 2014  -- Overseeing the Enforcers (Delivered on Nov. 6, 2014)
Hart 2014 -- Overseeing the Enforcers (Delivered on Nov. 6, 2014)
 
Envisioning Solutions to Problem Scenarios in Evaluation (AEA 2014)
Envisioning Solutions to Problem Scenarios in Evaluation (AEA 2014)Envisioning Solutions to Problem Scenarios in Evaluation (AEA 2014)
Envisioning Solutions to Problem Scenarios in Evaluation (AEA 2014)
 

Similar a Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges

Aea presentation final 18_oct2013
Aea presentation final 18_oct2013Aea presentation final 18_oct2013
Aea presentation final 18_oct2013soder145
 
Winning SBIR Grants & NSF I-Corps Program Update
Winning SBIR Grants & NSF I-Corps Program UpdateWinning SBIR Grants & NSF I-Corps Program Update
Winning SBIR Grants & NSF I-Corps Program UpdateTexas State University SBDC
 
Fostering research for policy and practitioners lessons and opportunities
Fostering research for policy and practitioners lessons and opportunitiesFostering research for policy and practitioners lessons and opportunities
Fostering research for policy and practitioners lessons and opportunitiesUNICEF Office of Research - Innocenti
 
Stewart_CapstonePresentation_2015 Dec
Stewart_CapstonePresentation_2015 DecStewart_CapstonePresentation_2015 Dec
Stewart_CapstonePresentation_2015 DecHaley J. Stewart
 
Strengthen Dissemination, Implementation and Improvement Science
Strengthen Dissemination, Implementation and Improvement ScienceStrengthen Dissemination, Implementation and Improvement Science
Strengthen Dissemination, Implementation and Improvement ScienceUCLA CTSI
 
Diagnosing State Enrollment Systems: Just What the Doctor Ordered!
Diagnosing State Enrollment Systems: Just What the Doctor Ordered!Diagnosing State Enrollment Systems: Just What the Doctor Ordered!
Diagnosing State Enrollment Systems: Just What the Doctor Ordered!NASHP HealthPolicy
 
CHHS Open DataFest - 3.14.16 - Day One Morning Sessions
CHHS Open DataFest - 3.14.16 - Day One Morning SessionsCHHS Open DataFest - 3.14.16 - Day One Morning Sessions
CHHS Open DataFest - 3.14.16 - Day One Morning SessionsMichael Kerr
 
Ron Haskins Evidence based policymaking uk
Ron Haskins Evidence based policymaking ukRon Haskins Evidence based policymaking uk
Ron Haskins Evidence based policymaking ukNesta
 
Building the Ship as it Sails: Challenges and Strategies to Assess and Enhanc...
Building the Ship as it Sails: Challenges and Strategies to Assess and Enhanc...Building the Ship as it Sails: Challenges and Strategies to Assess and Enhanc...
Building the Ship as it Sails: Challenges and Strategies to Assess and Enhanc...MEASURE Evaluation
 
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)Derek Warnick
 
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)D. Warnick Consulting
 
Developing Better Environmental Evidence in the U.S.: Determinants of Evaluat...
Developing Better Environmental Evidence in the U.S.: Determinants of Evaluat...Developing Better Environmental Evidence in the U.S.: Determinants of Evaluat...
Developing Better Environmental Evidence in the U.S.: Determinants of Evaluat...Nick Hart, Ph.D.
 
Iwasiw ppts ch08_3_e
Iwasiw ppts ch08_3_eIwasiw ppts ch08_3_e
Iwasiw ppts ch08_3_estanbridge
 
Evaluation Amidst Paperwork Reduction Act Reviews: Overcoming Challenges fro...
Evaluation Amidst Paperwork Reduction Act Reviews:  Overcoming Challenges fro...Evaluation Amidst Paperwork Reduction Act Reviews:  Overcoming Challenges fro...
Evaluation Amidst Paperwork Reduction Act Reviews: Overcoming Challenges fro...Nick Hart, Ph.D.
 
Big Data Opportunities in Census Bureau Research
Big Data Opportunities in Census Bureau ResearchBig Data Opportunities in Census Bureau Research
Big Data Opportunities in Census Bureau ResearchSudip Bhattacharjee
 
US University Research Funding, Peer Reviews, and Metrics
US University Research Funding, Peer Reviews, and MetricsUS University Research Funding, Peer Reviews, and Metrics
US University Research Funding, Peer Reviews, and MetricsDaniel S. Katz
 
swot STRENGHT WEAKNESSES THREATS OPPURTUNITIES
swot STRENGHT WEAKNESSES THREATS OPPURTUNITIESswot STRENGHT WEAKNESSES THREATS OPPURTUNITIES
swot STRENGHT WEAKNESSES THREATS OPPURTUNITIESberiniaedeno
 

Similar a Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges (20)

Aea presentation final 18_oct2013
Aea presentation final 18_oct2013Aea presentation final 18_oct2013
Aea presentation final 18_oct2013
 
Winning SBIR Grants & NSF I-Corps Program Update
Winning SBIR Grants & NSF I-Corps Program UpdateWinning SBIR Grants & NSF I-Corps Program Update
Winning SBIR Grants & NSF I-Corps Program Update
 
PPX January 2016 LE
PPX January 2016 LEPPX January 2016 LE
PPX January 2016 LE
 
Fostering research for policy and practitioners lessons and opportunities
Fostering research for policy and practitioners lessons and opportunitiesFostering research for policy and practitioners lessons and opportunities
Fostering research for policy and practitioners lessons and opportunities
 
Stewart_CapstonePresentation_2015 Dec
Stewart_CapstonePresentation_2015 DecStewart_CapstonePresentation_2015 Dec
Stewart_CapstonePresentation_2015 Dec
 
Strengthen Dissemination, Implementation and Improvement Science
Strengthen Dissemination, Implementation and Improvement ScienceStrengthen Dissemination, Implementation and Improvement Science
Strengthen Dissemination, Implementation and Improvement Science
 
Hm 418 harris ch09 ppt
Hm 418 harris ch09 pptHm 418 harris ch09 ppt
Hm 418 harris ch09 ppt
 
Diagnosing State Enrollment Systems: Just What the Doctor Ordered!
Diagnosing State Enrollment Systems: Just What the Doctor Ordered!Diagnosing State Enrollment Systems: Just What the Doctor Ordered!
Diagnosing State Enrollment Systems: Just What the Doctor Ordered!
 
CHHS Open DataFest - 3.14.16 - Day One Morning Sessions
CHHS Open DataFest - 3.14.16 - Day One Morning SessionsCHHS Open DataFest - 3.14.16 - Day One Morning Sessions
CHHS Open DataFest - 3.14.16 - Day One Morning Sessions
 
Ron Haskins Evidence based policymaking uk
Ron Haskins Evidence based policymaking ukRon Haskins Evidence based policymaking uk
Ron Haskins Evidence based policymaking uk
 
Building the Ship as it Sails: Challenges and Strategies to Assess and Enhanc...
Building the Ship as it Sails: Challenges and Strategies to Assess and Enhanc...Building the Ship as it Sails: Challenges and Strategies to Assess and Enhanc...
Building the Ship as it Sails: Challenges and Strategies to Assess and Enhanc...
 
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
 
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
 
Developing Better Environmental Evidence in the U.S.: Determinants of Evaluat...
Developing Better Environmental Evidence in the U.S.: Determinants of Evaluat...Developing Better Environmental Evidence in the U.S.: Determinants of Evaluat...
Developing Better Environmental Evidence in the U.S.: Determinants of Evaluat...
 
McCann-Woods Resume-Skills Based
McCann-Woods Resume-Skills BasedMcCann-Woods Resume-Skills Based
McCann-Woods Resume-Skills Based
 
Iwasiw ppts ch08_3_e
Iwasiw ppts ch08_3_eIwasiw ppts ch08_3_e
Iwasiw ppts ch08_3_e
 
Evaluation Amidst Paperwork Reduction Act Reviews: Overcoming Challenges fro...
Evaluation Amidst Paperwork Reduction Act Reviews:  Overcoming Challenges fro...Evaluation Amidst Paperwork Reduction Act Reviews:  Overcoming Challenges fro...
Evaluation Amidst Paperwork Reduction Act Reviews: Overcoming Challenges fro...
 
Big Data Opportunities in Census Bureau Research
Big Data Opportunities in Census Bureau ResearchBig Data Opportunities in Census Bureau Research
Big Data Opportunities in Census Bureau Research
 
US University Research Funding, Peer Reviews, and Metrics
US University Research Funding, Peer Reviews, and MetricsUS University Research Funding, Peer Reviews, and Metrics
US University Research Funding, Peer Reviews, and Metrics
 
swot STRENGHT WEAKNESSES THREATS OPPURTUNITIES
swot STRENGHT WEAKNESSES THREATS OPPURTUNITIESswot STRENGHT WEAKNESSES THREATS OPPURTUNITIES
swot STRENGHT WEAKNESSES THREATS OPPURTUNITIES
 

Más de Nick Hart, Ph.D.

The Role of Federal Evaluation Activities in the “Evidence-Based” Policy and ...
The Role of Federal Evaluation Activities in the “Evidence-Based” Policy and ...The Role of Federal Evaluation Activities in the “Evidence-Based” Policy and ...
The Role of Federal Evaluation Activities in the “Evidence-Based” Policy and ...Nick Hart, Ph.D.
 
Transparency for the Modern Evidence Ecosystem
Transparency for the Modern Evidence EcosystemTransparency for the Modern Evidence Ecosystem
Transparency for the Modern Evidence EcosystemNick Hart, Ph.D.
 
2018 Policy Contours for Using Linked Administrative Data in Evidence-Based ...
2018 Policy Contours for Using Linked Administrative Data in Evidence-Based ...2018 Policy Contours for Using Linked Administrative Data in Evidence-Based ...
2018 Policy Contours for Using Linked Administrative Data in Evidence-Based ...Nick Hart, Ph.D.
 
Improving Environmental Evidence in the US
Improving Environmental Evidence in the USImproving Environmental Evidence in the US
Improving Environmental Evidence in the USNick Hart, Ph.D.
 
Performance Partnership Case Presentation: Evaluation @EPA
Performance Partnership Case Presentation: Evaluation @EPAPerformance Partnership Case Presentation: Evaluation @EPA
Performance Partnership Case Presentation: Evaluation @EPANick Hart, Ph.D.
 
Articulating Program Impacts with Case Studies & Success Stories
Articulating Program Impacts with Case Studies & Success StoriesArticulating Program Impacts with Case Studies & Success Stories
Articulating Program Impacts with Case Studies & Success StoriesNick Hart, Ph.D.
 
Performance Measurement and Evaluation in the Obama Administration
Performance Measurement and Evaluation in the Obama AdministrationPerformance Measurement and Evaluation in the Obama Administration
Performance Measurement and Evaluation in the Obama AdministrationNick Hart, Ph.D.
 

Más de Nick Hart, Ph.D. (7)

The Role of Federal Evaluation Activities in the “Evidence-Based” Policy and ...
The Role of Federal Evaluation Activities in the “Evidence-Based” Policy and ...The Role of Federal Evaluation Activities in the “Evidence-Based” Policy and ...
The Role of Federal Evaluation Activities in the “Evidence-Based” Policy and ...
 
Transparency for the Modern Evidence Ecosystem
Transparency for the Modern Evidence EcosystemTransparency for the Modern Evidence Ecosystem
Transparency for the Modern Evidence Ecosystem
 
2018 Policy Contours for Using Linked Administrative Data in Evidence-Based ...
2018 Policy Contours for Using Linked Administrative Data in Evidence-Based ...2018 Policy Contours for Using Linked Administrative Data in Evidence-Based ...
2018 Policy Contours for Using Linked Administrative Data in Evidence-Based ...
 
Improving Environmental Evidence in the US
Improving Environmental Evidence in the USImproving Environmental Evidence in the US
Improving Environmental Evidence in the US
 
Performance Partnership Case Presentation: Evaluation @EPA
Performance Partnership Case Presentation: Evaluation @EPAPerformance Partnership Case Presentation: Evaluation @EPA
Performance Partnership Case Presentation: Evaluation @EPA
 
Articulating Program Impacts with Case Studies & Success Stories
Articulating Program Impacts with Case Studies & Success StoriesArticulating Program Impacts with Case Studies & Success Stories
Articulating Program Impacts with Case Studies & Success Stories
 
Performance Measurement and Evaluation in the Obama Administration
Performance Measurement and Evaluation in the Obama AdministrationPerformance Measurement and Evaluation in the Obama Administration
Performance Measurement and Evaluation in the Obama Administration
 

Último

“Be part of the Plan” International Day For Biological Diversity 2024.
“Be part of the Plan” International Day For Biological Diversity 2024.“Be part of the Plan” International Day For Biological Diversity 2024.
“Be part of the Plan” International Day For Biological Diversity 2024.Christina Parmionova
 
Low Atmospheric Pressure Stunning is not a humane alternative to Carbon Dioxi...
Low Atmospheric Pressure Stunning is not a humane alternative to Carbon Dioxi...Low Atmospheric Pressure Stunning is not a humane alternative to Carbon Dioxi...
Low Atmospheric Pressure Stunning is not a humane alternative to Carbon Dioxi...Harm Kiezebrink
 
Ghana High Commission on list of diplomats including US & China who owe £143m...
Ghana High Commission on list of diplomats including US & China who owe £143m...Ghana High Commission on list of diplomats including US & China who owe £143m...
Ghana High Commission on list of diplomats including US & China who owe £143m...Kweku Zurek
 
CourseHero 9KLDFSKJKSJDFKSDKFJSDKSLFJKSJL
CourseHero 9KLDFSKJKSJDFKSDKFJSDKSLFJKSJLCourseHero 9KLDFSKJKSJDFKSDKFJSDKSLFJKSJL
CourseHero 9KLDFSKJKSJDFKSDKFJSDKSLFJKSJLRohit Garg
 
Effective governance in the modern charity
Effective governance in the modern charityEffective governance in the modern charity
Effective governance in the modern charityFelixPerez547899
 
#Bepartoftheplan on International Day For Biological Diversity 2024
#Bepartoftheplan on International Day For Biological Diversity 2024#Bepartoftheplan on International Day For Biological Diversity 2024
#Bepartoftheplan on International Day For Biological Diversity 2024Christina Parmionova
 
Program Kickoff- Cohort......_4 (1).pptx
Program Kickoff- Cohort......_4 (1).pptxProgram Kickoff- Cohort......_4 (1).pptx
Program Kickoff- Cohort......_4 (1).pptxScottMeyers35
 
Advancing Impact Measurement | Public Good App House
Advancing Impact Measurement | Public Good App HouseAdvancing Impact Measurement | Public Good App House
Advancing Impact Measurement | Public Good App HouseTechSoup
 
Canadian Immigration Tracker March 2024 - Key Slides
Canadian Immigration Tracker March 2024 - Key SlidesCanadian Immigration Tracker March 2024 - Key Slides
Canadian Immigration Tracker March 2024 - Key SlidesAndrew Griffith
 
Writing Sample-Title: Pioneering Urban Transformation: The Collective Power o...
Writing Sample-Title: Pioneering Urban Transformation: The Collective Power o...Writing Sample-Title: Pioneering Urban Transformation: The Collective Power o...
Writing Sample-Title: Pioneering Urban Transformation: The Collective Power o...Rahsaan L. Browne
 
Who are the Sherden Yale Historical Review
Who are the Sherden Yale Historical ReviewWho are the Sherden Yale Historical Review
Who are the Sherden Yale Historical Reviewyalehistoricalreview
 
Creating an Effective Veteran Policy in Ukraine
Creating an Effective Veteran Policy in UkraineCreating an Effective Veteran Policy in Ukraine
Creating an Effective Veteran Policy in Ukrainessuser601bbf
 
Minority economic forum Executive Summary
Minority economic forum Executive SummaryMinority economic forum Executive Summary
Minority economic forum Executive SummaryRDE GROUP CORP
 
OilChange: Big Oil Reality Check May 2024
OilChange: Big Oil Reality Check May 2024OilChange: Big Oil Reality Check May 2024
OilChange: Big Oil Reality Check May 2024Energy for One World
 
Near and Not Lost Yale Historical Review
Near and Not Lost Yale Historical ReviewNear and Not Lost Yale Historical Review
Near and Not Lost Yale Historical Reviewyalehistoricalreview
 
researching client.pptxffffffffffffffffffffffffff
researching client.pptxffffffffffffffffffffffffffresearching client.pptxffffffffffffffffffffffffff
researching client.pptxfffffffffffffffffffffffffflolsDocherty
 
一比一原版(SUT毕业证)斯威本科技大学毕业证成绩单
一比一原版(SUT毕业证)斯威本科技大学毕业证成绩单一比一原版(SUT毕业证)斯威本科技大学毕业证成绩单
一比一原版(SUT毕业证)斯威本科技大学毕业证成绩单aveka1
 
EDI Executive Education Master Class- 15thMay 2024 (updated) (2)
EDI Executive Education Master Class- 15thMay 2024 (updated) (2)EDI Executive Education Master Class- 15thMay 2024 (updated) (2)
EDI Executive Education Master Class- 15thMay 2024 (updated) (2)Energy for One World
 
Program Kickoff- Cohort 4______ (2).pptx
Program Kickoff- Cohort 4______ (2).pptxProgram Kickoff- Cohort 4______ (2).pptx
Program Kickoff- Cohort 4______ (2).pptxScottMeyers35
 
一比一原版(UoB毕业证)伯明翰大学毕业证成绩单
一比一原版(UoB毕业证)伯明翰大学毕业证成绩单一比一原版(UoB毕业证)伯明翰大学毕业证成绩单
一比一原版(UoB毕业证)伯明翰大学毕业证成绩单ygymyy
 

Último (20)

“Be part of the Plan” International Day For Biological Diversity 2024.
“Be part of the Plan” International Day For Biological Diversity 2024.“Be part of the Plan” International Day For Biological Diversity 2024.
“Be part of the Plan” International Day For Biological Diversity 2024.
 
Low Atmospheric Pressure Stunning is not a humane alternative to Carbon Dioxi...
Low Atmospheric Pressure Stunning is not a humane alternative to Carbon Dioxi...Low Atmospheric Pressure Stunning is not a humane alternative to Carbon Dioxi...
Low Atmospheric Pressure Stunning is not a humane alternative to Carbon Dioxi...
 
Ghana High Commission on list of diplomats including US & China who owe £143m...
Ghana High Commission on list of diplomats including US & China who owe £143m...Ghana High Commission on list of diplomats including US & China who owe £143m...
Ghana High Commission on list of diplomats including US & China who owe £143m...
 
CourseHero 9KLDFSKJKSJDFKSDKFJSDKSLFJKSJL
CourseHero 9KLDFSKJKSJDFKSDKFJSDKSLFJKSJLCourseHero 9KLDFSKJKSJDFKSDKFJSDKSLFJKSJL
CourseHero 9KLDFSKJKSJDFKSDKFJSDKSLFJKSJL
 
Effective governance in the modern charity
Effective governance in the modern charityEffective governance in the modern charity
Effective governance in the modern charity
 
#Bepartoftheplan on International Day For Biological Diversity 2024
#Bepartoftheplan on International Day For Biological Diversity 2024#Bepartoftheplan on International Day For Biological Diversity 2024
#Bepartoftheplan on International Day For Biological Diversity 2024
 
Program Kickoff- Cohort......_4 (1).pptx
Program Kickoff- Cohort......_4 (1).pptxProgram Kickoff- Cohort......_4 (1).pptx
Program Kickoff- Cohort......_4 (1).pptx
 
Advancing Impact Measurement | Public Good App House
Advancing Impact Measurement | Public Good App HouseAdvancing Impact Measurement | Public Good App House
Advancing Impact Measurement | Public Good App House
 
Canadian Immigration Tracker March 2024 - Key Slides
Canadian Immigration Tracker March 2024 - Key SlidesCanadian Immigration Tracker March 2024 - Key Slides
Canadian Immigration Tracker March 2024 - Key Slides
 
Writing Sample-Title: Pioneering Urban Transformation: The Collective Power o...
Writing Sample-Title: Pioneering Urban Transformation: The Collective Power o...Writing Sample-Title: Pioneering Urban Transformation: The Collective Power o...
Writing Sample-Title: Pioneering Urban Transformation: The Collective Power o...
 
Who are the Sherden Yale Historical Review
Who are the Sherden Yale Historical ReviewWho are the Sherden Yale Historical Review
Who are the Sherden Yale Historical Review
 
Creating an Effective Veteran Policy in Ukraine
Creating an Effective Veteran Policy in UkraineCreating an Effective Veteran Policy in Ukraine
Creating an Effective Veteran Policy in Ukraine
 
Minority economic forum Executive Summary
Minority economic forum Executive SummaryMinority economic forum Executive Summary
Minority economic forum Executive Summary
 
OilChange: Big Oil Reality Check May 2024
OilChange: Big Oil Reality Check May 2024OilChange: Big Oil Reality Check May 2024
OilChange: Big Oil Reality Check May 2024
 
Near and Not Lost Yale Historical Review
Near and Not Lost Yale Historical ReviewNear and Not Lost Yale Historical Review
Near and Not Lost Yale Historical Review
 
researching client.pptxffffffffffffffffffffffffff
researching client.pptxffffffffffffffffffffffffffresearching client.pptxffffffffffffffffffffffffff
researching client.pptxffffffffffffffffffffffffff
 
一比一原版(SUT毕业证)斯威本科技大学毕业证成绩单
一比一原版(SUT毕业证)斯威本科技大学毕业证成绩单一比一原版(SUT毕业证)斯威本科技大学毕业证成绩单
一比一原版(SUT毕业证)斯威本科技大学毕业证成绩单
 
EDI Executive Education Master Class- 15thMay 2024 (updated) (2)
EDI Executive Education Master Class- 15thMay 2024 (updated) (2)EDI Executive Education Master Class- 15thMay 2024 (updated) (2)
EDI Executive Education Master Class- 15thMay 2024 (updated) (2)
 
Program Kickoff- Cohort 4______ (2).pptx
Program Kickoff- Cohort 4______ (2).pptxProgram Kickoff- Cohort 4______ (2).pptx
Program Kickoff- Cohort 4______ (2).pptx
 
一比一原版(UoB毕业证)伯明翰大学毕业证成绩单
一比一原版(UoB毕业证)伯明翰大学毕业证成绩单一比一原版(UoB毕业证)伯明翰大学毕业证成绩单
一比一原版(UoB毕业证)伯明翰大学毕业证成绩单
 

Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges

  • 1. 1 Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges April 28, 2015 Eastern Evaluation Research Society “Let’s Get Real: Evaluation Challenges and Solutions” 38th Annual EERS Conference in Galloway, NJ Nicholas Hart U.S. Office of Management and Budget (OMB)
  • 2. Challenges in Federal Evaluation • Encouraging production and use (supply/demand) – Building and maintaining support from agency leaders – Providing evaluations in a timely manner for decisions – Facilitating access to data the government already collects (and ensuring quality) • Identifying appropriate level of flexibility for initiatives given mixed capacity across Federal agencies • Engaging stakeholders within agencies, Congress, and the public • Linking existing efforts, especially performance measurement mandates with evaluation efforts 2 Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges Hart
  • 3. Administration Proposals for FY 2016 1. Funding – New fund requests – New set-aside requests – Contract flexibility 2. Rapid Evaluation – Behavioral Insights – Improving Data Access 3. Use – Program Scaling – “Tiered Evidence” for Grants 3 Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges Hart
  • 4. Funding Proposals • Sample of new evaluation funding requests: – Double funding for early education and childhood evaluation – Triples funding for Ed’s First in the World Fund (+$200m) – Create American Technical Training Fund to evaluate job- training models (+$200m) – New Child Support Research Fund (+$1b/10 years) – First time proposals for energy assistance evaluation and innovation funding (+$200m) – Early intervention demonstration projects for the Social Security Disability Insurance program (+$400m) – MCC economic development approaches (+$350m) – PEPFAR Impact Fund for AIDS data collection and program evaluation (+$300m) 4 Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges Hart
  • 5. Funding Proposals • Set-aside authority: – Funding set-aside requests for select Education, HHS, and Labor programs • Funding Flexibility – Increase funding flexibility for evaluation and survey contracts. – Would apply to HHS (ASPE, ACF), DOL (eval, BLS), DOJ (NIJ, BJS), Commerce (Census), and HUD (OPDR). 5 Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges Hart
  • 6. Rapid Evaluation Proposals • Behavioral Insights – Team focused on assessing behaviorally-informed interventions using low-cost RCTs • Access to Administrative Data – Expanding access – Invest in infrastructure – Plan for future improvements 6 Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges Hart
  • 7. Evaluation Use • Program Scaling – DOL re-employment services – HUD’s Jobs-Plus program – Apprenticeships • “Tiered Evidence” approaches – ED’s Investing in Innovation Fund (i3) – USAID’s Global Development Lab – Social Innovation Fund (SIF) – ED’s Leveraging What Works grants 7 Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges Hart
  • 8. What’s not included • Framework for integration of evaluation activities with performance measurement or strategic planning efforts • Evaluation directives or mandates • Baseline capacity survey or analysis • Uniform approaches • Explicit methodological preferences • PRA modifications 8 Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges Hart
  • 9. Thank you. Nicholas Hart nhart@omb.eop.gov www.whitehouse.gov/omb 9 Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges Hart

Notas del editor

  1. Challenges in Federal evaluation are many. This Administration has prioritized efforts to both produce and use evaluation, although there have been struggles in identifying the best path forward Specific challenges to highlight with proposals – resources, data availability, timeliness, use A number of other challenges without explicit proposals – link to GPRA, stakeholder engagement, PRA/timelineness
  2. Latest administration proposals fall in to three buckets where Administration asking for congressional approval: FUNDING Improving the supply of evaluation by funding more targeted, policy-relevant evaluations. These are cases where policymakers are asking for more information, a good indicator of potential use Set-aside requests help with formative and impact evaluation Flexibilities for certain agencies to address barriers to funding multi-year evaluations TIMELINENESS Related to use, approaches to helping expedite certain responses when possible to reduce uncertainty for decisionmakers USE Scale based on some evidence and incorporate in grant structures.
  3. Because the President’s budget request proposed lifting the BCA caps, room for many more investments in evaluation than recent years. Will just highlight a few: ACF spends 1/5 of 1 percent of its budget on evaluation (88M) and a lot of new requests are housed there. Early ed CSE LIHEAP SSA demonstration authority / DI Building off previous requests and new funding provided in 2015… Worth noting that not all of the requests are housed in social service agencies – some in State, USAID and USDA. At the end of the day, unclear how many of these will ultimately get enacted.
  4. Set-asides CSBG & SSBG up to 1 pct Labor increase from 0.5 pct to 1 pct Written as up to 1 pct to allow for flexibility for agency heads. Flexibility High quality evaluations are complicated and may span many years Study designs might be altered Recruitment might take longer than anticipated incremental funding of multiple-year non-severable contracts Would allow increased funding
  5. ADMIN DATA Expanding access – is about providing researchers access to what already exists. i.e NDNH, Medicare data and some tax data for statistical agencies Focus on improving government statistics and evaluations Infrastructure investments – data matching and sharing is currently a challenge – propose to encourage census too help facilitate linking and sharing of data Future – supports a commission similar to Ryan-Murray which focuses on expanding access to data, removing legislative barriers, while improving quality and protecting privacy