The Obama Administration has repeatedly used the annual budget formulation process to establish new directions and policy direction for Federal government evaluations and evaluation offices. This presentation will discuss the suite of evaluation proposals offered in the FY 2016 Budget, including items for specific Federal agencies and initiatives intended to broadly apply to Federal evaluations. Specific areas to be discussed will include funding availability, funding flexibility, and information collection requests. The discussion will focus on challenges the proposals seek to address for the evaluation community, provide context for the Administration’s evaluation vision moving forward, and highlight policies the Budget does not address.
Bhubaneswar Call Girls Bhubaneswar 👉👉 9777949614 Top Class Call Girl Service ...
Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges
1. 1
Looking Forward to the Future
of Federal Evaluation Efforts:
Addressing Identified Challenges
April 28, 2015
Eastern Evaluation Research Society
“Let’s Get Real: Evaluation Challenges and Solutions”
38th Annual EERS Conference in Galloway, NJ
Nicholas Hart
U.S. Office of Management and Budget (OMB)
2. Challenges in Federal Evaluation
• Encouraging production and use (supply/demand)
– Building and maintaining support from agency leaders
– Providing evaluations in a timely manner for decisions
– Facilitating access to data the government already collects
(and ensuring quality)
• Identifying appropriate level of flexibility for initiatives
given mixed capacity across Federal agencies
• Engaging stakeholders within agencies, Congress, and
the public
• Linking existing efforts, especially performance
measurement mandates with evaluation efforts
2
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
3. Administration Proposals for FY 2016
1. Funding
– New fund requests
– New set-aside requests
– Contract flexibility
2. Rapid Evaluation
– Behavioral Insights
– Improving Data Access
3. Use
– Program Scaling
– “Tiered Evidence” for Grants
3
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
4. Funding Proposals
• Sample of new evaluation funding requests:
– Double funding for early education and childhood evaluation
– Triples funding for Ed’s First in the World Fund (+$200m)
– Create American Technical Training Fund to evaluate job-
training models (+$200m)
– New Child Support Research Fund (+$1b/10 years)
– First time proposals for energy assistance evaluation and
innovation funding (+$200m)
– Early intervention demonstration projects for the Social
Security Disability Insurance program (+$400m)
– MCC economic development approaches (+$350m)
– PEPFAR Impact Fund for AIDS data collection and program
evaluation (+$300m)
4
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
5. Funding Proposals
• Set-aside authority:
– Funding set-aside requests for select Education, HHS,
and Labor programs
• Funding Flexibility
– Increase funding flexibility for evaluation and survey
contracts.
– Would apply to HHS (ASPE, ACF), DOL (eval, BLS), DOJ
(NIJ, BJS), Commerce (Census), and HUD (OPDR).
5
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
6. Rapid Evaluation Proposals
• Behavioral Insights
– Team focused on assessing behaviorally-informed
interventions using low-cost RCTs
• Access to Administrative Data
– Expanding access
– Invest in infrastructure
– Plan for future improvements
6
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
7. Evaluation Use
• Program Scaling
– DOL re-employment services
– HUD’s Jobs-Plus program
– Apprenticeships
• “Tiered Evidence” approaches
– ED’s Investing in Innovation Fund (i3)
– USAID’s Global Development Lab
– Social Innovation Fund (SIF)
– ED’s Leveraging What Works grants
7
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
8. What’s not included
• Framework for integration of evaluation
activities with performance measurement or
strategic planning efforts
• Evaluation directives or mandates
• Baseline capacity survey or analysis
• Uniform approaches
• Explicit methodological preferences
• PRA modifications
8
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
Challenges in Federal evaluation are many.
This Administration has prioritized efforts to both produce and use evaluation,
although there have been struggles in identifying the best path forward
Specific challenges to highlight with proposals – resources, data availability, timeliness, use
A number of other challenges without explicit proposals – link to GPRA, stakeholder engagement, PRA/timelineness
Latest administration proposals fall in to three buckets where Administration asking for congressional approval:
FUNDING
Improving the supply of evaluation by funding more targeted, policy-relevant evaluations.
These are cases where policymakers are asking for more information, a good indicator of potential use
Set-aside requests help with formative and impact evaluation
Flexibilities for certain agencies to address barriers to funding multi-year evaluations
TIMELINENESS
Related to use, approaches to helping expedite certain responses when possible to reduce uncertainty for decisionmakers
USE
Scale based on some evidence and incorporate in grant structures.
Because the President’s budget request proposed lifting the BCA caps, room for many more investments in evaluation than recent years.
Will just highlight a few:
ACF spends 1/5 of 1 percent of its budget on evaluation (88M) and a lot of new requests are housed there.
Early ed
CSE
LIHEAP
SSA demonstration authority / DI
Building off previous requests and new funding provided in 2015…
Worth noting that not all of the requests are housed in social service agencies – some in State, USAID and USDA.
At the end of the day, unclear how many of these will ultimately get enacted.
Set-asides
CSBG & SSBG up to 1 pct
Labor increase from 0.5 pct to 1 pct
Written as up to 1 pct to allow for flexibility for agency heads.
Flexibility
High quality evaluations are complicated and may span many years
Study designs might be altered
Recruitment might take longer than anticipated
incremental funding of multiple-year non-severable contracts
Would allow increased funding
ADMIN DATA
Expanding access – is about providing researchers access to what already exists. i.e NDNH, Medicare data and some tax data for statistical agencies
Focus on improving government statistics and evaluations
Infrastructure investments – data matching and sharing is currently a challenge – propose to encourage census too help facilitate linking and sharing of data
Future – supports a commission similar to Ryan-Murray which focuses on expanding access to data, removing legislative barriers, while improving quality and protecting privacy