This presentation by Andy Feldman was made at the OECD conference on Innovating the Public Sector: From Ideas to Impact (12-13 November 2014). For more information visit the OECD Observatory of Public Sector Innovation: https://www.oecd.org/governance/observatory-public-sector-innovation/events/.

1. Bridging Evidence & Innovation
Andrew Feldman, PhD, MPP
Evidence and Innovation Team
U.S. Office of Management and Budget

2. A perceived gap…
Evidence Innovation
• Using existing
knowledge about what
works
• Rigorously testing
whether something
works (involves
replication)
• Trying new
approaches in
order to find
better ways of
doing things

3. In recent years, new efforts in U.S.
government to bridge:
Evidence Innovation
Today’s presentation:
5 quick insights from our experience

4. Supported Work Demonstration
Youth Adult men Adult women
63
57
Employed(%)
49
Program group
#1: Ensure everyone understands the
value of rigorous evaluation

5. Youth Adult men Adult women
63
57
41
Employed(%)
63
53
49
Control group
Key Question: Where is Our Program
Having the Greatest Impact?
Insight #1: Ensure everyone understands
the value of rigorous evaluation
Program group
Supported Work Demonstration
#1: Ensure everyone understands the
value of rigorous evaluation

6. Key Question: Where is Our Program
Having the Greatest Impact?
Insight #1: Ensure everyone understands
the value of rigorous evaluation
#2: Frame evidence-building as learning,
not just an “up or down” verdict
• Traditional evaluation: Does this program
work?
• Can feel threatening
• Instead: How can we make program better?
Which versions are better?
• E.g.: U.S. Dept of Labor Learning Agendas

7. Key Question: Where is Our Program
Having the Greatest Impact?
Insight #1: Ensure everyone understands
the value of rigorous evaluation
#3: Behavioral insights team can open
doors to innovation & learning
• Many agencies: Little experience of
innovation / rigorous evaluation
• Behavioral insights team (called “SBST” in
U.S.) = non-threatening way to start
• Team asks: What operational
improvements could we test to better
achieve your goals?
• Ex: US Dept. of Education - student loans

8. Key Question: Where is Our Program
Having the Greatest Impact?
Scale-up
Development
Validation
#4: Use tiered-evidence grant programs
(a.k.a. innovation funds)

9. Key Question: Where is Our Program
Having the Greatest Impact?
Insight #2: Use tiered-evidence grant
programs (a.k.a. innovation funds)
Examples:
•Investing in Innovation (i3)
•Workforce Innovation Fund
•Social Innovation Fund
•Home Visiting
•Teen Pregnancy Prevention
#4: Use tiered-evidence grant programs
(a.k.a. innovation funds)

10. Key Question: Where is Our Program
Having the Greatest Impact?
#5: Bridge “silos” within agencies by
connecting experts to address key
challenges
• Policy officials
• Program managers
• Experts in:
 Innovation
 Evaluation
 Performance
 Data

11. Resources
Andrew Feldman
afeldman@omb.eop.gov
www.govinnovator.com
• OMB Memo M-13-17: Next Steps in the Evidence
and Innovation Agenda
• 2014 Economic Report of the President, Ch. 7:
Evaluation as a Tool for Improving Fed. Programs
• 2015 President’s Budget Fact Sheet: Building and
Using Evidence to Strengthen Results