Making communications land - Are they received and understood as intended? we...
IFPRI Policy Seminar "Evidence-Based Policymaking" Presentation by John Young
1. Measuring the impact of research: experience from ODI’s RAPID Programme John Young Overseas Development Institute J.young@odi.org.uk
2. Commission research Analyse the results Choose the best option Establish the policy Implement the policy Evaluation Policy processes are not... Identify the problem
3. Policy processes are... Cabinet Donors Policy Formulation Parliament Agenda Setting Decision Making Civil Society Ministries Monitoring and Evaluation Policy Implementation Private Sector
4. Policy is chaos “The whole life of policy is a chaos of purposes and accidents. It is not at all a matter of the rational implementation of the so-called decisions through selected strategies” Clay & Schaffer (1984), Room for Manoeuvre: An Exploration of Public Policy in Agricultural and Rural Development, Heineman Educational Books, London
12. Research can transform lives “The results of household disease surveys informed processes of health service reform which contributed to a 43 and 46 per cent reduction in infant mortality between 2000 and 2003 in two districts in rural Tanzania.” TEHIP Project, Tanzania: www.idrc.ca/tehip
19. What should you measure? “If you don't know where you are going, any road will get you there”
20. Strategy and direction –are you doing the right thing? Management –are you doing what you planned to do? Outputs– are the outputs appropriate for the audience? Uptake – are people aware of your work? Outcomes and impacts –are you having any impact? Strategy and direction Management Outputs Uptake Outcomes and impacts What should you measure?
21. Focus on behaviour change Project Team Impact Outcomes Other Actors Inputs Activities Outputs Outcomes Impact Outcomes Impact BehaviourChange
22. International Research The Hubl Study Episode Studies 1970s 1980s 1990s 2000s Professionalisation of Public Services. Structural Adjustment -> collapse of services. Paravet projects emerge. ITDG projects. Privatisation. ITDG Paravet network. Rapid spread in North. KVB letter (January 1998). Multistakeholder WSs -> new policies. Still not approved / passed! Professionalisationof Public Services. Structural Adjustment Privatisation ITDG Paravet networkand change of DVS. KVB letter(January 1998). Multistakeholder WSs ->new policies. ITDG projects – collaborative research. Dr Kajume
23. Outcome Mapping OUTCOME MAPPING:Building Learning and Reflection into Development ProgramsSarah Earl, Fred Carden, and Terry Smutylo http://www.idrc.ca/en/ev-9330-201-1-DO_TOPIC.html
26. Most Significant Change Collect “stories of change” from different stakholders Systematic analysis of “significance”. http://www.mande.co.uk/docs/MSCGuide.pdf
28. Conclusions Research to influence policy/practice: Clear objectives Understand the context Theory of change Iterative / learning approach Measuring impact Clear objectives Theory of change 5-levels Multiple methods Triangulation Expect the unexpected
Notas del editor
What are you trying to learn:Impact of research on policy and practice?Impact of changes in policy / practice on livelihoods?Why:To improve your own practice?To satisfy the donor?To demonstrate value for money?