SlideShare a Scribd company logo
1 of 21
What, why and how – initial
thoughts based on a literature
review
Quentin de Roquefeuil & Jeske van Seters
23 May 2013, OECD Conference Centre
Working Group on Agricultural Policies and Markets Meeting
Development of a
methodology for country-
level assessments of PCD
impacts on food security:
1.  What the methodology is about
2.  Key lessons from the literature review
3.  Initial ideas on the methodology
4.  Questions for discussion
Structure of the Presentation
ECDPM Page 2
1. What the methodology is about
•  Non-development policies of OECD member
countries (e.g. agriculture, trade,
investment, science) can have an impact on
developing countries
•  2008 OECD Ministerial declaration confirmed
commitment to promote Policy Coherence for
Development
•  The declaration included the resolution to
further invest in measuring the effects of
OECD members’ policies on international
development objectives.
Context
ECDPM Page 4
ECDPM Page 5
Measuring PCD
= one of the key OECD PCD building blocks
•  PCD section in ex-ante impact assessments
of OECD member countries’ policy proposals
•  PCD section in OECD DAC Peer Reviews
- assessing PCD commitments, institutional
mechanisms, efforts to improve development
financing beyond aid,…
•  Ex-post assessments of OECD policy impact
at developing country level
Different ways to measure PCD
ECDPM Page 6
General objective: to develop a methodology for
identifying and assessing the impacts of OECD
policies on food security in individual developing
countries
Specific objectives:
1.  Help OECD DAC members in pursuing their PCD
policy objectives through providing evidence for
policy change domestically and for programme
design at country level
(e.g. more information to address trade-offs between internal
goals & negative externalities on developing countries)
2.  Enable partner countries and civil society
advocate for improved PCD and to address the
impacts of incoherencies.
Objectives
ECDPM Page 7
ECDPM Page 8
OECD policies
(domestic, aid,
bilateral/
international)
Developing
country’s food
system
(e.g. prices,
functioning of
markets)
Developing
country’s food
security
situation
International
rules and
regulations
Developing
country’s policy
priorities
Focus of the assessment
Steps to develop the methodology
2. The literature review
Objectives
•  Review of different studies attempting to
determine effect of OECD policies on developing
countries (NGOs, academia, etc).
•  Focus on the methodology used in the studies.
•  Assess general robustness of findings.
•  See whether we could incorporate some aspects
of their methodology into ours, and draw some
general lessons.
Page 11ECDPM
•  How did we select the studies?
1.  Assess impact at individual developing country level
(not aggregate).
2.  Focus on a clearly identifiable policy or instrument
emanating from one or several OECD countries (no
general concepts, e.g. “neoliberalism”,
“protectionism”).
3.  Sample should cover wide range of data collection
methods and analytical approaches (try to get as
many approaches as possible in the sample).
Sample selection
ECDPM Page 12
Overview of data collection methods & analytical frameworks
!"#$%&'$()*+*
,-./)*0%-/1)
2/3"#'#3#&$*43#3*
,%-5*
!"#$%"3#'-"36*+*
"3#'-"36*+*1%'&3#$*
)-/%.$)
7-%8)9-1) :/%&$;) <-./5$"#*%$&'$(***=-"$* 2/36'#3#'&$* 2/3"#'#3#'&$ >-5?'"3#'-"*
! "#$%& ' ' ' '
( ")*+,-. ' '
/ "*&*0& ' '
1 23.,+*4&*546&--%+7,4 ' ' '
8 2933:,4;<=>6 ' '
? @&*-39+ ' '
A @">BC ' '
D @E9-0, ' '
F ;&%#G+H: ' ' '
!I ;JCK ' ' '
!! ;03$ ' '
!( <@LBMK ' '
!/ <E93$"N90H& ' ' '
!1 O3*-&*4K+9, ' ' '
!8 J3350,3* ' '
!? P&95E, ' '
!A P+))+ ' ' '
!D P0#50-H% ' '
!F P3+G0*: ' ' '
(I PE)$%9+.4Q(II1R4 ' ' '
(! PE)$%9+.4Q(IIDR ' ' '
(( L#0S0T ' ' '
(/ >&&,H% ' ' ' '
(1 B0H%&95,3* ' ' '
(8 KH33*+, ' ' '
(? K-+S+*, ' ' '
(A U3*V+9+*W4=&* ' '
(D U++NN+#+*W4S&*4Q(I!(R ' '
(F U++NN+#+*W4S&*4Q(I!/R ' ' ' '
/I X&-:0*,4 ' '
@-#36* AB CD CA A A CA CE F G H
<3#3*.-66$.#'-"*5$#9-4 I"36;#'.36*,%35$(-%8*
J K$,$%$".$*
1.  Some studies tweak the methodology (e.g.
selection of interviewees) to get to the results.
2.  Need to define early what is it exactly that is
being impacted on (deconstruct “food security”).
3.  Deductive approach works well.
4.  Country selection criteria?
5.  Need to be clear about the period being covered
by the analysis.
6.  We can (and should) combine data collection
methods (e.g. interviews/quantitative data) and
analytical approaches (e.g. modeling/ value
chain analysis) at different stages in the
analysis/process.
What did we learn?
ECDPM Page 14
7.  Developing country policies and characteristics
(net food import/export, social policies,
governance) deserve to be at centre stage
because they exert a large influence on impact.
8.  Disaggregation between social groups poses
data availability problems.
9.  Local stakeholder involvement can go beyond
interviews. But risk of “capture” needs to be
managed.
What did we learn (cont’d)
ECDPM Page 15
3. Initial ideas on the methodology:
guiding principles and main steps
•  Stakeholder involvement
•  Deductive reasoning
•  Disaggregation between social groups
•  Triangulation (through use of mix of data
collection methods and analytical approaches)
Guiding Principles
ECDPM Page 17
1.  Country selection
2.  Clarify the ‘baseline’
(through internationally accepted quantitative and
qualitative indicators of the food security system)
3.  Identify OECD policies impacting on the food
security system through desk review
4.  In-country testing of hypotheses
5.  Dissemination and use of the findings
Main Steps
ECDPM Page 18
4. Questions for discussion
1.  How can the methodology be most
effective for informing OECD countries’
policymaking?
2.  What are your views on the key guiding
principles and steps of the methodology?
3.  How do we manage the tradeoff between
user-friendliness and depth?
4.  How to insure inclusiveness while
avoiding interest group capture?
Questions for Discussion
Page 20ECDPM
Thank you for your
kind attention.
Quentin de Roquefeuil qd@ecdpm.org
Jeske van Seters jvs@ecdpm.org
Page 21

More Related Content

What's hot

Module 2: Needs Analysis Dima course content
Module 2: Needs Analysis Dima course contentModule 2: Needs Analysis Dima course content
Module 2: Needs Analysis Dima course contentMichael Kenny
 
Using SURVEYBE to improve the collection of panel data experience from EDI
Using SURVEYBE to improve the collection of panel data experience from EDIUsing SURVEYBE to improve the collection of panel data experience from EDI
Using SURVEYBE to improve the collection of panel data experience from EDIUNICEF Office of Research - Innocenti
 
Fostering research for policy and practitioners lessons and opportunities
Fostering research for policy and practitioners lessons and opportunitiesFostering research for policy and practitioners lessons and opportunities
Fostering research for policy and practitioners lessons and opportunitiesUNICEF Office of Research - Innocenti
 
Arundel - Management and service innovation in universities
Arundel - Management and service innovation in universitiesArundel - Management and service innovation in universities
Arundel - Management and service innovation in universitiesinnovationoecd
 
WHAT CAN EXPERIENCE WITH CLUSTERS TEACH US ABOUT FOSTERING SMART SPECIALISATION?
WHAT CAN EXPERIENCE WITH CLUSTERS TEACH US ABOUT FOSTERING SMART SPECIALISATION?WHAT CAN EXPERIENCE WITH CLUSTERS TEACH US ABOUT FOSTERING SMART SPECIALISATION?
WHAT CAN EXPERIENCE WITH CLUSTERS TEACH US ABOUT FOSTERING SMART SPECIALISATION?Orkestra
 
Meijer - Monitoring the evolution and benefits of responsible research and in...
Meijer - Monitoring the evolution and benefits of responsible research and in...Meijer - Monitoring the evolution and benefits of responsible research and in...
Meijer - Monitoring the evolution and benefits of responsible research and in...innovationoecd
 
HLEG thematic workshop on "Multidimensional Subjective Well-being", Martine D...
HLEG thematic workshop on "Multidimensional Subjective Well-being", Martine D...HLEG thematic workshop on "Multidimensional Subjective Well-being", Martine D...
HLEG thematic workshop on "Multidimensional Subjective Well-being", Martine D...StatsCommunications
 
Impact Evaluation Step by Step Evaluating the Impact of Formality_GRADE
Impact Evaluation Step by Step Evaluating the Impact of Formality_GRADEImpact Evaluation Step by Step Evaluating the Impact of Formality_GRADE
Impact Evaluation Step by Step Evaluating the Impact of Formality_GRADEthinktankinitiative
 
Molly Irwin - Evidence informed policy making - 27 June 2017
Molly Irwin - Evidence informed policy making - 27 June 2017Molly Irwin - Evidence informed policy making - 27 June 2017
Molly Irwin - Evidence informed policy making - 27 June 2017OECD Governance
 
Rafols - Towards more inclusive STI indicators
Rafols - Towards more inclusive STI indicatorsRafols - Towards more inclusive STI indicators
Rafols - Towards more inclusive STI indicatorsinnovationoecd
 
Oecd uni indcollaboration_ch4_website
Oecd uni indcollaboration_ch4_websiteOecd uni indcollaboration_ch4_website
Oecd uni indcollaboration_ch4_websiteslideshow19
 
Educational.policy&and ;planning
Educational.policy&and ;planningEducational.policy&and ;planning
Educational.policy&and ;planningDr.Saramma Mathew
 
Vertesy - Auditing composite Indicators of Innovation
Vertesy - Auditing composite Indicators of InnovationVertesy - Auditing composite Indicators of Innovation
Vertesy - Auditing composite Indicators of Innovationinnovationoecd
 
GCRf: RCUK Global Challenges Research Fund
GCRf: RCUK Global Challenges Research FundGCRf: RCUK Global Challenges Research Fund
GCRf: RCUK Global Challenges Research FundLIDC
 
The OECD A Partner in Open Government Reforms
The OECD A Partner in Open Government ReformsThe OECD A Partner in Open Government Reforms
The OECD A Partner in Open Government ReformsOECD Governance
 
Impact Evaluation for Policy Making_Promoting Uptake of Impact Evaluation Fin...
Impact Evaluation for Policy Making_Promoting Uptake of Impact Evaluation Fin...Impact Evaluation for Policy Making_Promoting Uptake of Impact Evaluation Fin...
Impact Evaluation for Policy Making_Promoting Uptake of Impact Evaluation Fin...thinktankinitiative
 
Output Composition of the Monetary Policy Transmission Mechanism: Is Australi...
Output Composition of the Monetary Policy Transmission Mechanism: Is Australi...Output Composition of the Monetary Policy Transmission Mechanism: Is Australi...
Output Composition of the Monetary Policy Transmission Mechanism: Is Australi...anucrawfordphd
 

What's hot (20)

Module 2: Needs Analysis Dima course content
Module 2: Needs Analysis Dima course contentModule 2: Needs Analysis Dima course content
Module 2: Needs Analysis Dima course content
 
Using SURVEYBE to improve the collection of panel data experience from EDI
Using SURVEYBE to improve the collection of panel data experience from EDIUsing SURVEYBE to improve the collection of panel data experience from EDI
Using SURVEYBE to improve the collection of panel data experience from EDI
 
Fostering research for policy and practitioners lessons and opportunities
Fostering research for policy and practitioners lessons and opportunitiesFostering research for policy and practitioners lessons and opportunities
Fostering research for policy and practitioners lessons and opportunities
 
Arundel - Management and service innovation in universities
Arundel - Management and service innovation in universitiesArundel - Management and service innovation in universities
Arundel - Management and service innovation in universities
 
WHAT CAN EXPERIENCE WITH CLUSTERS TEACH US ABOUT FOSTERING SMART SPECIALISATION?
WHAT CAN EXPERIENCE WITH CLUSTERS TEACH US ABOUT FOSTERING SMART SPECIALISATION?WHAT CAN EXPERIENCE WITH CLUSTERS TEACH US ABOUT FOSTERING SMART SPECIALISATION?
WHAT CAN EXPERIENCE WITH CLUSTERS TEACH US ABOUT FOSTERING SMART SPECIALISATION?
 
Meijer - Monitoring the evolution and benefits of responsible research and in...
Meijer - Monitoring the evolution and benefits of responsible research and in...Meijer - Monitoring the evolution and benefits of responsible research and in...
Meijer - Monitoring the evolution and benefits of responsible research and in...
 
HLEG thematic workshop on "Multidimensional Subjective Well-being", Martine D...
HLEG thematic workshop on "Multidimensional Subjective Well-being", Martine D...HLEG thematic workshop on "Multidimensional Subjective Well-being", Martine D...
HLEG thematic workshop on "Multidimensional Subjective Well-being", Martine D...
 
Impact Evaluation Step by Step Evaluating the Impact of Formality_GRADE
Impact Evaluation Step by Step Evaluating the Impact of Formality_GRADEImpact Evaluation Step by Step Evaluating the Impact of Formality_GRADE
Impact Evaluation Step by Step Evaluating the Impact of Formality_GRADE
 
5 maarit laihonen - 11.45 presentation
5 maarit laihonen - 11.45 presentation5 maarit laihonen - 11.45 presentation
5 maarit laihonen - 11.45 presentation
 
Molly Irwin - Evidence informed policy making - 27 June 2017
Molly Irwin - Evidence informed policy making - 27 June 2017Molly Irwin - Evidence informed policy making - 27 June 2017
Molly Irwin - Evidence informed policy making - 27 June 2017
 
Rafols - Towards more inclusive STI indicators
Rafols - Towards more inclusive STI indicatorsRafols - Towards more inclusive STI indicators
Rafols - Towards more inclusive STI indicators
 
Oecd uni indcollaboration_ch4_website
Oecd uni indcollaboration_ch4_websiteOecd uni indcollaboration_ch4_website
Oecd uni indcollaboration_ch4_website
 
Educational.policy&and ;planning
Educational.policy&and ;planningEducational.policy&and ;planning
Educational.policy&and ;planning
 
Vertesy - Auditing composite Indicators of Innovation
Vertesy - Auditing composite Indicators of InnovationVertesy - Auditing composite Indicators of Innovation
Vertesy - Auditing composite Indicators of Innovation
 
Monitoring the effects of the CAP: General research on PCD and a review of in...
Monitoring the effects of the CAP: General research on PCD and a review of in...Monitoring the effects of the CAP: General research on PCD and a review of in...
Monitoring the effects of the CAP: General research on PCD and a review of in...
 
GCRf: RCUK Global Challenges Research Fund
GCRf: RCUK Global Challenges Research FundGCRf: RCUK Global Challenges Research Fund
GCRf: RCUK Global Challenges Research Fund
 
The OECD A Partner in Open Government Reforms
The OECD A Partner in Open Government ReformsThe OECD A Partner in Open Government Reforms
The OECD A Partner in Open Government Reforms
 
Impact Evaluation for Policy Making_Promoting Uptake of Impact Evaluation Fin...
Impact Evaluation for Policy Making_Promoting Uptake of Impact Evaluation Fin...Impact Evaluation for Policy Making_Promoting Uptake of Impact Evaluation Fin...
Impact Evaluation for Policy Making_Promoting Uptake of Impact Evaluation Fin...
 
Peter Vagi, Seminar on Monitoring and Evaluation, Kizilcahamam, Republic of T...
Peter Vagi, Seminar on Monitoring and Evaluation, Kizilcahamam, Republic of T...Peter Vagi, Seminar on Monitoring and Evaluation, Kizilcahamam, Republic of T...
Peter Vagi, Seminar on Monitoring and Evaluation, Kizilcahamam, Republic of T...
 
Output Composition of the Monetary Policy Transmission Mechanism: Is Australi...
Output Composition of the Monetary Policy Transmission Mechanism: Is Australi...Output Composition of the Monetary Policy Transmission Mechanism: Is Australi...
Output Composition of the Monetary Policy Transmission Mechanism: Is Australi...
 

Viewers also liked (9)

PCD Impact Assessment on Food Security in Tanzania
PCD Impact Assessment on Food Security in TanzaniaPCD Impact Assessment on Food Security in Tanzania
PCD Impact Assessment on Food Security in Tanzania
 
Short framing presentation by ECDPM
Short framing presentation by ECDPMShort framing presentation by ECDPM
Short framing presentation by ECDPM
 
CAADP Successes and Challenges
CAADP Successes and ChallengesCAADP Successes and Challenges
CAADP Successes and Challenges
 
Regional approaches to food security in africa
Regional approaches to food security in africaRegional approaches to food security in africa
Regional approaches to food security in africa
 
Short framing presentation by Jean Pierre Elong Mbassi
Short framing presentation by Jean Pierre Elong MbassiShort framing presentation by Jean Pierre Elong Mbassi
Short framing presentation by Jean Pierre Elong Mbassi
 
Public Private Dialogue and Learning for Economic Transformation
Public Private Dialogue and Learning for Economic TransformationPublic Private Dialogue and Learning for Economic Transformation
Public Private Dialogue and Learning for Economic Transformation
 
Involvement of FOs in Regional CAADP Processes
Involvement of FOs in Regional CAADP ProcessesInvolvement of FOs in Regional CAADP Processes
Involvement of FOs in Regional CAADP Processes
 
Presentation on the case of ghana by Daria Fane
Presentation on the case of ghana by Daria FanePresentation on the case of ghana by Daria Fane
Presentation on the case of ghana by Daria Fane
 
Scaling-up CSA in Africa challenges & way forward
Scaling-up CSA in Africa challenges & way forwardScaling-up CSA in Africa challenges & way forward
Scaling-up CSA in Africa challenges & way forward
 

Similar to Development of a methodology for country-level assessments of PCD impacts on food security: What, why and how - initial thoughts based on a literature review

TESTING NEW SOCIAL INNOVATION POLICIES ON LOCAL AND REGIONAL LEVEL
TESTING NEW SOCIAL INNOVATION POLICIES ON LOCAL AND REGIONAL LEVELTESTING NEW SOCIAL INNOVATION POLICIES ON LOCAL AND REGIONAL LEVEL
TESTING NEW SOCIAL INNOVATION POLICIES ON LOCAL AND REGIONAL LEVELarmelleguillermet
 
04 policy training agrifose-willis
04 policy training agrifose-willis04 policy training agrifose-willis
04 policy training agrifose-willispseng
 
BRAINPOoL Workshop 24 March 2014: E-frame presentation
BRAINPOoL Workshop 24 March 2014: E-frame presentationBRAINPOoL Workshop 24 March 2014: E-frame presentation
BRAINPOoL Workshop 24 March 2014: E-frame presentationnefwellbeing
 
Nicholas Mays: More than Methods
Nicholas Mays: More than Methods Nicholas Mays: More than Methods
Nicholas Mays: More than Methods Nuffield Trust
 
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...Institute of Development Studies
 
The development of ATNI: valuable lessons
The development of ATNI: valuable lessonsThe development of ATNI: valuable lessons
The development of ATNI: valuable lessonsriatenorio
 
FCAS M&E Seminar
FCAS M&E SeminarFCAS M&E Seminar
FCAS M&E SeminarItad Ltd
 
Introducing Policy Implementation and Evaluation.
  Introducing Policy Implementation and Evaluation.  Introducing Policy Implementation and Evaluation.
Introducing Policy Implementation and Evaluation.pasicUganda
 
From theory based policy evaluation to smart policy design: lessons learned f...
From theory based policy evaluation to smart policy design: lessons learned f...From theory based policy evaluation to smart policy design: lessons learned f...
From theory based policy evaluation to smart policy design: lessons learned f...IEA DSM Implementing Agreement (IA)
 
ASIS Guideline #4 2021 - Testing new social innovation policies on local and ...
ASIS Guideline #4 2021 - Testing new social innovation policies on local and ...ASIS Guideline #4 2021 - Testing new social innovation policies on local and ...
ASIS Guideline #4 2021 - Testing new social innovation policies on local and ...armelleguillermet
 
ASIS project - Guidelines #4 - TESTING NEW SOCIAL INNOVATION POLICIES ON LOCA...
ASIS project - Guidelines #4 - TESTING NEW SOCIAL INNOVATION POLICIES ON LOCA...ASIS project - Guidelines #4 - TESTING NEW SOCIAL INNOVATION POLICIES ON LOCA...
ASIS project - Guidelines #4 - TESTING NEW SOCIAL INNOVATION POLICIES ON LOCA...armelleguillermet
 
PPWNov13- Day 2 pm- Mogues and Billings- IFPRI
PPWNov13- Day 2 pm- Mogues and Billings- IFPRIPPWNov13- Day 2 pm- Mogues and Billings- IFPRI
PPWNov13- Day 2 pm- Mogues and Billings- IFPRIAg4HealthNutrition
 
Assignment_Group 2_Integrating Gender Equality.pptx
Assignment_Group 2_Integrating Gender Equality.pptxAssignment_Group 2_Integrating Gender Equality.pptx
Assignment_Group 2_Integrating Gender Equality.pptxfuad80
 
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...Institute of Development Studies
 

Similar to Development of a methodology for country-level assessments of PCD impacts on food security: What, why and how - initial thoughts based on a literature review (20)

PCD Impact Assessment on Food Security in Tanzania
PCD Impact Assessment on Food Security in TanzaniaPCD Impact Assessment on Food Security in Tanzania
PCD Impact Assessment on Food Security in Tanzania
 
Measuring the impact of integrated systems research
Measuring the impact of integrated systems researchMeasuring the impact of integrated systems research
Measuring the impact of integrated systems research
 
TESTING NEW SOCIAL INNOVATION POLICIES ON LOCAL AND REGIONAL LEVEL
TESTING NEW SOCIAL INNOVATION POLICIES ON LOCAL AND REGIONAL LEVELTESTING NEW SOCIAL INNOVATION POLICIES ON LOCAL AND REGIONAL LEVEL
TESTING NEW SOCIAL INNOVATION POLICIES ON LOCAL AND REGIONAL LEVEL
 
04 policy training agrifose-willis
04 policy training agrifose-willis04 policy training agrifose-willis
04 policy training agrifose-willis
 
BRAINPOoL Workshop 24 March 2014: E-frame presentation
BRAINPOoL Workshop 24 March 2014: E-frame presentationBRAINPOoL Workshop 24 March 2014: E-frame presentation
BRAINPOoL Workshop 24 March 2014: E-frame presentation
 
Nicholas Mays: More than Methods
Nicholas Mays: More than Methods Nicholas Mays: More than Methods
Nicholas Mays: More than Methods
 
Key steps for the identification of Green Economy indicators
Key steps for the identification of Green Economy indicatorsKey steps for the identification of Green Economy indicators
Key steps for the identification of Green Economy indicators
 
Promoting Policy Coherence for Development: Exploring new opportunities for m...
Promoting Policy Coherence for Development: Exploring new opportunities for m...Promoting Policy Coherence for Development: Exploring new opportunities for m...
Promoting Policy Coherence for Development: Exploring new opportunities for m...
 
Strategic management
Strategic managementStrategic management
Strategic management
 
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
 
The development of ATNI: valuable lessons
The development of ATNI: valuable lessonsThe development of ATNI: valuable lessons
The development of ATNI: valuable lessons
 
FCAS M&E Seminar
FCAS M&E SeminarFCAS M&E Seminar
FCAS M&E Seminar
 
ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...
ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...
ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...
 
Introducing Policy Implementation and Evaluation.
  Introducing Policy Implementation and Evaluation.  Introducing Policy Implementation and Evaluation.
Introducing Policy Implementation and Evaluation.
 
From theory based policy evaluation to smart policy design: lessons learned f...
From theory based policy evaluation to smart policy design: lessons learned f...From theory based policy evaluation to smart policy design: lessons learned f...
From theory based policy evaluation to smart policy design: lessons learned f...
 
ASIS Guideline #4 2021 - Testing new social innovation policies on local and ...
ASIS Guideline #4 2021 - Testing new social innovation policies on local and ...ASIS Guideline #4 2021 - Testing new social innovation policies on local and ...
ASIS Guideline #4 2021 - Testing new social innovation policies on local and ...
 
ASIS project - Guidelines #4 - TESTING NEW SOCIAL INNOVATION POLICIES ON LOCA...
ASIS project - Guidelines #4 - TESTING NEW SOCIAL INNOVATION POLICIES ON LOCA...ASIS project - Guidelines #4 - TESTING NEW SOCIAL INNOVATION POLICIES ON LOCA...
ASIS project - Guidelines #4 - TESTING NEW SOCIAL INNOVATION POLICIES ON LOCA...
 
PPWNov13- Day 2 pm- Mogues and Billings- IFPRI
PPWNov13- Day 2 pm- Mogues and Billings- IFPRIPPWNov13- Day 2 pm- Mogues and Billings- IFPRI
PPWNov13- Day 2 pm- Mogues and Billings- IFPRI
 
Assignment_Group 2_Integrating Gender Equality.pptx
Assignment_Group 2_Integrating Gender Equality.pptxAssignment_Group 2_Integrating Gender Equality.pptx
Assignment_Group 2_Integrating Gender Equality.pptx
 
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
 

More from European Centre for Development Policy Management (ECDPM)

More from European Centre for Development Policy Management (ECDPM) (20)

How does ECDPM operate as a “think-and-do tank” in a changing development con...
How does ECDPM operate as a “think-and-do tank” in a changing development con...How does ECDPM operate as a “think-and-do tank” in a changing development con...
How does ECDPM operate as a “think-and-do tank” in a changing development con...
 
Principles for public-private partnerships – towards sustainability? Lessons ...
Principles for public-private partnerships – towards sustainability? Lessons ...Principles for public-private partnerships – towards sustainability? Lessons ...
Principles for public-private partnerships – towards sustainability? Lessons ...
 
EU Approaches and Instruments to Engage the Private Sector for Sustainable De...
EU Approaches and Instruments to Engage the Private Sector for Sustainable De...EU Approaches and Instruments to Engage the Private Sector for Sustainable De...
EU Approaches and Instruments to Engage the Private Sector for Sustainable De...
 
Post Cotonou, EU-Africa and the EU-SADC EPA: Key issues and debates
Post Cotonou, EU-Africa and the EU-SADC EPA: Key issues and debatesPost Cotonou, EU-Africa and the EU-SADC EPA: Key issues and debates
Post Cotonou, EU-Africa and the EU-SADC EPA: Key issues and debates
 
Peace keeping operations in Africa: Reflections on the APSA and strategic par...
Peace keeping operations in Africa: Reflections on the APSA and strategic par...Peace keeping operations in Africa: Reflections on the APSA and strategic par...
Peace keeping operations in Africa: Reflections on the APSA and strategic par...
 
Civil-military coordination in the Lake Chad region (case)
Civil-military coordination in the Lake Chad region (case)Civil-military coordination in the Lake Chad region (case)
Civil-military coordination in the Lake Chad region (case)
 
Policy coherence for agricultural development and food security The case of a...
Policy coherence for agricultural development and food security The case of a...Policy coherence for agricultural development and food security The case of a...
Policy coherence for agricultural development and food security The case of a...
 
ECDPM-Presentation-Addressing-Hunger-Poverty-Policy-Coherence-2030-Agenda-2017
ECDPM-Presentation-Addressing-Hunger-Poverty-Policy-Coherence-2030-Agenda-2017ECDPM-Presentation-Addressing-Hunger-Poverty-Policy-Coherence-2030-Agenda-2017
ECDPM-Presentation-Addressing-Hunger-Poverty-Policy-Coherence-2030-Agenda-2017
 
Policy Coherence & the 2030 Agenda Building on the PCD experience
Policy Coherence & the 2030 Agenda Building on the PCD experiencePolicy Coherence & the 2030 Agenda Building on the PCD experience
Policy Coherence & the 2030 Agenda Building on the PCD experience
 
EU Development Cooperation and Humanitarian Aid ‘Living Apart Together’
EU Development Cooperation and Humanitarian Aid ‘Living Apart Together’EU Development Cooperation and Humanitarian Aid ‘Living Apart Together’
EU Development Cooperation and Humanitarian Aid ‘Living Apart Together’
 
Sustainability and human rights in EPAs: A comparative analysis between the C...
Sustainability and human rights in EPAs: A comparative analysis between the C...Sustainability and human rights in EPAs: A comparative analysis between the C...
Sustainability and human rights in EPAs: A comparative analysis between the C...
 
Tax, Good governance and the problem of illicit financial flows from Africa
Tax, Good governance and the problem of illicit financial flows from AfricaTax, Good governance and the problem of illicit financial flows from Africa
Tax, Good governance and the problem of illicit financial flows from Africa
 
The Future of ACP-EU Relations: Scenarios for Post Cotonou 2020
The Future of ACP-EU Relations:Scenarios for Post Cotonou 2020The Future of ACP-EU Relations:Scenarios for Post Cotonou 2020
The Future of ACP-EU Relations: Scenarios for Post Cotonou 2020
 
Political Economy of Continental Integration - Peria and the CFTA: Conceptua...
Political Economy of Continental Integration - Peria and the CFTA: Conceptua...Political Economy of Continental Integration - Peria and the CFTA: Conceptua...
Political Economy of Continental Integration - Peria and the CFTA: Conceptua...
 
The political economy around regional food market integration and policies in...
The political economy around regional food marketintegration and policies in...The political economy around regional food marketintegration and policies in...
The political economy around regional food market integration and policies in...
 
Political Economy of Regional Integration in Africa: What drives and constrai...
Political Economy of Regional Integration in Africa: What drives and constrai...Political Economy of Regional Integration in Africa: What drives and constrai...
Political Economy of Regional Integration in Africa: What drives and constrai...
 
Migration in Africa Europe relations
Migration in Africa Europe relationsMigration in Africa Europe relations
Migration in Africa Europe relations
 
Too nice to fail? EU external action towards Africa
Too nice to fail? EU external action towards AfricaToo nice to fail? EU external action towards Africa
Too nice to fail? EU external action towards Africa
 
The EIB’s innovative role in the ACP under Cotonou: Options Beyond 2020
The EIB’s innovative role in the ACP under Cotonou: Options Beyond 2020The EIB’s innovative role in the ACP under Cotonou: Options Beyond 2020
The EIB’s innovative role in the ACP under Cotonou: Options Beyond 2020
 
Evaluation of the EU Support to Research and Innovation in Partner Countries ...
Evaluation of the EU Support to Research and Innovation in Partner Countries ...Evaluation of the EU Support to Research and Innovation in Partner Countries ...
Evaluation of the EU Support to Research and Innovation in Partner Countries ...
 

Recently uploaded

Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demoHarshalMandlekar2
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????blackmambaettijean
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 

Recently uploaded (20)

Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 

Development of a methodology for country-level assessments of PCD impacts on food security: What, why and how - initial thoughts based on a literature review

  • 1. What, why and how – initial thoughts based on a literature review Quentin de Roquefeuil & Jeske van Seters 23 May 2013, OECD Conference Centre Working Group on Agricultural Policies and Markets Meeting Development of a methodology for country- level assessments of PCD impacts on food security:
  • 2. 1.  What the methodology is about 2.  Key lessons from the literature review 3.  Initial ideas on the methodology 4.  Questions for discussion Structure of the Presentation ECDPM Page 2
  • 3. 1. What the methodology is about
  • 4. •  Non-development policies of OECD member countries (e.g. agriculture, trade, investment, science) can have an impact on developing countries •  2008 OECD Ministerial declaration confirmed commitment to promote Policy Coherence for Development •  The declaration included the resolution to further invest in measuring the effects of OECD members’ policies on international development objectives. Context ECDPM Page 4
  • 5. ECDPM Page 5 Measuring PCD = one of the key OECD PCD building blocks
  • 6. •  PCD section in ex-ante impact assessments of OECD member countries’ policy proposals •  PCD section in OECD DAC Peer Reviews - assessing PCD commitments, institutional mechanisms, efforts to improve development financing beyond aid,… •  Ex-post assessments of OECD policy impact at developing country level Different ways to measure PCD ECDPM Page 6
  • 7. General objective: to develop a methodology for identifying and assessing the impacts of OECD policies on food security in individual developing countries Specific objectives: 1.  Help OECD DAC members in pursuing their PCD policy objectives through providing evidence for policy change domestically and for programme design at country level (e.g. more information to address trade-offs between internal goals & negative externalities on developing countries) 2.  Enable partner countries and civil society advocate for improved PCD and to address the impacts of incoherencies. Objectives ECDPM Page 7
  • 8. ECDPM Page 8 OECD policies (domestic, aid, bilateral/ international) Developing country’s food system (e.g. prices, functioning of markets) Developing country’s food security situation International rules and regulations Developing country’s policy priorities Focus of the assessment
  • 9. Steps to develop the methodology
  • 11. Objectives •  Review of different studies attempting to determine effect of OECD policies on developing countries (NGOs, academia, etc). •  Focus on the methodology used in the studies. •  Assess general robustness of findings. •  See whether we could incorporate some aspects of their methodology into ours, and draw some general lessons. Page 11ECDPM
  • 12. •  How did we select the studies? 1.  Assess impact at individual developing country level (not aggregate). 2.  Focus on a clearly identifiable policy or instrument emanating from one or several OECD countries (no general concepts, e.g. “neoliberalism”, “protectionism”). 3.  Sample should cover wide range of data collection methods and analytical approaches (try to get as many approaches as possible in the sample). Sample selection ECDPM Page 12
  • 13. Overview of data collection methods & analytical frameworks !"#$%&'$()*+* ,-./)*0%-/1) 2/3"#'#3#&$*43#3* ,%-5* !"#$%"3#'-"36*+* "3#'-"36*+*1%'&3#$* )-/%.$) 7-%8)9-1) :/%&$;) <-./5$"#*%$&'$(***=-"$* 2/36'#3#'&$* 2/3"#'#3#'&$ >-5?'"3#'-"* ! "#$%& ' ' ' ' ( ")*+,-. ' ' / "*&*0& ' ' 1 23.,+*4&*546&--%+7,4 ' ' ' 8 2933:,4;<=>6 ' ' ? @&*-39+ ' ' A @">BC ' ' D @E9-0, ' ' F ;&%#G+H: ' ' ' !I ;JCK ' ' ' !! ;03$ ' ' !( <@LBMK ' ' !/ <E93$"N90H& ' ' ' !1 O3*-&*4K+9, ' ' ' !8 J3350,3* ' ' !? P&95E, ' ' !A P+))+ ' ' ' !D P0#50-H% ' ' !F P3+G0*: ' ' ' (I PE)$%9+.4Q(II1R4 ' ' ' (! PE)$%9+.4Q(IIDR ' ' ' (( L#0S0T ' ' ' (/ >&&,H% ' ' ' ' (1 B0H%&95,3* ' ' ' (8 KH33*+, ' ' ' (? K-+S+*, ' ' ' (A U3*V+9+*W4=&* ' ' (D U++NN+#+*W4S&*4Q(I!(R ' ' (F U++NN+#+*W4S&*4Q(I!/R ' ' ' ' /I X&-:0*,4 ' ' @-#36* AB CD CA A A CA CE F G H <3#3*.-66$.#'-"*5$#9-4 I"36;#'.36*,%35$(-%8* J K$,$%$".$*
  • 14. 1.  Some studies tweak the methodology (e.g. selection of interviewees) to get to the results. 2.  Need to define early what is it exactly that is being impacted on (deconstruct “food security”). 3.  Deductive approach works well. 4.  Country selection criteria? 5.  Need to be clear about the period being covered by the analysis. 6.  We can (and should) combine data collection methods (e.g. interviews/quantitative data) and analytical approaches (e.g. modeling/ value chain analysis) at different stages in the analysis/process. What did we learn? ECDPM Page 14
  • 15. 7.  Developing country policies and characteristics (net food import/export, social policies, governance) deserve to be at centre stage because they exert a large influence on impact. 8.  Disaggregation between social groups poses data availability problems. 9.  Local stakeholder involvement can go beyond interviews. But risk of “capture” needs to be managed. What did we learn (cont’d) ECDPM Page 15
  • 16. 3. Initial ideas on the methodology: guiding principles and main steps
  • 17. •  Stakeholder involvement •  Deductive reasoning •  Disaggregation between social groups •  Triangulation (through use of mix of data collection methods and analytical approaches) Guiding Principles ECDPM Page 17
  • 18. 1.  Country selection 2.  Clarify the ‘baseline’ (through internationally accepted quantitative and qualitative indicators of the food security system) 3.  Identify OECD policies impacting on the food security system through desk review 4.  In-country testing of hypotheses 5.  Dissemination and use of the findings Main Steps ECDPM Page 18
  • 19. 4. Questions for discussion
  • 20. 1.  How can the methodology be most effective for informing OECD countries’ policymaking? 2.  What are your views on the key guiding principles and steps of the methodology? 3.  How do we manage the tradeoff between user-friendliness and depth? 4.  How to insure inclusiveness while avoiding interest group capture? Questions for Discussion Page 20ECDPM
  • 21. Thank you for your kind attention. Quentin de Roquefeuil qd@ecdpm.org Jeske van Seters jvs@ecdpm.org Page 21