This webinar provided an overview of evaluating climate change interventions for excluded populations. It discussed the challenges of evaluating climate change adaptations given uncertainties and timescales that differ from project timelines. It then summarized three approaches to evaluation: the UNDP framework, the SCR consortium's ADAPT framework, and IIED's approach linking adaptation and development. Key lessons included the need to evaluate policy environments, development outcomes, and adaptive capacity. Further challenges discussed capturing relationships between adaptation and equity.

1. WELCOME to the webinar
“Evaluation of Climate Change
Interventions for Excluded
Populations.”
11 June 2012
This Live Webinar will start at 1:00 PM New York time.
All microphones & webcams are disabled and we will only enable microphones during
the Q&A portion.
Therefore, you will not hear any sound/noise till the beginning of the webinar.

2. Series of 17 live webinars on
“Equity-focused Evaluations”
Interact live with 28 world-level evaluators
This series of webinars addresses the challenges and
opportunities in evaluating the effects of policies, programmes
and projects to enhance equitable development results, with a
special focus on the effects to the most excluded, marginalized
and deprived groups.

4. The books are available for free at
MyM&E Virtual Library: www.mymande.org

6. Webinars on Equity-focused Evaluation 2011
Colin KIRK Evaluation to accelerate progress towards 6 September 2011
equitable development 9:30 AM NY time
Penny HAWKINS
Belen SANZ
Human rights and Gender equality in evaluations 21 September 2011
Flaminia MINELLI 9:30 AM NY time
Marco SEGONE How to design, implement and use equity- 4 October 2011
oriented evaluations 11:30 AM NY time
Michael BAMBERGER
Saville KUSHNER Case study evaluation as an intervention for 11 October 2011
promoting equity 9:30 AM NY time
Bob WILLIAMS Systems approach (CSH) to address ethical 14 November 2011
issues 3:00 PM NY time
Martin REYNOLDS
Patricia ROGERS Program theories and LogFrames to evaluate 22 November 2011
pro-poor and equity programs 4:00 PM NY time
Richard HUMMELBRUNNER
Michael Quinn PATTON Developmental Evaluation 6 December 2011
11:30 AM NY time

7. Webinars on Equity-focused Evaluation 2012
Donna MERTENS Methodological guidance in evaluation for Social 24 January 2012
Justice 9:30 AM NY time
Jennifer GREENE Values-Engaged Evaluation 15 February 2012
1:00 PM NY time
Michael Quinn PATTON How to evaluate interventions in complex 28 February 2012
dynamic environments? 11:30 AM NY time
Rodney HOPSON Cultural Responsiveness in Applied Research 15 March 2012
and Evaluation Settings
2:00 PM NY time
Katrina BLEDSOE
Juha UITTO Evaluating equity-focused public policies. The 27 March 2012
case of Brazil and Mexico 9:30 AM NY time
Oscar A. GARCIA
Katherine HAY Strengthening Equity-focused evaluations 15 May 2012
through insights from feminist theory and 8:30 AM Delhi (India) time
Ratna SUDARSHAN approaches 10:00 AM Bangkok (Thailand) time
11:00 AM Manila (Philippines) time

8. Webinars on Equity-focused Evaluation 2012
Julian BARR Evaluation of climate change interventions for 11 June 2012
excluded populations 1:00 PM NY time
Robbie GREGOROWSKI
Sulley GARIBA Evaluation of pro-poor urban interventions 28 June 2012
1:00 PM NY time
Guy THIJS Evaluation of the ILO’s strategy to eliminate To be announced.
discrimination in employment and occupation
Francisco GUZMAN

9. The recordings are available at
www.mymande.org

10. The recordings are available at
www.mymande.org

11. The recordings are available at
www.mymande.org

12. Interact with
Questions and Answers
Type here

13. Keynote Speakers
“Evaluation of climate change interventions for excluded populations”
Julian Barr, International Trade & Development (ITAD)
Robbie Gregorowski, International Trade & Development (ITAD)

14. Agenda
1:00 – 1:05 PM Welcome and introduction
Marco Segone, Systemic Management,
UNICEF Evaluation Office
1:05 – 1:20 Julian Barr, International Trade & Development (ITAD)
1:20 – 1:35 Robbie Gregorowski, International Trade & Development (ITAD)
1:35 – 1:55 Questions and Answers
Moderator: Stewart Donaldson, Dean & Chair of Psychology
School of Behavioral & Organizational Sciences,
Claremont Graduate University
1:55 – 2:00 Wrap-up: Penny Hawkins, Evaluation Office,
The Rockefeller Foundation

15. Evaluation of climate
change interventions for
excluded populations
Julian Barr and Robbie Gregorowski
International Trade & Development (ITAD)

16. Outline
• The nature of climate change interventions
• Excluded populations
• Climate change evaluation challenges
• Climate change evaluation frameworks
• Addressing the challenges

17. Climate Change (CC)
The nature of CC interventions
• IPCC identifies two main responses to CC change:
mitigation and adaptation
• Adaptation shares common ground with Disaster
Risk Reduction (DRR)
• Sudden onset climate-related events (floods, cyclones, etc)
• But note, slow onset climate-related events (sea-level rise,
changing rain-fall patterns)
• Now major focus on Climate Change Resilience
• Our main focus: adaptation and resilience

18. Categories of Adaptation
Type of Adaptation Type of Action Example
Addressing the Coping / resilience Livelihood diversification;
adaptation deficit building crop insurance; DRR early
warning systems
Adapting to Climate proofing Improved drainage
incremental changes systems; adapting cropping
systems (short seasons)
Adapting to qualitative Transformational Resettlement;
changes change transformation of
agricultural systems
Brooks et al, 2011. IIED

19. Excluded populations
• In CC terms, excluded populations seen as those most
vulnerable to climate-related shocks and stresses
• i.e “susceptible to, or unable to cope with, adverse effects of
climate change”
 low adaptive capacity
• Adaptive capacity: function of both individual & societal
capacity
• household resources + institutions & policy
• Climate vulnerability and poverty closely linked
• also gender, age, ethnic minority dimensions
• drivers of CC vulnerability not all climate-related

20. Climate
change,
Vulnerability,
& Poverty
Change in length
of cropping
season, 2000 -
2050.
ILRI, 2002

21. Evaluating what?
Climate change adaptation frameworks
Two main aspects:
Result Indicator
1. Capacity of govt & Existence of policy & other
institutions to understand mechanisms that promote
CC & integrate Adaptation knowledge & action on CC
into decision making
2. Climate change - Adaptive capacity
adaptation keeps - Development outcomes
development ‘on track’

22. Adaptation: evaluation challenges
1. Timescale disconnects:
• Adaption: project timescale
• Climate change: longer timescale (slow onset risks)
2. Declining baseline:
• Climate is changing: measuring development success against a
worsening situation; normalise for vulnerability
3. Uncertainty:
• climate scenarios still highly uncertain at local, national and
regional levels.
4. Unintended consequences:
• Maladaptation
5. Focus of CCA on coping strategies and climate
proofing (short sighted)

23. Addressing the challenges:
three approaches to evaluating CCA
UNDP:
• Proposed Framework for Monitoring Adaptation to Climate
Change. Draft. (2008)
Strengthening Climate Resilience (SCR)
consortium:
• Learning to ADAPT: monitoring and evaluation approaches
in climate change adaptation and DRR. Silva Villaneuva
(2011)
IIED:
• Tracking adaptation and measuring development. Brooks et al
(2011).

24. UNDP

25. SCR consortium: ADAPT framework
An integrated set of outcome and process based indicators that
consider environmental, disaster, climate change and developmental
domains of decision-making

26. ADAPT approach
• Framework of questions and indicators
• Learning approach
• Employs constant monitoring to allow flexibility
and enhance capacities to deal with uncertainty

27. IIED: Adaptation measurement

28. In practice: Rockefeller ACCCRN
www.acccrn.org

29. Linking the streams
Indicators of
Adaptive Capacity:
society, communities,
households, individuals

30. Indicators of adaptive capacity
Main characteristics which enhance adaptive capacity
identified as:
• Promoting diversity
• Creating flexible effective institutions
• Accepting non-equilibrium (?)
• Adopting multi-level perspectives
• Integrating uncertainty
• Ensuring community involvement
• Promoting learning
• Advocating for equity
• Recognizing the importance of social values and structures
• Working towards preparedness, planning and readiness
Adapted from GEF: Tracking Progress for Effective Action - A Framework for Monitoring and Evaluating Adaptation to Climate Change. Sanahuja (2011)

31. Evaluation lessons
All 3 approaches broadly focus on:
• combining top down and bottom up approaches
• link: integrating CC into policy/institutions  actions at
the households/community level
Evaluation should not separate the two streams
• Top: policy environment
• Bottom: development outcomes
• Missing middle: assessing the adaptive capacity / behavior
of people and society
• adaptive capacity encompasses knowledge, attitudes and
practices (KAP) at a number of levels

32. Further evaluation challenges
M&E frameworks for CC still in infancy.
Needs:
• approaches to satisfactorily join upstream and downstream
• to develop and test indicators of adaptive capacity at different
levels and for different groups to fill the missing middle
• develop methods for assessing the relationship between adaptation
and equity (zero-sum games)
• explore existing indicator frameworks, such as the Sustainable
Livelihoods Framework, to clarify relationships between
determinants of adaptive capacity along the results chain
• establish mechanisms for M&E to empower excluded populations by
feeding-back between the upstream and downstream tracks, as part
of increasing climate accountability and transparency

33. Questions and Answers
MODERATOR
Stewart Donaldson, Dean & Chair of Psychology
School of Behavioral & Organizational Sciences,
Claremont Graduate University

34. Audience Questions

35. Wrap-up
Penny Hawkins, Rockefeller Foundation Evaluation
Office, is the former Head of Evaluation for the New
Zealand Aid Program, Ministry of Foreign Affairs and
Trade and Vice-Chair of the OECD-DAC Network on
Development Evaluation. She is a past President of the
Australasian Evaluation Society, a founding board
member of the International Organization for Cooperation
in Evaluation (IOCE) and an IPDET (International
Program for Development Evaluation Training) faculty
member.

36. The recording will be available at
www.mymande.org

37. The recording will be available at
www.mymande.org

38. Next webinar, 28 June 2012,
1:00PM New York time
“Evaluation of pro-poor urban interventions”
Sulley Gariba, Institute for Policy Alternatives (IPA), Ghana

39. Evaluation of Webinars
Survey
Your opinion/feedback is important to us, therefore
we ask that you complete this short evaluation on
today’s webinar.
http://6.11.questionpro.com/