Experience with the DESIGN OF LOGICAL FRAMEWORKS AND THE EVALUATION OF DELIVERY BASED ON QUANTIFIABLE TARGETS AND MEASURABLE INDICATORS

1. EXPERIENCE WITH THE DESIGN OF LOGICALEXPERIENCE WITH THE DESIGN OF LOGICAL
FRAMEWORKS AND THE EVALUATION OFFRAMEWORKS AND THE EVALUATION OF
DELIVERY BASED ON QUANTIFIABLE TARGETSDELIVERY BASED ON QUANTIFIABLE TARGETS
AND MEASURABLE INDICATORSAND MEASURABLE INDICATORS
David VousdenDavid Vousden
Effective GEF IW IndicatorsEffective GEF IW Indicators

2. Targets need to be based on real interventions and ‘concrete’Targets need to be based on real interventions and ‘concrete’
activities. Some examples….activities. Some examples….
Process IndicatorsProcess Indicators: legislative reform for sustainable fisheries or: legislative reform for sustainable fisheries or
water qualitywater quality
Stress Reduction IndicatorsStress Reduction Indicators: Sewage treatment systems up and: Sewage treatment systems up and
running; Gear changes/modification in fisheriesrunning; Gear changes/modification in fisheries
Environment/socioeconomic IndicatorsEnvironment/socioeconomic Indicators: By-catch reduced;: By-catch reduced;
catches of threatened species reduced (landingcatches of threatened species reduced (landing
figures/observers); nutrient loads down; nutrient –demanding algalfigures/observers); nutrient loads down; nutrient –demanding algal
levels downlevels down
How to ensure that targets andHow to ensure that targets and
indicators are appropriateindicators are appropriate

3. Targets should NOT be based on intangeable orTargets should NOT be based on intangeable or
unmeasurable/impractical indicators (some examples!)unmeasurable/impractical indicators (some examples!)
Political will for improving fisheries and water qualityPolitical will for improving fisheries and water quality
approaches raised/improvedapproaches raised/improved
Management practices for stress reduction expandedManagement practices for stress reduction expanded
Improved water quality on coral reefsImproved water quality on coral reefs
Raised quality of life in communitiesRaised quality of life in communities
These are difficult or often impossible to quantify and areThese are difficult or often impossible to quantify and are
subjective in any evaluation processsubjective in any evaluation process
Inappropriate Targets andInappropriate Targets and
Indicators!Indicators!

4. There are… in terms of the need to focus on transboundaryThere are… in terms of the need to focus on transboundary
deliverables at a regional leveldeliverables at a regional level
These can be hard to quantify because of the need to show aThese can be hard to quantify because of the need to show a
balanced set of deliveries across a number of countries thatbalanced set of deliveries across a number of countries that
should represent an equitable regional effortshould represent an equitable regional effort
As an example, the ASCLME project is dealing with this problemAs an example, the ASCLME project is dealing with this problem
by undertaking a national Marine Ecosystem Diagnostic Analysisby undertaking a national Marine Ecosystem Diagnostic Analysis
(MEDA) in each country first….(MEDA) in each country first….
This is then reflected synergistically in the overall TDAThis is then reflected synergistically in the overall TDA
Are their special challenges thatAre their special challenges that
relate to IW Log Frame design?relate to IW Log Frame design?

5. This is a logical and effective approach as it provides a clear flowThis is a logical and effective approach as it provides a clear flow
from concept to concrete action….from concept to concrete action….
1.1. Changes in approach, policy and legislation (processChanges in approach, policy and legislation (process
reforms)reforms)
2.2. Actual efforts to deliver these reforms as concrete actionsActual efforts to deliver these reforms as concrete actions
for reducing stresses on the ‘system’for reducing stresses on the ‘system’
Leading to…Leading to…
3.3. Measurable improvements at the ecosystem/biologicalMeasurable improvements at the ecosystem/biological
community/social community/ species levels (which cancommunity/social community/ species levels (which can
feed back to 1. above)feed back to 1. above)
Use of Process, Stress ReductionUse of Process, Stress Reduction
and Environmental/Socioeconomicand Environmental/Socioeconomic
Status indicatorsStatus indicators

6. A.A. Log Frames are frequently out-of-date at Project InceptionLog Frames are frequently out-of-date at Project Inception
(may be several years old!) therefore….(may be several years old!) therefore….
B.B. Review and revision of Log Frames is often one of the firstReview and revision of Log Frames is often one of the first
important activities for the Projectimportant activities for the Project
C.C. This agreement/ approval of a reviewed and revised LogThis agreement/ approval of a reviewed and revised Log
Frame by participating countries and the Project SteeringFrame by participating countries and the Project Steering
Committee can be extremely valuable and critical in buildingCommittee can be extremely valuable and critical in building
country ownership and support (especially as the PSCcountry ownership and support (especially as the PSC
members and National Focal Institutions and theirmembers and National Focal Institutions and their
policies/priorities may have changes since the original Logpolicies/priorities may have changes since the original Log
Frame was designed)Frame was designed)
Some weaknesses in Log FrameSome weaknesses in Log Frame
designdesign

7. These are a very useful component of the Log Frame but alsoThese are a very useful component of the Log Frame but also
they DO need to be reviewed at Project Inception/Implementationthey DO need to be reviewed at Project Inception/Implementation
along with this rest of the Log Frame for the same reasons asalong with this rest of the Log Frame for the same reasons as
stated in the previous slide (changes over time, countrystated in the previous slide (changes over time, country
agreement and ownership)agreement and ownership)
One clear example would be in the ASCLME Project in theOne clear example would be in the ASCLME Project in the
western Indian Ocean where the original document did not identifywestern Indian Ocean where the original document did not identify
piracy as a risk but which has now become one the greatestpiracy as a risk but which has now become one the greatest
transboundary threats to the projecttransboundary threats to the project
It is important to realise that the Project (and therefore its LogIt is important to realise that the Project (and therefore its Log
Frame) is not written in stone and SHOULD be reviewed fromFrame) is not written in stone and SHOULD be reviewed from
time to time as part of a flexible, evolving and dynamic projecttime to time as part of a flexible, evolving and dynamic project
Risks and AssumptionsRisks and Assumptions

8. A.A. There is a need to develop some standardised Indicators forThere is a need to develop some standardised Indicators for
certain situations and projects to allow for a more comparablecertain situations and projects to allow for a more comparable
review process. (e.g. LME indicators could focus on the 5review process. (e.g. LME indicators could focus on the 5
modules of the LMEs)modules of the LMEs)
B.B. A review of the Logical Framework Matrix at Inception orA review of the Logical Framework Matrix at Inception or
soon after should be a standard requirement to ensuresoon after should be a standard requirement to ensure
accuracy of evaluation and true country ownershipaccuracy of evaluation and true country ownership
C.C. Part of the mandate of the Mid Term Reviewers should be toPart of the mandate of the Mid Term Reviewers should be to
re-visit the Log Frame with the stakeholders and to advise there-visit the Log Frame with the stakeholders and to advise the
Project on any appropriate modifications or additions to theProject on any appropriate modifications or additions to the
Log Frame to ensure a more accurate and representativeLog Frame to ensure a more accurate and representative
Terminal EvaluationTerminal Evaluation
Better use of Log Frames in ProjectBetter use of Log Frames in Project
Design and ManagementDesign and Management

9. 1.1. On-going ‘progress-chasing’ of deliverables during the ProjectOn-going ‘progress-chasing’ of deliverables during the Project
lifetime using Log Frame indicators (continuous assessmentlifetime using Log Frame indicators (continuous assessment
and fine-tuning)and fine-tuning)
2.2. Post-Project Evaluation of Indicators to ensure sustainabilityPost-Project Evaluation of Indicators to ensure sustainability
of Project objectives and GEF Investmentof Project objectives and GEF Investment
Other improvements to the useOther improvements to the use
of GEF IW Indicatorsof GEF IW Indicators

10. THANK YOU!THANK YOU!
Effective GEF IW IndicatorsEffective GEF IW Indicators