Presented at the annual conference of the World Association for Public Opinion Research, Austin, TX, May 11, 2016 Nurhan Kocaoglu, Zahra Lutfeali – Counterpart International Julie E. Phelan, Gary Langer, Gregory G. Holyk – Langer Research Associates Matthew Warshaw – D3 Systems Inc.

1. Impact Assessment:
Bangladesh Leadership
Development Program
Presented at the annual conference of the
World Association for Public Opinion Research
Austin, Texas - May 11, 2016
Nurhan Kocaoglu, Zahra Lutfeali – Counterpart International
Julie E. Phelan, Gary Langer, Gregory G. Holyk – Langer Research Associates
Matthew Warshaw – D3 Systems Inc.

2. Nurhan Kocaoglu
Counterpart International
Project Background

3.  Funded by USAID, implemented by Counterpart
International in partnership with five Bangladesh CSOs,
2012-15
 Train current and future leaders to participate
effectively in community development; enhance their
civic engagement and democratic values
 Build and support the capacity of adult community leaders
 Encourage emerging youth leaders to become change
agents for democratic processes and local development
BLDP Background

4.  Among the world’s poorest, most densely populated
countries
 Annual GNI per capita $1,097 (2014); 32% poverty
 Little economic opportunity, broad environmental
degradation, lack of access to clean water, electricity
and sewage systems; unsafe working conditions,
substandard construction/; persistent gender inequities
 Developing democracy; centralized, insular and
entrenched political system
 Pervasive corruption and distrust of national gov’t
 Local development dominated by connected elites,
chained to political and financial gain
Country Background: Bangladesh

5. Lack of understanding of civil rights and
responsibilities
Lack of participation in community decision
making
Lack of awareness of means by which
elected officials can be held accountable
Absence of decentralized, independent
community-level leadership
BLDP Concerns

6.  Identify adult and youth community leaders via
CSO partners
 Train in participatory rural appraisal techniques to
identify key development needs and identify assets
and resources available to address them
 Build capacity of participants to engage with other
community members, local government officials and
other civil society leaders to promote needed
development and improve accountability
BLDP Intervention Approach

7. Review the community development/civic
engagement literature to inform BLDP
curriculum and assessment plan
Conduct an independent, empirically based
assessment of BLDP’s effectiveness
Assessment produced by Langer Research
Associates; field work management by D3
Systems, Inc.; field work by ORG Quest Ltd.
Research Needs

8. Gary Langer
Langer Research Associates
Research Design and Execution

9. Is the BLDP achieving its goal of increasing
the leadership capacity, skills, engagement
and effectiveness of its participants?
What does the literature tell us about
effective civic engagement and how can it
inform our research design?
Research Questions

10.  Importance of cultural context in leadership training
 Sensitivity toward norms of traditional behavior for women
 Impact on women’s views of their ability to effect change
 Cultural norms reflect deeply ingrained underlying values,
inc. religious beliefs, that are difficult to influence
 Underscore compatibility of civic involvement/democratic
values and religious/traditional beliefs by emphasizing
shared concepts, e.g., tolerance, respect, community
 Buy-in from religious, cultural/traditional or business
leaders promotes program legitimacy
Literature Review – Key Findings (I)

11.  Information encourages interest and empowers individuals
to take an active role in community affairs
 Enhanced leadership skills promote confidence and self-
efficacy; these encourage involvement
 Program effects may be subtle, require multiple measures
 Beware of ceiling effects
 Local living conditions and quality of instruction (teachers,
teaching materials, topics and strategies) impact success
Literature Review – Key Findings (II)

12.  Assist in design of participant database
 Conduct F2F pre-treatment interviews with a random
sample of 1,750 Cohort 1 participants, Feb. 21-March 24,
2013
 F2F post-treatment interviews with a random sample of
1,731 Cohort 1 and 2 participants and pre-treatment
interviews with 1,750 Cohort 3 participants, Jan. 12-Feb.
16, 2015
 Combine questions in construct-specific indices (tested
with Cronbach’s alpha) mapped to program performance
benchmarks
 Given large sample sizes, use a more rigorous approach -
Cohen’s d - to assess significant change in index scores
(difference between two means divided by stdev)
Assessment

13. Key Findings

14. Importance of civic values

15. Are civic & religious values compatible?

16. Acceptance of others
See community as highly respectful of…
• Religious leaders of other faiths: +21 pts
• Ethnic and religious minorities: +11
• Women who are involved in the community: +9
• Young women who are involved in the community: +14

17. Willingness to work with others

18. Civic participation rates

19. Leadership roles

20. Information

21. Self-efficacy

22. Belief you can have any influence on local
government
Pre-training: 40%
Post-training: 61%
Ability to influence government

23. Efficacy: Accountability

24. Efficacy: Self confidence

25. Rate self as highly skilled in
 Teamwork: +18 pts
 Problem-solving: +18
 Communication: +17
 Conflict resolution: +17
 Decision making: +17
Efficacy: Group skills

26. Overall impacts

27.  The BLDP successfully produced measurable,
positive advances in trainees’ political and
community engagement and commitment to
community development
 Gains were broadly based across metrics, including:
 Greater understanding of democracy and development
issues
 Broader belief in own ability to effect change
 Enhanced acceptance of others
 More extensive involvement in community activities
Conclusions

28.  Gains were smaller among previously trained
participants; offer them enhanced training or
mentoring roles
 Gains were smaller among those in more difficult
living conditions; offer them additional support
 Gains differed among implementing partners;
ensure and monitor training quality
 Address room for additional improvement in some
areas, e.g. efficacy and involvement in community
development activities
Recommendations

29. Takeaways for Counterpart

30.  Capacity building and learning experience
 Solidifying and building upon the organization’s work
 Best practices of creating change & ensuring sustainability
 Desired effect?
Insights & Gains

31. Impact Assessment:
Bangladesh Leadership
Development Program
Thank you!