SlideShare una empresa de Scribd logo
1 de 30
Evaluating Advocacy: Dilemmas, Tactics, and Methods Julia Coffman Center for Evaluation Innovation jcoffman@evaluationinnovation.org October 7, 2011
Three Questions ,[object Object], What can we measure about advocacy? How can we measure it?
How is evaluating  advocacy different?
Challenge: The policy environment is complex,  and that makes attribution hard.
Solution: If accountability is the purpose, demonstration of contribution  is expected, not attribution. What is my unique contribution?
Challenge: Advocacy strategies shift in  response to the environment. Shifting Politics Shifting Economics New Partners
Solution: Advocacy is a good opportunity  to integrate or embed evaluation for learning  (not just accountability). ADVOCACY EVALUATION
Challenge: Timeframes can be unpredictable. 1 Year 1 Year 1 Year Advocacy Timeframe Goal Reporting Timeframe
Solution: Assess progress,  not just the end result. Goal …progress…
What can we measure about influencing?
Measure meaningful things.  Don’t just count what is easy to quantify.
Have realistic expectations. What are other influencers doing? Where is your issue in the policy process? What’s the political  context? What’s the opposition doing? What are you doing and who are you targeting?
Measure the changes made along the way,  not just the end result. Policy Influence …progress… INTERIM OUTCOMES
Interim outcomes are the changes you expect as you work toward your goal. Think about the changes you will  see in your audiences.
Use the framework to think about interim outcomes. ACTION HOW will they change as a result of your work? WILL OUTCOMES AWARENESS WHO will change as a result of your work? DECISION MAKERS INFLUENCERS PUBLIC AUDIENCES
Where are your audiences? How far do you need to move them? ACTION Increase quality of child care WILL Child care providers INTERIM OUTCOMES AWARENESS Parents of young children DECISION MAKERS INFLUENCERS PUBLIC Legislators AUDIENCES
Interim Outcomes Awareness Action Increased knowledge Increased collaboration among advocates Increased issue visibility or recognition Increased media coverage Activities and Outputs Policy Goals Will Reframing of the issue Changed attitudes or beliefs New and active advocates Increased salience New and active high-profile champions Increased personal or collective efficacy New donors Increased willingness to act Increased or diversified funding Increased capacity  to act
How can we measure it?
Traditional Evaluation Methods Interviews Surveys Focus Groups Polling
Non-Traditional Methods Charting and Mapping Survey and Interview Debriefing and Rating Media/Messaging Tracking System Mapping Intense Period Debriefs Research Panels Media Tracking Media Scorecards Network Mapping Crowdsourcing 360-Degree Critical Incident Debriefs Advocacy Capacity Assessment Snapshot Surveys Policy Maker Ratings ECCO Analysis Critical Incident Timelines Intercept Interviews Policy Tracking Champion Tracking Bellwether Methodology
Bellwether Methodology Bellwethers are:  “Influentials” in the public and private sectors whose positions require that they are politically informed and that they track a broad range of policy issues ,[object Object]
 Administrators
 Media
 Other Advocates
 Funders
 BusinessDeveloped by Harvard Family Research Project
Bellwether Methodology
Bellwether Methodology Can preschool help address  the achievement gap? How would you address the achievement gap?
Bellwether Methodology What is the likelihood that California will increase preschool investments in the next 3 years?
Policymaker Ratings Ratings are completed for a whole governing body or defined group of policymakers Developed by Harvard Family Research Project

Más contenido relacionado

La actualidad más candente

Prt 595 week 2 lecture 2
Prt 595 week 2 lecture 2Prt 595 week 2 lecture 2
Prt 595 week 2 lecture 2ejadair
 
Stakeholder Mapping
Stakeholder MappingStakeholder Mapping
Stakeholder Mappingmartin1959
 
Stakeholder Analysis Pauline Hall
Stakeholder Analysis Pauline HallStakeholder Analysis Pauline Hall
Stakeholder Analysis Pauline Hallklenihan
 
Stephanie Marx Presentation
Stephanie Marx PresentationStephanie Marx Presentation
Stephanie Marx PresentationMediabistro
 
Stakeholder analysis
Stakeholder analysisStakeholder analysis
Stakeholder analysisStefan Csosz
 
Evaluation Theory Tree: Evaluation Approaches
Evaluation Theory Tree: Evaluation ApproachesEvaluation Theory Tree: Evaluation Approaches
Evaluation Theory Tree: Evaluation ApproachesInnovation Network
 
Collaborative work part IV DATA COLLECTION INSTRUMENTS
Collaborative work part IV DATA COLLECTION INSTRUMENTSCollaborative work part IV DATA COLLECTION INSTRUMENTS
Collaborative work part IV DATA COLLECTION INSTRUMENTSandrevallejo1217
 
10-Year Evaluation of Connecticut Health Foundation's Leadership Program
10-Year Evaluation of Connecticut Health Foundation's Leadership Program10-Year Evaluation of Connecticut Health Foundation's Leadership Program
10-Year Evaluation of Connecticut Health Foundation's Leadership ProgramConnecticut Health Foundation
 
Arma Presentation 2008.10.16
Arma Presentation 2008.10.16Arma Presentation 2008.10.16
Arma Presentation 2008.10.16naffeldt
 
PR Theory and Plan Writing
PR Theory and Plan WritingPR Theory and Plan Writing
PR Theory and Plan Writingmargyparker
 
1 1 stakeholder_analysis_11_01_05
1 1 stakeholder_analysis_11_01_051 1 stakeholder_analysis_11_01_05
1 1 stakeholder_analysis_11_01_05Mohammadsadegh1365
 
Marketing Plans: The key to reaching your target
Marketing Plans: The key to reaching your targetMarketing Plans: The key to reaching your target
Marketing Plans: The key to reaching your targetJessica Walter
 
How to do Stakeholder Analysis
How to do Stakeholder AnalysisHow to do Stakeholder Analysis
How to do Stakeholder AnalysisAberdeen CES
 
Logic Models and Theories of Change
Logic Models and Theories of ChangeLogic Models and Theories of Change
Logic Models and Theories of ChangeScot Evans
 

La actualidad más candente (20)

Prt 595 week 2 lecture 2
Prt 595 week 2 lecture 2Prt 595 week 2 lecture 2
Prt 595 week 2 lecture 2
 
Stakeholder Mapping
Stakeholder MappingStakeholder Mapping
Stakeholder Mapping
 
Stakeholder mapping
Stakeholder mappingStakeholder mapping
Stakeholder mapping
 
Stakeholder Analysis Pauline Hall
Stakeholder Analysis Pauline HallStakeholder Analysis Pauline Hall
Stakeholder Analysis Pauline Hall
 
Stephanie Marx Presentation
Stephanie Marx PresentationStephanie Marx Presentation
Stephanie Marx Presentation
 
Stakeholder analysis
Stakeholder analysisStakeholder analysis
Stakeholder analysis
 
Stakeholder Analysis
Stakeholder AnalysisStakeholder Analysis
Stakeholder Analysis
 
Evaluation Theory Tree: Evaluation Approaches
Evaluation Theory Tree: Evaluation ApproachesEvaluation Theory Tree: Evaluation Approaches
Evaluation Theory Tree: Evaluation Approaches
 
Collaborative work part IV DATA COLLECTION INSTRUMENTS
Collaborative work part IV DATA COLLECTION INSTRUMENTSCollaborative work part IV DATA COLLECTION INSTRUMENTS
Collaborative work part IV DATA COLLECTION INSTRUMENTS
 
10-Year Evaluation of Connecticut Health Foundation's Leadership Program
10-Year Evaluation of Connecticut Health Foundation's Leadership Program10-Year Evaluation of Connecticut Health Foundation's Leadership Program
10-Year Evaluation of Connecticut Health Foundation's Leadership Program
 
Arma Presentation 2008.10.16
Arma Presentation 2008.10.16Arma Presentation 2008.10.16
Arma Presentation 2008.10.16
 
PR Theory and Plan Writing
PR Theory and Plan WritingPR Theory and Plan Writing
PR Theory and Plan Writing
 
Stakeholder Analysis
Stakeholder AnalysisStakeholder Analysis
Stakeholder Analysis
 
Stakeholder Mapping: IA Summit 2014
Stakeholder Mapping: IA Summit 2014Stakeholder Mapping: IA Summit 2014
Stakeholder Mapping: IA Summit 2014
 
1 1 stakeholder_analysis_11_01_05
1 1 stakeholder_analysis_11_01_051 1 stakeholder_analysis_11_01_05
1 1 stakeholder_analysis_11_01_05
 
Marketing Plans: The key to reaching your target
Marketing Plans: The key to reaching your targetMarketing Plans: The key to reaching your target
Marketing Plans: The key to reaching your target
 
How to do Stakeholder Analysis
How to do Stakeholder AnalysisHow to do Stakeholder Analysis
How to do Stakeholder Analysis
 
Stakeholders Analysis
Stakeholders AnalysisStakeholders Analysis
Stakeholders Analysis
 
Ch 16 enc
Ch 16 encCh 16 enc
Ch 16 enc
 
Logic Models and Theories of Change
Logic Models and Theories of ChangeLogic Models and Theories of Change
Logic Models and Theories of Change
 

Similar a Arizona advocacy

Effective Advocacy: Best Practices from Ilm Ideas on Slide Share
Effective Advocacy: Best Practices from Ilm Ideas on Slide ShareEffective Advocacy: Best Practices from Ilm Ideas on Slide Share
Effective Advocacy: Best Practices from Ilm Ideas on Slide Shareilmideas
 
Power Of In Between M&E Session
Power Of In Between M&E SessionPower Of In Between M&E Session
Power Of In Between M&E Sessionpowerinbetween
 
Evaluation of Settings and Whole Systems Approaches
Evaluation of Settings and Whole Systems ApproachesEvaluation of Settings and Whole Systems Approaches
Evaluation of Settings and Whole Systems Approacheshealthycampuses
 
Policy Analysis Process by Willy Ruin
Policy Analysis Process by Willy RuinPolicy Analysis Process by Willy Ruin
Policy Analysis Process by Willy RuinWilfredo Ruin
 
Building Skills to Advocate for Change with Health Data
Building Skills to Advocate for Change with Health DataBuilding Skills to Advocate for Change with Health Data
Building Skills to Advocate for Change with Health DataMEASURE Evaluation
 
Applying impact evaluation tools for integrating agricultural sectors in Nati...
Applying impact evaluation tools for integrating agricultural sectors in Nati...Applying impact evaluation tools for integrating agricultural sectors in Nati...
Applying impact evaluation tools for integrating agricultural sectors in Nati...UNDP Climate
 
Good practice in evaluation research
Good practice in evaluation researchGood practice in evaluation research
Good practice in evaluation researchQSR International
 
A Quick Introduction To Pr Planning
A Quick Introduction To Pr PlanningA Quick Introduction To Pr Planning
A Quick Introduction To Pr Planningnturnbull
 
10policyanalysddddddddddis-211028063453.pdf
10policyanalysddddddddddis-211028063453.pdf10policyanalysddddddddddis-211028063453.pdf
10policyanalysddddddddddis-211028063453.pdfGaaaau2019
 
Developing Research Culture in Aid of Policy Formulation.pptx
Developing Research Culture in Aid of Policy Formulation.pptxDeveloping Research Culture in Aid of Policy Formulation.pptx
Developing Research Culture in Aid of Policy Formulation.pptxErwinPurcia2
 
A strategic approach to policy engagement for research organisations
A strategic approach to policy engagement for research organisationsA strategic approach to policy engagement for research organisations
A strategic approach to policy engagement for research organisationsJames Georgalakis
 
SWK311 Assessment 2 Final EssayWhat is t.docx
SWK311 Assessment 2 Final EssayWhat is t.docxSWK311 Assessment 2 Final EssayWhat is t.docx
SWK311 Assessment 2 Final EssayWhat is t.docxmabelf3
 
presenttion policy analysis
 presenttion policy analysis presenttion policy analysis
presenttion policy analysis12345AFSHAN
 
Understanding Public Relations Research
Understanding Public Relations ResearchUnderstanding Public Relations Research
Understanding Public Relations ResearchAlli Mowrey
 

Similar a Arizona advocacy (20)

Advocacy Workshop
Advocacy Workshop Advocacy Workshop
Advocacy Workshop
 
Public policy analysis
Public policy analysisPublic policy analysis
Public policy analysis
 
Effective Advocacy: Best Practices from Ilm Ideas on Slide Share
Effective Advocacy: Best Practices from Ilm Ideas on Slide ShareEffective Advocacy: Best Practices from Ilm Ideas on Slide Share
Effective Advocacy: Best Practices from Ilm Ideas on Slide Share
 
Shaila.advocacy
Shaila.advocacyShaila.advocacy
Shaila.advocacy
 
Power Of In Between M&E Session
Power Of In Between M&E SessionPower Of In Between M&E Session
Power Of In Between M&E Session
 
Evaluation of Settings and Whole Systems Approaches
Evaluation of Settings and Whole Systems ApproachesEvaluation of Settings and Whole Systems Approaches
Evaluation of Settings and Whole Systems Approaches
 
Policy Analysis Process by Willy Ruin
Policy Analysis Process by Willy RuinPolicy Analysis Process by Willy Ruin
Policy Analysis Process by Willy Ruin
 
Building Skills to Advocate for Change with Health Data
Building Skills to Advocate for Change with Health DataBuilding Skills to Advocate for Change with Health Data
Building Skills to Advocate for Change with Health Data
 
Applying impact evaluation tools for integrating agricultural sectors in Nati...
Applying impact evaluation tools for integrating agricultural sectors in Nati...Applying impact evaluation tools for integrating agricultural sectors in Nati...
Applying impact evaluation tools for integrating agricultural sectors in Nati...
 
Theory of Change
Theory of ChangeTheory of Change
Theory of Change
 
Good practice in evaluation research
Good practice in evaluation researchGood practice in evaluation research
Good practice in evaluation research
 
10 Steps To Advocacy Lissy De Santis
10 Steps To Advocacy   Lissy De Santis10 Steps To Advocacy   Lissy De Santis
10 Steps To Advocacy Lissy De Santis
 
A Quick Introduction To Pr Planning
A Quick Introduction To Pr PlanningA Quick Introduction To Pr Planning
A Quick Introduction To Pr Planning
 
policy analysis
policy analysispolicy analysis
policy analysis
 
10policyanalysddddddddddis-211028063453.pdf
10policyanalysddddddddddis-211028063453.pdf10policyanalysddddddddddis-211028063453.pdf
10policyanalysddddddddddis-211028063453.pdf
 
Developing Research Culture in Aid of Policy Formulation.pptx
Developing Research Culture in Aid of Policy Formulation.pptxDeveloping Research Culture in Aid of Policy Formulation.pptx
Developing Research Culture in Aid of Policy Formulation.pptx
 
A strategic approach to policy engagement for research organisations
A strategic approach to policy engagement for research organisationsA strategic approach to policy engagement for research organisations
A strategic approach to policy engagement for research organisations
 
SWK311 Assessment 2 Final EssayWhat is t.docx
SWK311 Assessment 2 Final EssayWhat is t.docxSWK311 Assessment 2 Final EssayWhat is t.docx
SWK311 Assessment 2 Final EssayWhat is t.docx
 
presenttion policy analysis
 presenttion policy analysis presenttion policy analysis
presenttion policy analysis
 
Understanding Public Relations Research
Understanding Public Relations ResearchUnderstanding Public Relations Research
Understanding Public Relations Research
 

Más de Cassandra O'Neill

Más de Cassandra O'Neill (8)

Az net presentation 5.2.12
Az net presentation 5.2.12Az net presentation 5.2.12
Az net presentation 5.2.12
 
Pp may 2
Pp may 2Pp may 2
Pp may 2
 
coach training march 21-2012[1]
coach training march 21-2012[1]coach training march 21-2012[1]
coach training march 21-2012[1]
 
Slhi june 23 08 imp part 1
Slhi june 23 08 imp part 1Slhi june 23 08 imp part 1
Slhi june 23 08 imp part 1
 
Slhi aug 27 08 imple part 2
Slhi aug 27 08 imple part 2Slhi aug 27 08 imple part 2
Slhi aug 27 08 imple part 2
 
Slhi june 23 08 imp part 1
Slhi june 23 08 imp part 1Slhi june 23 08 imp part 1
Slhi june 23 08 imp part 1
 
Arizona systems
Arizona systemsArizona systems
Arizona systems
 
Arizona sl
Arizona slArizona sl
Arizona sl
 

Último

Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...PsychoTech Services
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingTeacherCyreneCayanan
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3JemimahLaneBuaron
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphThiyagu K
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Celine George
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactPECB
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Krashi Coaching
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...fonyou31
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Disha Kariya
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104misteraugie
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpinRaunakKeshri1
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxVishalSingh1417
 

Último (20)

Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpin
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 

Arizona advocacy

  • 1. Evaluating Advocacy: Dilemmas, Tactics, and Methods Julia Coffman Center for Evaluation Innovation jcoffman@evaluationinnovation.org October 7, 2011
  • 2.
  • 3. How is evaluating advocacy different?
  • 4. Challenge: The policy environment is complex, and that makes attribution hard.
  • 5. Solution: If accountability is the purpose, demonstration of contribution is expected, not attribution. What is my unique contribution?
  • 6. Challenge: Advocacy strategies shift in response to the environment. Shifting Politics Shifting Economics New Partners
  • 7. Solution: Advocacy is a good opportunity to integrate or embed evaluation for learning (not just accountability). ADVOCACY EVALUATION
  • 8. Challenge: Timeframes can be unpredictable. 1 Year 1 Year 1 Year Advocacy Timeframe Goal Reporting Timeframe
  • 9. Solution: Assess progress, not just the end result. Goal …progress…
  • 10. What can we measure about influencing?
  • 11. Measure meaningful things. Don’t just count what is easy to quantify.
  • 12. Have realistic expectations. What are other influencers doing? Where is your issue in the policy process? What’s the political context? What’s the opposition doing? What are you doing and who are you targeting?
  • 13. Measure the changes made along the way, not just the end result. Policy Influence …progress… INTERIM OUTCOMES
  • 14. Interim outcomes are the changes you expect as you work toward your goal. Think about the changes you will see in your audiences.
  • 15. Use the framework to think about interim outcomes. ACTION HOW will they change as a result of your work? WILL OUTCOMES AWARENESS WHO will change as a result of your work? DECISION MAKERS INFLUENCERS PUBLIC AUDIENCES
  • 16. Where are your audiences? How far do you need to move them? ACTION Increase quality of child care WILL Child care providers INTERIM OUTCOMES AWARENESS Parents of young children DECISION MAKERS INFLUENCERS PUBLIC Legislators AUDIENCES
  • 17. Interim Outcomes Awareness Action Increased knowledge Increased collaboration among advocates Increased issue visibility or recognition Increased media coverage Activities and Outputs Policy Goals Will Reframing of the issue Changed attitudes or beliefs New and active advocates Increased salience New and active high-profile champions Increased personal or collective efficacy New donors Increased willingness to act Increased or diversified funding Increased capacity to act
  • 18. How can we measure it?
  • 19. Traditional Evaluation Methods Interviews Surveys Focus Groups Polling
  • 20. Non-Traditional Methods Charting and Mapping Survey and Interview Debriefing and Rating Media/Messaging Tracking System Mapping Intense Period Debriefs Research Panels Media Tracking Media Scorecards Network Mapping Crowdsourcing 360-Degree Critical Incident Debriefs Advocacy Capacity Assessment Snapshot Surveys Policy Maker Ratings ECCO Analysis Critical Incident Timelines Intercept Interviews Policy Tracking Champion Tracking Bellwether Methodology
  • 21.
  • 26. BusinessDeveloped by Harvard Family Research Project
  • 28. Bellwether Methodology Can preschool help address the achievement gap? How would you address the achievement gap?
  • 29. Bellwether Methodology What is the likelihood that California will increase preschool investments in the next 3 years?
  • 30. Policymaker Ratings Ratings are completed for a whole governing body or defined group of policymakers Developed by Harvard Family Research Project
  • 31. Policymaker Ratings Developed by Harvard Family Research Project
  • 32. Policymaker Ratings Del Norte * Hypothetical Data Siskiyou Modoc Trinity Shasta Lassen Humboldt Tehama Plumas Mendocino Butte Glenn Sierra = Increase in Support Nevada Yuba Colusa Placer Lake Sutter El Dorado Yolo Sonoma Napa Alpine Sacramento Amador Solano Calaveras San Marin Mono Costa Tuolumne Joaquin Contra San Francisco Alameda Stanislaus San Mariposa Mateo Santa Clara Merced Santa Madera Cruz Fresno Inyo San Benito Low Support Tulare Monterey Kings San Medium Support Luis Obispo Kern San Bernardino High Support Santa Barbara Ventura Los Angeles Orange Riverside Imperial San Diego Developed by Harvard Family Research Project
  • 33. Policymaker Ratings Developed by Harvard Family Research Project
  • 34.
  • 35. It’s okay to prioritize and focus on what is most important to assess.
  • 36.

Notas del editor

  1. With a real-time approach evaluators are embedded and emphasize a collaborative and participatory evaluation process. This approach is different from traditional evaluation in which the evaluator remains completely separate from the program or strategy. “Evaluators become part of a team whose members collaborate to conceptualize, design and test new approaches in a long-term, ongoing process of continuous improvement, adaptation, and intentional change. The evaluator’s primary function in the team is to elucidate team discussions with evaluative questions, data and logic, and to facilitate data-based assessments and decision-making in the unfolding and developmental processes of innovation.”  Patton, M. Q. (2006).Evaluation for the way we work. The Nonprofit Quarterly.
  2. The framework contains specific types of strategies and activities, organized according to where they fall on two strategic dimensions—the audience targeted (x-axis) and the outcomes desired (y-axis). Audiences are the groups that policy strategies target and attempt to influence or persuade. They represent the main actors in the policy process and include the public (or specific segments of it), policy influencers (e.g., media, community leaders, the business community, thought leaders, political advisors, etc.), and decision makers (e.g., elected officials, administrators, judges, etc.). These audiences are arrayed along a continuum according to their proximity to actual policy decisions; the farther out they are on the continuum, the closer they are to such decisions. Naturally, decision makers are the closest to such decisions, and therefore are on the continuum’s far end. Grantmaking may focus on just one audience or target more than one simultaneously. Outcomesare the results an advocacy or policy change effort aims for with an audience in order to progress toward a policy goal. The three points on this continuum differ in terms of how far an audience is expected to engage on a policy issue. The continuum starts with basic awareness or knowledge. Here the goal is to make the audience aware that a problem of potential policy solution exists. The next point is will. The goal here is to raise an audience’s willingness to take action on an issue. It goes beyond awareness and tries to convince the audience that the issue is important enough to warrant action, and that any actions taken will in fact make a difference. The third point is action. Here, policy efforts actually support or facilitate audience action on an issue. Again, grantmaking may pursue one outcome or more than one simultaneously. Foundations can use the framework to examine how to position their public policy strategies along these two dimensions. Rather than jumping straight to decisions about which activities to fund (e.g., public awareness campaigns, polling, etc.), the framework encourages foundations to think first about which audiences they need to engage and how hard they need to “push” those audiences toward action.HYPOTHETICAL: The shading in the figure at right illustrates how this might work. The hypothetical policy goal in this example calls for an action-oriented strategy focused primarily at the public or community level. The strategy supports activities that include organizing, coalition building, and mobilization activities to generate the action needed to move the policy issue forward.RISK: It’s also important to note that foundations perceive different parts of this framework as riskier than others.