Se ha denunciado esta presentación.
Utilizamos tu perfil de LinkedIn y tus datos de actividad para personalizar los anuncios y mostrarte publicidad más relevante. Puedes cambiar tus preferencias de publicidad en cualquier momento.
<ul><li>Monitoring and evaluation of research communications- what’s it all about? </li></ul><ul><li>Anna Downie, Informat...
Objectives for the session <ul><li>To think about the purpose of evaluating communication strategies </li></ul><ul><li>To ...
 
Why evaluate your communication strategy?
What is “monitoring”?  <ul><li>… routine, ongoing, collection of information on a program’s outputs, outcomes and indicato...
What is “evaluation”? <ul><li>… the systematic acquisition and assessment of information to provide useful feedback about ...
Learning & Reporting (Info to users/events/audiences) Clarifying Intent (Both interventions & outcomes) M&E Planning (Choo...
Boundary partners those individuals, groups, and organisations with whom the program:  <ul><li>interacts directly to effec...
Outcome mapping: Nested spheres Adapted from: Steff Deprez VVOB-CEGO, Nov 2006 sphere of  ‘control’ sphere of influence sp...
Outcomes and indicators <ul><li>Who has seen the wind? </li></ul><ul><li>Neither I nor you. </li></ul><ul><li>But when the...
<ul><li>A graduated set of statements describing a progression of changed  behaviours  in the boundary partner </li></ul><...
Progress markers Ladder of change Expanding influence, helping others, sharing expertise Actively engaged, learning, commi...
Some indicators (suggested by Hilary) <ul><li>References to work of partners in policy and finance statements </li></ul><u...
Charting choices for M&E Uses Adjust Strategy  Improve Implementation Report Performance Risk Management  Build Capacity L...
… <ul><li>facilitate mid-course corrections and improvements </li></ul><ul><li>articulate the complexity of change </li></...
Who, what, when and how of evaluation <ul><li>What data will you need to collect? </li></ul><ul><li>Who will collect it? <...
Finally <ul><li>Expecting the unexpected </li></ul><ul><li>Think about baselines </li></ul><ul><li>Don’t just seek the pos...
For more information on  Outcome Mapping : www.outcomemapping.ca   www.idrc.ca/evaluation For more information on the  Mos...
Próxima SlideShare
Cargando en…5
×

Monitoring and evaluation of research communications- what’s it all about?

2.564 visualizaciones

Publicado el

Presentation given by Anna Downie at a research communications capacity building workshop held at IDS April 2008.

Publicado en: Empresariales, Tecnología
  • Sé el primero en comentar

  • Sé el primero en recomendar esto

Monitoring and evaluation of research communications- what’s it all about?

  1. 1. <ul><li>Monitoring and evaluation of research communications- what’s it all about? </li></ul><ul><li>Anna Downie, Information Department, IDS </li></ul>
  2. 2. Objectives for the session <ul><li>To think about the purpose of evaluating communication strategies </li></ul><ul><li>To develop some measurable indicators </li></ul><ul><li>To identify data collection methods and monitoring processes </li></ul>
  3. 4. Why evaluate your communication strategy?
  4. 5. What is “monitoring”? <ul><li>… routine, ongoing, collection of information on a program’s outputs, outcomes and indicators to measure, improve and report on the performance. </li></ul>
  5. 6. What is “evaluation”? <ul><li>… the systematic acquisition and assessment of information to provide useful feedback about a program, policy, technology or activity. </li></ul>
  6. 7. Learning & Reporting (Info to users/events/audiences) Clarifying Intent (Both interventions & outcomes) M&E Planning (Choosing what to track) M&E Implementation (Data collection & interpretation) Useful M&E needs…
  7. 8. Boundary partners those individuals, groups, and organisations with whom the program: <ul><li>interacts directly to effect change </li></ul><ul><li>anticipates opportunities for influence </li></ul><ul><li>engages in mutual learning </li></ul>
  8. 9. Outcome mapping: Nested spheres Adapted from: Steff Deprez VVOB-CEGO, Nov 2006 sphere of ‘control’ sphere of influence sphere of interest Research project Partners Beneficiaries
  9. 10. Outcomes and indicators <ul><li>Who has seen the wind? </li></ul><ul><li>Neither I nor you. </li></ul><ul><li>But when the leaves hang trembling, </li></ul><ul><li>The wind is passing through. </li></ul><ul><li>Who has seen the wind? </li></ul><ul><li>Neither you nor I. </li></ul><ul><li>But when the trees bow down their heads, </li></ul><ul><li>The wind is passing by. </li></ul><ul><li>By Christina Rossetti (1830-1894) </li></ul>
  10. 11. <ul><li>A graduated set of statements describing a progression of changed behaviours in the boundary partner </li></ul><ul><li>Describe changes in actions, activities and relationships leading to the ideal outcome </li></ul><ul><li>Articulate the complexity of the change process </li></ul>Progress markers
  11. 12. Progress markers Ladder of change Expanding influence, helping others, sharing expertise Actively engaged, learning, commitment Early encouraging response to program, initial engagement Love to see Like to see Expect to see
  12. 13. Some indicators (suggested by Hilary) <ul><li>References to work of partners in policy and finance statements </li></ul><ul><li>Statements and position papers </li></ul><ul><li>Commitments in national plans and finance strategies </li></ul><ul><li>Changes in position or attitudes </li></ul><ul><li>Resources commitments of finance or health ministers </li></ul><ul><li>Expenditure on contraception </li></ul><ul><li>Changes in SRH spending </li></ul><ul><li>Changes in services delivery </li></ul>
  13. 14. Charting choices for M&E Uses Adjust Strategy Improve Implementation Report Performance Risk Management Build Capacity Lobbying Events Annual Team meeting Annual Report Quarterly Report to Donor 3 year Programme Review Project Review Management Users Program Staff Board Donor Project Partner Programme Management Info Strategies implemented Morbidity & mortality Partner actions in community Community responses to project Partner collaboration with ministry Community participation Funding flows
  14. 15. … <ul><li>facilitate mid-course corrections and improvements </li></ul><ul><li>articulate the complexity of change </li></ul><ul><li>stimulate the program to consider how it can contribute to the most profound transformation possible </li></ul><ul><li>suggest the logic model of change </li></ul><ul><li>are NOT a checklist of accomplishments! </li></ul>Taken together, progress markers
  15. 16. Who, what, when and how of evaluation <ul><li>What data will you need to collect? </li></ul><ul><li>Who will collect it? </li></ul><ul><li>When will you collect it? </li></ul><ul><li>How often will you collect it? </li></ul>
  16. 17. Finally <ul><li>Expecting the unexpected </li></ul><ul><li>Think about baselines </li></ul><ul><li>Don’t just seek the positive </li></ul><ul><ul><li>Most significant change </li></ul></ul><ul><li>Learn from your learning </li></ul><ul><li>Share your learning </li></ul><ul><ul><li>Peer review </li></ul></ul>
  17. 18. For more information on Outcome Mapping : www.outcomemapping.ca www.idrc.ca/evaluation For more information on the Most Significant Change : www.mande.co.uk/MSC Further reading

×