1. Network Strategy – Working Group C
Performance measurement:
“Measuring network impact and
effectiveness”

2. Working Group C – Team members
China Mde Gu
Rick Zou
Yimei McCabe
CEO, Youth Business China
Project Director, Youth Business
China
India Lakshmi Venkatesan CEO, BYST
South Africa Mzwabantu Ntlangeni Director International Relations &
Partnerships, National Youth
Development Agency
Sri Lanka Harin Malwatte Youth Business Sri Lanka

3. Our project hypothesis
• Being able to demonstrate the global impact of the network is
one of the key mechanisms for adding network value to individual
YBPs
• Historically, the quality of the data collected at network level has
not been sufficient for two reasons:
1. Low visibility for YBPs that the data was used in a way that added
value to them – providing data to YBI not a priority
2. The process for collecting and aggregating the data was not
adequate
We decided to focus on how we measure network
impact & effectiveness

4. Requirements for effective global data capture
Do we have a consistent
understanding of what a
YBP does and therefore
of the impact we are
trying to measure?
Do we have consistent
and appropriate
definitions and metrics
for impact and
effectiveness?
Do we have a process in
each YBP that can
reliably collect, analyse
and report the data?
1 2 3
• Our global data set must cover the impact of our programmes and also
our effectiveness
• What is measured must be common, core and consistent
• Our project will use our Working Group as a sample test the following:

5. KPI Definition Process for collection Freq Usage Installation
status*
Youth
businesses
supported
Number of
qualifying business
started or
supported in
period
• Standard format data request
sent to regions week after
quarter end
• Regions complete and return
within 5 working data
• Data compiled by Ops Director
in Excel spreadsheet of
historical data
Quarterly • Data used to report to
Board (every 6 months)
• Data submitted to YBI Ops
team quarterly
2
Jobs
created
Number of people
directly employed
by YBP-supported
businesses
• Questionnaire sent to all clients
on our database asking them
about their business
• Responses compiled by Ops
director
Annually • Input to annual review
and annual report
• Data also used in
marketing materials
3
Etc...
Data evaluation template
We will capture the following data for each key KPIs we track today
focussing on what we measure, how we collect the data and how we use
the information
* see below

6. 6
Installation status score
Score Criteria
0 Not measured/tracked
1 Gathered if requested
2 Regularly gathered and recorded
3
Routinely gathered with clear process, responsibilities, format and
analysis
4
Routinely gathered and used as standard input into programme
management process
As well as identifying what KPIs are measured, we will also assess the
robustness of the process that collects the data using the scoring system
below:

7. 7
Project implementation
Agree project
objective and
approach
Conduct
individual
assessments
& compare
findings
Design common KPI
framework & pilot
implementation
process
Conduct pilot
implementations
• Do we track the same KPIs?
• Do we track the right KPIs?
• Are the processes we use to
generate our data robust?
• What do we need to have in place
to efficiently produce reliable
data?
• What KPI’s best allow us
to demonstrate network
impact?
• How are they defined?
• How are they measured?
• How can data be
gathered?
• How do we support pilot
implementation?
• Implement in pilot YBPS with
focus on:
― Data accuracy
― Implementing for
sustainability
― Fit with/development of
OMS
• capture and feedback
learnings
*London School of Economics
Working
Group
Working Group
YBI /LSE*
Working Group
YBI

8. Learnings from this project (so far)
• Our team has struggled to create momentum in
this project for lots of good reasons
• But we will always be able to find “good reasons”
for not being able to work on this sort of project
• We need to change the current paradigm if we are
to create more value for ourselves