Telecentre-Europe Summit 2012 - Parallel Session of Cristina Torrecillas: "Building evidence to measure the socio-economic impact of Telecentres on e-inclusion"

1. MIREIA
Measuring the impact of eInclusion
Building evidence to Intermediary actors
measure the socio- on Digital Literacy, Skills, and Inclusion
Goals
economic impact of
telecentres on Inclusion
Gianluca Misuraca, Senior Scientific Officer
Cristina Torrecillas, Scientific Officer
*http://www.casadellibro.com/libro-mireia-
la-estrella-un-libro-musical-para-mirar-tocar-
The views expressed by the authors are not necessarily those of the EC y-escuchar/9788434885240/864859
October 29, 2012 1

2. What do we need to
know?
(for Building evidence to measure the socio-economic impact of
telecentres on Inclusion)
Who the INTERMEDIARIES are:
 Locality Mapping: TYPOLOGY OF INTERMEDIARIES
 EU Mapping: Estimation of the size
How to measure their impact:
 The Impact Assessment Framework: TYPOLOGY OF
ACTIVITIES AND INDICATORS
 Pilot-Test of the Impact Assessment Framework

3. MIREIA’s Implementation
Plan
Task 1 – Literature Review
Experts and Stakeholders’ Consultations
Experts and Stakeholders’ Consultations
Task 2 – Locality Mapping
Task 3 – EU Mapping
Task 4 – Review of methods and indicators
Task 5 – Development of the Impact Assessment Framework
Task 6 – Pilot-Test of the Impact Assessment Framework
Way
forward
2012 2013

4. Locality Mapping
Preliminary Findings
Country Spain Latvia UK
(Mapping Type) El Raval, Barcelona Zemgale Sunderland
(Neighbourhood) (Regional) (City)
Total No. of 79 157 248
Orgs in location No sample – based on (NGOs and terminated projects Orgs in sample = 39
interviews and some site not included – revise)
visits Orgs in sample = 54
Type of Cybercafe = 30 Libraries = 68 City Council Facilities = 26
Organization Municipal Wifi = 20 School libraries = 25 Community Youth Centers = 43
School =7 Municipal Adult Ed. Cen = 3 Formal Educational Inst =93
Library = 6 Primary & Secondary = 53 Edu, Training and Employment =32
High School = 4 State Agency Social = 2 Black and Minority Ethnic Groups =8
Technical School = 4 State Agency Jobs = 2 Social Housing = 20
Telecentre = 3 Private Institutions = 4 Health and Social Care = 20
Civic Centre = 2 NGOs = X Business/Business Support = 13
University = 2
Categorization Based on structure and Based on role in communities Based on organizational and activities
of e-Inclusion activities 1. Public Internet access points 1. Education and Training providers
1. ICT core activity | Not 2. Training Centers 2. Neighbourhood based open access &
actors core activity 3. Social Advisers/Consultants ICT courses (community)
2. Inclusion core activity | 4. Raising awareness about 3. Neighbourhood based open access
Not core benefits of digital society, e- and ICT courses (council)
3. Not for profit | For Profit services, and e-Skills 4. Socially-targeted access
4. Public | Private 5. Business/Community and Voluntary
5. Networked | Not Support and Facilitation
networked

5. Locality Mapping
Preliminary Findings
Spain, El Raval, Barcelona
Context Multi-ethnic neighbourhood with migrants of low-income and a mix
Organizational Type NA
(from survey)
Landscape of eInclusion
• Cybercafes more prominent actor coherent with composition of Rabal
actors
(high migrant population)
(from survey + desk
• Followed by Municipal WiFi hot spots that are not "formally" recognized
research)
as actors
• Libraries are gaining significance in the area and many include in plans
eInclusion goals
• Interestingly, there are fewer telecenters compared with cybercafés and
libraries.
Main Target groups • Telecenters in area are opened for all citizens but seniors prevail
(from survey) • Libraries open to all groups but ID card required for Internet access
(undocum migrants can't enjoy most of the services)
• Cybercafes overwhelmingly serve migrant population and seldom tourists
Outcomes Identified NA Yet

6. Locality Mapping
Preliminary Findings
Latvia, Zemgale
Context Rural/Ag area with high level unemployment and economic migration of youth
Organizational Type Municipal/State = 66%
(from survey) NGO Sector = 21%
Private Orgs = 11%
Ad Hoc Projects = 3%
Landscape of eInclusion • Libraries the largest actor and play the role of telecenters. All offer a list of
actors common digital inclusion services.
(from survey + desk • Municipal LLL Centers although small in number they provide a wider range
research) of eSkills training and also ICT support for other orgs
• NGOs in Zemgale region usually operate w/small budgets and no paid staff –
mostly run by volunteers (dif. from national NGOs)
Main Target groups • Young adults and children are the two top priority groups for eInclusion actors
(from survey) in area. Coherent since libraries defined these two groups as primary audience
• Unemployed and job seekers considered top priority for 37% of organizations
• People w/physical disabilities target audience for relatively small % of orgs
(21%)
• Women not considered a disadvantaged group in Latvia
Outcomes Identified • Almost 80% provide free access to computers and Internet
• 63% provide basic training. Few orgs provide training for beginners or for
professionals
• Orgs serve as social community centres. 71% consultations on private and
government e-services
• Important advocacy role raising awareness about benefits of digital society

7. Locality Mapping
Preliminary Findings
UK, Sunderland
Post-industrial city with high level of unemployment specially among
Context young adults. One of highest levels of NEETs in the country
Organizational Type Municipal/State = 15%
(from survey) NGO Sector = 64%
Private Orgs = 15%
MISSING 6%
Landscape of eInclusion • Vast majority of actors based in the formal educational sector [interesting
actors in a city with one of the highest level of NEETs]
(from survey + desk • Followed in presence by community-based orgs
research)
Main Target groups • Orgs identified as third sector serve needs of broader community.
(from survey) • Some, however, target needs of specific groups (BME 3 orgs, Youth 12
orgs, and Disability 4 orgs)
Outcomes Identified • Educational and Employment related services most commonly cited as
outcomes
• Public and more equal access to ICT opportunities.
• Disability support orgs primarily create employment and job searching
outcomes
• Youth Centres identified a wider variety of outcomes – access to
employment, communication, recreation

8. Typology of Intermediaries
based on Organizational
type
Aggregated Disaggregated Category
Category
National, Regional, and State Agencies [Social, Employment, Health]
Municipal/City Government [Adult Education Centers, Electonic Village Halls,
Training Rooms, etc.]
Public Libraries
Government
Government-run Telecenters
Formal Educational Institutions [Primary, Secondary, High School, technical
school, University]
Other [Ad hoc projects –Terminated projects – ....]
NGO-run Telecenters
Neighbourhood Community Centers/Associations
Voluntary Support Organizations
Third Sector Youth Centers
Migrant and Minority Support Organizations [Refugee & Asylum seekers, BME
Support orgs]
Other
Private Sector Cybercafes
Private Training Organizations [Support Government programs, NGOs, etc]
Formal Educational Institutions [Primary, Secondary, High School, technical
school, University]
Other [Private nursing homes, privately-run social housing, etc.]

9. Outlining the MIREIA eI2-IAF

10. Employability relevant outcomes
and (specific) impact
dimensions
 Direct and indirect effects of eI2 activities (employability relevant):
 Skilling: improvement of ICT skills and capabilities
 leading to better opportunities to look for and apply for jobs
 Empowerment: enhancement of confidence and motivation for learning
 leading to an increased perception of the possibility to improve
(individual/group) social and economic conditions (social capital formation);
 Networking capacities: strengthening network ties and outreach potential
(social capital bonding and bridging)
 leading to increase of the opportunities for socio-economic integration;
 Job-placement: facilitate the possibility for accessing information on labour
market and entrepreneurial opportunities
 leading to increasing opportunities for participating actively to the (local)
economic development and contributing to socio-economic inclusion

11. eI2 typologies of activities
Outcome dimension Typology of activities
category (employability
relevant)
Skilling Basic Digital literacy training courses and ICT use ('medium-related' skills including operational and formal Internet skills such as
(reference to EC Digital Competence Framework under development): Information management (search/analysys/storage)
Advanced ICT skills development (both 'medium-related' and 'content-related' skills including information and strategic Internet skills)
(reference to EC Digital Competence Framework under development): Creation of content and knowledge (Content creation, integration
and re-elaboration of previous knowledge and content; Knowledge creation and creative expression)
Empowerment Engagement in Lifelong Learning and Learning through ICT (e.g. eLearning / informal ICT learning support) and other learning /
empowering activities
Increasing awareness and management of legal and ethical aspects and privacy and security (reference to EC Digital Competence
Framework under development): (e.g. legal constraints, respect of self and others; personal data protection and privacy; security and safety
measures; Digital Identity management)
eAccessibility measures
Networking Measures providing ICT access (e.g. Public Internet Access Points, Telecentres, ICT access in libraries, etc.)
Training and use of ICT for communication, collaboration and participation (reference to EC Digital Competence Framework under
development): e.g. Digital communication; sharing of content, knowledge and resources, online participation and digital collaboration
ICT networking and support to increase outreach capabilities (including self-employment /entrepreneurship)
eIntermediation - ICT supported measures to access welfare entitlement, health and independent living and other public services
Job placement Specific/purposeful ICT-enabled skills building for employability
Specific/purposeful ICT supported job-seeking and matching measures
ICT supported community building (including assistance to SMMEs)

12. Possible output /
direct outcome indicators
Outcome dimension Possible Output indicators Possible Direct Outcome indicators
(employability relevant)
Skilling # of participants in basic training courses % graduates progressing on advanced courses
# of participants in advanced training courses % of participants trained / potential target
% participants who completed the courses % of users achieving evidence of skills progression
# of users or beneficiaries of ICT support activities % of users/beneficiaries who became regular ICT users
Empowerment # of users or beneficiaries of ICT support activities % of users achieving an increase in their confidence of use of ICT
# of users or beneficiaries of eLearning or informal ICT % of users progressing to take up advanced ICT courses
support activities % of users progressing to take up advanced other training courses
# of users or beneficiaries of specific measures related to ICT % of users achieving evidence of empowerment progression (self-confidence,
legal/ethics and privacy/security aspects ICT capabilities, etc.)
# of users or beneficiaries of eAccessibility measures
Networking # of regular users of ICT networking facilities % of users progressing to regular ICT users / % increase in Internet usage in
Average length of use of facilities per user the area
% coverage of deprived communities # of services (e.g. online eligibility checks, forms or information) delivered
# of beneficiaries of ICT networking support activities (per to beneficiaries
target group) % of reached beneficiaries achieving evidence of improvement in their
% of beneficiaries of ICT networking support activities / situation (e.g. obtained an entitlement or successful transaction on any other
potential target (per target group) public service)
# of beneficiaries counseled and mediated % of users achieving evidence of ICT networking capabilities progression
# of beneficiaries assisted on self-employment / % of beneficiaries successful counseled and mediated
entrepreneurship activities % of beneficiaries successfully assisted on self-employment/entrepreneurship
activities
Job placement % of beneficiaries / local unemployment rate % of beneficiaries successful counseled and mediated
# of beneficiaries counseled and mediated on job-search % of successful 'job-matching' activities / total of activities
activities % of users that have been 'placed' on the job market
# of beneficiaries referred to non-employment activities (e.g. % of beneficiaries that have actually found a job (ICT-related or not-ICT
further training) related)
# of job-suppliers served (or # of job-offers made available) % of SMMEs achieving evidence of improvement
# of SMMEs assisted % increase in local economic development
% SMMEs assisted / potential target
# of new SMMEs created / established on the local area of
reference

13. Group discussion
Building evidence to measure the socio-economic impact of
Telecentres on eInclusion
Objectives and expected outcome
 Discussing and revising the typology of eInclusion Intermediaries
 Discussing and revising the main components of the proposed eI2-IAF:
typology of activities, outputs, expected outcomes and impacts
 Defining SMART (Specific, Measurable, Attainable, Relevant and
Timebound) indicators and data collection methods that are appropriate
and feasible

14. Group discussion
Questions
Topic 1. Typology of interventions/activities and related expected outcomes / impacts
1.1. Do you modify the aggregated typology provided?
1.2. Do you modify the disaggregated typology provided?
1.3. Do you add the any other category to the typology provided?
Topic 2. Typology of interventions/activities and related expected outcomes / impacts
2.1. Do you add/modify the list of activities provided?
2.2. What are the most relevant types of outcomes?
2.3. What are the most relevant types of impacts?
Topic 3. Indicators and measurement tools
3.1. Are the indicators provided suitable to measure the outputs and outcomes?
3.2. Would you add/modify the list of indicators provided?
3.3. What appropriate means can be used to collect data according to the indicators?

15. For further information about MIREIA:
http://is.jrc.ec.europa.eu/pages/EAP/MIREIA.html
gianluca.misuraca@ec.europa.eu
cristina.torrecillas@ec.europa.eu