SlideShare una empresa de Scribd logo
1 de 24
Assessing the socio-economic impact of Telecentres



Gianluca Misuraca, Senior Scientific Officer

The views expressed by the authors are not necessarily those of the EC


October 29, 2012                                                         1
Institute for Prospective Technological Studies

                                 IPTS: one of the seven
                                 institutes of the EC JRC

                                 IPTS Mission:
                                 to provide support to EU
                                 policy-making      process
                                 by developing science-
                                 based      responses     to
                                 policy challenges that
                                 have both a socio-
                                 economic as well as a
                                 scientific/technological
                                 dimension
Information Society Unit of JRC-IPTS




October 29, 2012                                 4
Outline

1. The evolving eInclusion policy landscape

2. The role of eInclusion Intermediaries in the Information
   Society

3. MIREIA - Measuring        the   Impact     of   eInclusion
   Intermediaries

4. The Way Forward and what´s in for you
Setting the stage:
the EU eInclusion policy

     ICT play an essential role in supporting daily life in today's digital society
      e-Inclusion means both inclusive ICT and the use of ICT to achieve wider inclusion
       objectives
      e-Inclusion policy aims at reducing gaps in ICT usage and promoting the use of ICT to
       overcome exclusion, and improve economic performance, employment opportunities,
       quality of life, social participation and cohesion

     Launched under the i2010 Agenda for realising the inclusive pillar of the
      Lisbon Strategy
      Riga Ministerial Declaration in 2006
      Vienna Ministerial Conference in 2008

     It now features as an important element in the Digital Agenda for Europe, a
      flagship of the current Europe 2020 strategy
      Under Pillar 6 - Enhancing digital literacy, skills and inclusion, the Commission
       proposes a series of measures to promote take-up of ICT by potentially disadvantaged
       groups, such as elderly, less-literate, low-income persons, etc.
A changing Policy landscape for eInclusion
    Renewed focus on Growth and Jobs in the current socio-economic context
     (e.g. New Employment Package adopted on 18/4/2012)
     it becomes crucial to assess the impact of eInclusion initiatives so to convince “ICT
      outsiders” and to support mainstream of ICT use in non-ICT policies


    eInclusion is closely related to EU policies on social inclusion, education and
     culture, regional development, innovation, industry and internal market
     An agenda for new skills and new jobs
     Youth on the move
     European platform against poverty and social exclusion
     Regional cohesion
      • especially in light of the current debate on the reform of the EU policy and
        instruments for social and economic cohesion
Unleashing the power of the ´I2 paradigm´
•   eInclusion is about both inclusive technological innovation and
    innovative ways to deliver inclusive policies by using ICTs


•   ’There are probably few fields where Inclusion and Innovation are so entwined
    and can in principle virtuously feed each other as that of inclusive services
    supported by ICTs

•   Technology driven innovation in service provision has an impact on economy
    and society and finds market sustainability only inasmuch as the adoption and
    appropriation of such services in everyday life activities are wide and
    expanding among citizens and across all value chains.

•   Yet this potential will not be unlocked until innovative policies and regulatory
    solutions, as well as investments by industry, expand their adoption.


                                                 Source, EC Vienna Study (2009).
The role of the eInclusion intermediaries (eI2) in
    the Information Society

    eI2 play a crucial role especially due to their potential multiplier effects in
     promoting   socio-economic   inclusion   at   various   levels   (regional,   local,
     community, thematic, etc.) and thus contribute exploiting the I2 paradigm


    In spite of their crucial role, eI2 have received limited policy attention and
     there are important ‘knowledge gaps’


    The variety of eInclusion intermediary actors in Europe is high
     ‘Telecentres’ are assumed to be representative of the types of organisations
      and network organisations populating the vast field of eInclusion intermediary
      actors
MIREIA
      Measuring the impact of eInclusion Intermediary actors
            on Digital Literacy, Skills, and Inclusion Goals


   Characterising the role of eI2 actors involved in
    implementing     eInclusion   policies   and   better
    understand their policy potential


   Developing   a   conceptual     and   methodological
    framework    to assess   impacts      of ICT-enabled         MIREIA la estrella
    services (eI2-mediated) in support of groups at             (MIREIA the star)*
                                                            *http://www.casadellibro.com/libro-mireia-
    risk of exclusion and to promote social inclusion,      la-estrella-un-libro-musical-para-mirar-tocar-
                                                            y-escuchar/9788434885240/864859

    integration and employability
MIREIA’s Rationale

   The rationale of the research relies on the need to develop a shared
    methodological framework to measure the impact of eI2 actors on the
    socio-economic conditions of the target users they address

   This project, done in close cooperation with key stakeholders, is
    expected to involve practitioner and design jointly a methodological
    framework to further enhance capacity, mobilise stakeholders and
    engage them to collect data so as to measure their impact

   An indirect objective of the project is also to further link its results with
    EC supporting funding schemes (e.g. ICT-PSP-CIP, European Social
    Fund – ESF, and others)
Research design: MIREIA’s Building Blocks
                                               Explanation and theories
                  Task 1 – Literature Review
                  Task 1 – Literature Review
                                                 LR on Employability
   WP1 – eI2A
   WP1 – eI2A
  Characterisat
  Characterisat          Task 2 – Locality
                                                  Locality Mapping
     ion &
      ion &          mapping in 3 selected
    Mapping
    Mapping                  areas
                    Task 3 – EU Mapping              EU Mapping


                        Task 4 – Review of
                                                       Methods
                      indicators & methods
   WP2 – eI2
    Impact        Task 5 – IAF Development           Design of IAF
  Assessment
  Framework          Task 6 – Test of IAF         ‘Piloting & Testing’
Key activities
                            Explanations and                 2 Expert
                                theories                   Workshops
                                              June 2012
                                              June 2012
                  Task 1
                  Task 1
      WP1 –
       WP1 –                                                1- MIREIA
                           LR on Employability
    Characteris
    Characteris                               June 2012
                                              June 2012   2- Employability
      ation &
      ation &     Task 2    Locality Mapping                        May 2012
                                                                    May 2012
    Mapping of
    Mapping of                                Oct 2012
                                              Oct 2012
        eIA
        eIA
                  Task 3       EU Mapping
                                              Jan 2013
                                              Jan 2013


                  Task 4        Methods                   Stakeholders
                                             June 2012
                                             June 2012
       WP2 –                                               Consultation
      Impact      Task 5      Design of IAF                 Workshop
    Assessmen                                Sept 2012
                                             Sept 2012
                                                             Draft IAF
        t         Task 6        Pilot&Test
                                               2013
                                               2013                 Sept 2012
                                                                    Sept 2012
    Framework
MIREIA eI2-IAF

   Objective:
        To build and test an IAF to systematically collect end-users micro-data through
         grassroots organisations and aggregate it at various levels, in order to facilitate the
         measurement of outcomes and the estimation of the impact of those actors on
         employment, education and social inclusion


Focus on the role of ICT for employability
   'the combination of factors and processes that enable people to progress toward
    or find employment, to remain employed, and/or to advance in the workplace'
    (Brown, Hesketh, Williams, 2003; Fugate, Kinicki, Ashforth, 2004; Houston, 2005)

   Evidence from literature shows that
     •   the adoption of ICT increases the demand for skilled workers and reduces that for
         unskilled workers
     •   Employment, wage trajectories and labour supply decisions along the life-cycle tend to
         be affected by the level of digital skills possessed by individuals
     •   Access and ability to use ICT affects employability, by shaping the decision to enter
         the labour market and of investing in training, and the likelihood of
         obtaining/maintaining a job
Unfolding ‘Impact Assessment’ in MIREIA
    'a process aimed at structuring and supporting the development of policies’
     identifies and assesses the problem at stake and the objectives pursued
     identifies the main options for achieving the objective and analyses their likely impacts in
      the economic, environmental and social fields
     outlines advantages and disadvantages of each option and examines possible synergies
      and trade-offs [European Commission, http://ec.europa.eu/governance/impact/index_en.htm]


    The MIREIA eI2-IAF is to be considered as an hybrid mix of methodological
     approaches and practical methods being, at the same time:
     a methodological framework to measure the impacts of eInclusion interventions
      implemented by eInclusion Intermediary actors
     a practical tool-kit to provide guidelines and recommendations for the design and
      operationalization of monitoring and evaluation systems to be implemented by eInclusion
      Intermediary actors
National
Key elements for designing the MIREIA eI2 IAF
                              Politics and
                               policies
                     IC
         Target Groups/
          Beneficiaries T                                    Socio-economic
         PEOPLE AT RISK                                         Impacts
     Socio-                Transactional environment         EU policies
  demographic
   NEEDS
                                                Third sectorSpecific
  developmentseInclusion
                                                            Impacts
                                               organisations
                      CBOs
            Intermediaries                                        Contextual
                                    Socio-economic
                                       Inclusion                Private
                                                           Disruptives
                   School/training                       Variables / ICTs    environment
                                                                 Sector
                      centresSpecific
         MISSION                                          Research
          GOALS             Objectives          Outputs           Outomes
                             Government                  Community
                                          Technology              Administrative
                                           suppliers               culture and
              Economics                                             attitudes
                                           ...........
                           ASSUMPTIONS / RISKS / LIMITATIONS
Principles underpinning the MIREIA eI2-IAF
       Under certain conditions, ICT-mediated interventions of eI2 can have a
        potential ‘amplifying’ effect capable of contributing to:

           enabling empowerment mechanisms
        •    (e.g. in terms of improving ICT skills and acquiring other skills than ICT, such as social skills,
             communication skills or labour market skills through ICT, as well as self-confidence, etc. which
             in turn can increase social capital formation)

           enhancing outreach capabilities of individuals and groups either as part of the local
            community they belong too, but virtually at a global scale
        •    (e.g. through networking and participating in dedicated 'spaces' for socializing and community-
             building, thus in turn improving social capital bonding and bridging, as individuals of various
             backgrounds are brought together beyond one's immediate social network)

           offering new and innovative ways for economic participation in society
        •    (e.g. increasing the opportunities for job-related search, training and self-employment or
             online activities allowing to engage in social and economic interactions)
Methodological approach: A multi-level analysis

  Perspective/Target           Type of Indicators            Level of analysis



 Costs and benefits from       Contribution of eI2
  a policy and broader         activities to ‘global
                                                                Policy/Macro
     socio-economic          Impacts’ on society and
       perspective             economy at large



   Role of eI2 from an       ‘Mediated effects in terms
      organizational/          of indirect outcomes             Strategic/Meso
 institutional perspective       /specific impacts


        eInclusion           Direct benefits in terms of
                                                           Operational/Micro and Exo
  Intermediary/services       outputs/direct outcomes
Outlining the MIREIA eI2-IAF
Employability relevant outcomes and (specific) impact dimensions

       Direct and indirect effects of eI2 identified to be employability relevant:

        Skilling: improvement of ICT skills and capabilities, thus leading to better
         opportunities to look for and apply for jobs

        Empowerment: enhancement of confidence and motivation for learning,
         leading to an increased perception of the possibility to improve
         (individual/group) social and economic conditions (social capital formation);

        Networking capacities: strengthening network ties and outreach potential
         (social capital bonding and bridging), leading to increase of the opportunities
         for socio-economic integration;

        Job-placement: facilitate the possibility for accessing information on labour
         market and entrepreneurial opportunities, thus participating actively to the
         (local) economic development and contributing to socio-economic inclusion
Where are we now?

MIREIA’s Overview of activities

  Task 1 – Literature Review




                                                                                  Experts and Stakeholders’ Consultations
                                                                                  Experts and Stakeholders’ Consultations
         Task 2 – Locality Mapping


                           Task 3 – EU Mapping



   Task 4 – Review of methods and indicators


                        Task 5 – Development of the Impact Assessment Framework




                    Task 6 – Test of the Impact Assessment Framework

                                                                         Way
                                                                       forward
                 2012                                  2013
The way forward


    Continue building the MIREIA Community of practice
     Experts and stakeholders workshops and Online consultation
     Linking to Telecentre Europe and other key stakeholders

    Finalise the three ‘Exhaustive Locality mapping´ analysis
     1. El Raval, Barcelona, Spain - Neighboroud
     2. Sunderland, UK – Urban Area
     3. Zemgale, Latvia – Rural Area

    Start-up the ´Mapping of Telecentres´ at EU27 level
     Executed by Telecentre-Europe (October 2012 – March 2013)

    Characterisation of eI2 in Europe
     to support to gain visibility and policy attention with regard to their
      contribution to policy goals
The way forward

       Develop the eI2 – IAF and ´test´ its validity in real life settings
        through ´applying´ its principles to 5 case study interventions
        1.   Community Hubs, UK Online Centres, UK
        2.   eSkills and your future profession, LDP/FRSI, Poland
        3.   Fast Track to IT, FIT, Ireland
        4.   Pane & Internet, Emilia Romagna Region, Italy
        5.   Social Innovation & Employability, Guadalinfo, Andalusia, Spain

       Develop a 'full-fledged' operational framework including
     a complete set of monitoring and evaluation indicators
     guidelines, practical tools and instruments for monitoring and evaluation

       Refine and validate the eI2 IAF through discussion with experts and
        stakeholders
     develop recommendations for possibly generalising the MIREIA eI2-IAF at
      European level, through, for example, a 'large-scale' pilot and/or other policy
      and research actions.
For further information about MIREIA:
http://is.jrc.ec.europa.eu/pages/EAP/MIREIA.html



        gianluca.misuraca@ec.europa.eu
        cristina.torrecillas@ec.europa.eu

Más contenido relacionado

Destacado

Destacado (6)

Vocabulari complet
Vocabulari completVocabulari complet
Vocabulari complet
 
Roma
RomaRoma
Roma
 
Aparell Locomotor[3]. Exercicis
Aparell Locomotor[3]. ExercicisAparell Locomotor[3]. Exercicis
Aparell Locomotor[3]. Exercicis
 
Meteorológia 2
Meteorológia 2Meteorológia 2
Meteorológia 2
 
Meteorológia 1
Meteorológia 1Meteorológia 1
Meteorológia 1
 
презентация2
презентация2презентация2
презентация2
 

Similar a Gianluca Misuraca: "Assessing the socio-economic impact of Telecentres"

Gurgaon Renewal Mission Status Report
Gurgaon Renewal Mission Status ReportGurgaon Renewal Mission Status Report
Gurgaon Renewal Mission Status ReportDLF Foundation
 
Data4Impact Expert Workshop Report
Data4Impact Expert Workshop ReportData4Impact Expert Workshop Report
Data4Impact Expert Workshop ReportData4Impact
 
A guide to ICT-related activities in WP2016-17
A guide to ICT-related activities in WP2016-17A guide to ICT-related activities in WP2016-17
A guide to ICT-related activities in WP2016-17Open Concept
 
Final report 2007 to 2012
Final report 2007 to 2012Final report 2007 to 2012
Final report 2007 to 2012linioti
 
IRJET - Dnyanada-Back to Learn: A Survey
IRJET - Dnyanada-Back to Learn: A SurveyIRJET - Dnyanada-Back to Learn: A Survey
IRJET - Dnyanada-Back to Learn: A SurveyIRJET Journal
 
September 2010
September 2010September 2010
September 2010linioti
 
October 2011
October 2011October 2011
October 2011linioti
 
Smespire at "Powered by INSPIRE" March 2013
Smespire at "Powered by INSPIRE" March 2013Smespire at "Powered by INSPIRE" March 2013
Smespire at "Powered by INSPIRE" March 2013smespire
 
Developing Regional Innovation Ecosystems through RIS3, Horizon 2020 and Euro...
Developing Regional Innovation Ecosystems through RIS3, Horizon 2020 and Euro...Developing Regional Innovation Ecosystems through RIS3, Horizon 2020 and Euro...
Developing Regional Innovation Ecosystems through RIS3, Horizon 2020 and Euro...VLC/CAMPUS
 
Assurance responsabilité civile : A Report of Eco-Cities
Assurance responsabilité civile : A Report of Eco-CitiesAssurance responsabilité civile : A Report of Eco-Cities
Assurance responsabilité civile : A Report of Eco-CitiesRavi Nakulan
 
Effect of the learning support and the use of project management tools
Effect of the learning support and the use of project management toolsEffect of the learning support and the use of project management tools
Effect of the learning support and the use of project management toolsAlexander Decker
 
How to measure innovation in eLearning. The i-AFIEL methodology
How to measure innovation in eLearning. The i-AFIEL methodologyHow to measure innovation in eLearning. The i-AFIEL methodology
How to measure innovation in eLearning. The i-AFIEL methodologyeLearning Papers
 
Open Source Technologies for Contents and Maps
Open Source Technologies for Contents and MapsOpen Source Technologies for Contents and Maps
Open Source Technologies for Contents and MapsTsungWei Hu
 
Markku Markkula - Towards Innovation Ecosystems: from Smart Cities to Smart R...
Markku Markkula - Towards Innovation Ecosystems: from Smart Cities to Smart R...Markku Markkula - Towards Innovation Ecosystems: from Smart Cities to Smart R...
Markku Markkula - Towards Innovation Ecosystems: from Smart Cities to Smart R...ENoLL Conference 2010
 
Hanson Using Cdio Hanson Fors
Hanson Using Cdio Hanson ForsHanson Using Cdio Hanson Fors
Hanson Using Cdio Hanson Forsguest0f2c98
 
Are EU regional digital strategies evidence-based?
Are EU regional digital strategies evidence-based?Are EU regional digital strategies evidence-based?
Are EU regional digital strategies evidence-based?Luigi Reggi
 

Similar a Gianluca Misuraca: "Assessing the socio-economic impact of Telecentres" (20)

OECD Skills Strategy Luxembourg
OECD Skills Strategy LuxembourgOECD Skills Strategy Luxembourg
OECD Skills Strategy Luxembourg
 
4 fines_strategic_directions-martinez
4 fines_strategic_directions-martinez4 fines_strategic_directions-martinez
4 fines_strategic_directions-martinez
 
Gurgaon Renewal Mission Status Report
Gurgaon Renewal Mission Status ReportGurgaon Renewal Mission Status Report
Gurgaon Renewal Mission Status Report
 
Data4Impact Expert Workshop Report
Data4Impact Expert Workshop ReportData4Impact Expert Workshop Report
Data4Impact Expert Workshop Report
 
A guide to ICT-related activities in WP2016-17
A guide to ICT-related activities in WP2016-17A guide to ICT-related activities in WP2016-17
A guide to ICT-related activities in WP2016-17
 
Final report 2007 to 2012
Final report 2007 to 2012Final report 2007 to 2012
Final report 2007 to 2012
 
IRJET - Dnyanada-Back to Learn: A Survey
IRJET - Dnyanada-Back to Learn: A SurveyIRJET - Dnyanada-Back to Learn: A Survey
IRJET - Dnyanada-Back to Learn: A Survey
 
EDF2012 Elena Simperl - EUCLID
EDF2012  Elena Simperl - EUCLIDEDF2012  Elena Simperl - EUCLID
EDF2012 Elena Simperl - EUCLID
 
September 2010
September 2010September 2010
September 2010
 
October 2011
October 2011October 2011
October 2011
 
Smespire at "Powered by INSPIRE" March 2013
Smespire at "Powered by INSPIRE" March 2013Smespire at "Powered by INSPIRE" March 2013
Smespire at "Powered by INSPIRE" March 2013
 
Developing Regional Innovation Ecosystems through RIS3, Horizon 2020 and Euro...
Developing Regional Innovation Ecosystems through RIS3, Horizon 2020 and Euro...Developing Regional Innovation Ecosystems through RIS3, Horizon 2020 and Euro...
Developing Regional Innovation Ecosystems through RIS3, Horizon 2020 and Euro...
 
Assurance responsabilité civile : A Report of Eco-Cities
Assurance responsabilité civile : A Report of Eco-CitiesAssurance responsabilité civile : A Report of Eco-Cities
Assurance responsabilité civile : A Report of Eco-Cities
 
Effect of the learning support and the use of project management tools
Effect of the learning support and the use of project management toolsEffect of the learning support and the use of project management tools
Effect of the learning support and the use of project management tools
 
How to measure innovation in eLearning. The i-AFIEL methodology
How to measure innovation in eLearning. The i-AFIEL methodologyHow to measure innovation in eLearning. The i-AFIEL methodology
How to measure innovation in eLearning. The i-AFIEL methodology
 
Open Source Technologies for Contents and Maps
Open Source Technologies for Contents and MapsOpen Source Technologies for Contents and Maps
Open Source Technologies for Contents and Maps
 
Markku Markkula - Towards Innovation Ecosystems: from Smart Cities to Smart R...
Markku Markkula - Towards Innovation Ecosystems: from Smart Cities to Smart R...Markku Markkula - Towards Innovation Ecosystems: from Smart Cities to Smart R...
Markku Markkula - Towards Innovation Ecosystems: from Smart Cities to Smart R...
 
Eric's pitch.pptx
Eric's pitch.pptxEric's pitch.pptx
Eric's pitch.pptx
 
Hanson Using Cdio Hanson Fors
Hanson Using Cdio Hanson ForsHanson Using Cdio Hanson Fors
Hanson Using Cdio Hanson Fors
 
Are EU regional digital strategies evidence-based?
Are EU regional digital strategies evidence-based?Are EU regional digital strategies evidence-based?
Are EU regional digital strategies evidence-based?
 

Más de TELECENTRE EUROPE

Facilitator’s handbook on “Online Employment Toolkit” in Spanish
Facilitator’s handbook on “Online Employment Toolkit” in SpanishFacilitator’s handbook on “Online Employment Toolkit” in Spanish
Facilitator’s handbook on “Online Employment Toolkit” in SpanishTELECENTRE EUROPE
 
Facilitator’s handbook on “Online Employment Toolkit” in Romanian
Facilitator’s handbook on “Online Employment Toolkit” in RomanianFacilitator’s handbook on “Online Employment Toolkit” in Romanian
Facilitator’s handbook on “Online Employment Toolkit” in RomanianTELECENTRE EUROPE
 
Facilitator’s handbook on “Online Employment Toolkit” in Latvian
Facilitator’s handbook on “Online Employment Toolkit” in LatvianFacilitator’s handbook on “Online Employment Toolkit” in Latvian
Facilitator’s handbook on “Online Employment Toolkit” in LatvianTELECENTRE EUROPE
 
Context Analysis Facilitators
Context Analysis FacilitatorsContext Analysis Facilitators
Context Analysis FacilitatorsTELECENTRE EUROPE
 
Methodological frameworks harmonisation
Methodological frameworks harmonisationMethodological frameworks harmonisation
Methodological frameworks harmonisationTELECENTRE EUROPE
 
Practical guideline transculturation of modules
Practical guideline transculturation of modulesPractical guideline transculturation of modules
Practical guideline transculturation of modulesTELECENTRE EUROPE
 
Protocole of fine tuning of e-learning modules
Protocole of fine tuning of e-learning modulesProtocole of fine tuning of e-learning modules
Protocole of fine tuning of e-learning modulesTELECENTRE EUROPE
 
The role of the National referents
The role of the National referentsThe role of the National referents
The role of the National referentsTELECENTRE EUROPE
 
Context Analysis - comparative report
Context Analysis - comparative reportContext Analysis - comparative report
Context Analysis - comparative reportTELECENTRE EUROPE
 
Profiles of the learners and of their organisations
Profiles of the learners and of their organisationsProfiles of the learners and of their organisations
Profiles of the learners and of their organisationsTELECENTRE EUROPE
 
Context Analysis, initial Research
Context Analysis, initial ResearchContext Analysis, initial Research
Context Analysis, initial ResearchTELECENTRE EUROPE
 
Context Analysis, initial Research
Context Analysis, initial ResearchContext Analysis, initial Research
Context Analysis, initial ResearchTELECENTRE EUROPE
 

Más de TELECENTRE EUROPE (20)

Summary of Research
Summary of ResearchSummary of Research
Summary of Research
 
Facilitator’s handbook on “Online Employment Toolkit” in Spanish
Facilitator’s handbook on “Online Employment Toolkit” in SpanishFacilitator’s handbook on “Online Employment Toolkit” in Spanish
Facilitator’s handbook on “Online Employment Toolkit” in Spanish
 
Facilitator’s handbook on “Online Employment Toolkit” in Romanian
Facilitator’s handbook on “Online Employment Toolkit” in RomanianFacilitator’s handbook on “Online Employment Toolkit” in Romanian
Facilitator’s handbook on “Online Employment Toolkit” in Romanian
 
Facilitator’s handbook on “Online Employment Toolkit” in Latvian
Facilitator’s handbook on “Online Employment Toolkit” in LatvianFacilitator’s handbook on “Online Employment Toolkit” in Latvian
Facilitator’s handbook on “Online Employment Toolkit” in Latvian
 
Pilot training Youth
Pilot training YouthPilot training Youth
Pilot training Youth
 
Training eFacilitators
Training eFacilitatorsTraining eFacilitators
Training eFacilitators
 
Context Analysis Facilitators
Context Analysis FacilitatorsContext Analysis Facilitators
Context Analysis Facilitators
 
Methodological frameworks harmonisation
Methodological frameworks harmonisationMethodological frameworks harmonisation
Methodological frameworks harmonisation
 
Practical guideline transculturation of modules
Practical guideline transculturation of modulesPractical guideline transculturation of modules
Practical guideline transculturation of modules
 
Protocole of fine tuning of e-learning modules
Protocole of fine tuning of e-learning modulesProtocole of fine tuning of e-learning modules
Protocole of fine tuning of e-learning modules
 
The role of the National referents
The role of the National referentsThe role of the National referents
The role of the National referents
 
The role of the tutor
The role of the tutorThe role of the tutor
The role of the tutor
 
Context Analysis - comparative report
Context Analysis - comparative reportContext Analysis - comparative report
Context Analysis - comparative report
 
Profiles of the learners and of their organisations
Profiles of the learners and of their organisationsProfiles of the learners and of their organisations
Profiles of the learners and of their organisations
 
Context Analysis, initial Research
Context Analysis, initial ResearchContext Analysis, initial Research
Context Analysis, initial Research
 
Context Analysis, initial Research
Context Analysis, initial ResearchContext Analysis, initial Research
Context Analysis, initial Research
 
D13 Pen Portrait
D13 Pen PortraitD13 Pen Portrait
D13 Pen Portrait
 
D12 Six thinking hats
D12 Six thinking hatsD12 Six thinking hats
D12 Six thinking hats
 
D11 Case consultation
D11 Case consultationD11 Case consultation
D11 Case consultation
 
D10 Five whys
D10 Five whysD10 Five whys
D10 Five whys
 

Último

Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfSherif Taha
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxAreebaZafar22
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...pradhanghanshyam7136
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfPoh-Sun Goh
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptxMaritesTamaniVerdade
 
Third Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptxThird Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptxAmita Gupta
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxVishalSingh1417
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Jisc
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701bronxfugly43
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxheathfieldcps1
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxRamakrishna Reddy Bijjam
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhikauryashika82
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxDenish Jangid
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.MaryamAhmad92
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17Celine George
 

Último (20)

Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
Third Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptxThird Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptx
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Asian American Pacific Islander Month DDSD 2024.pptx
Asian American Pacific Islander Month DDSD 2024.pptxAsian American Pacific Islander Month DDSD 2024.pptx
Asian American Pacific Islander Month DDSD 2024.pptx
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Spatium Project Simulation student brief
Spatium Project Simulation student briefSpatium Project Simulation student brief
Spatium Project Simulation student brief
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 

Gianluca Misuraca: "Assessing the socio-economic impact of Telecentres"

  • 1. Assessing the socio-economic impact of Telecentres Gianluca Misuraca, Senior Scientific Officer The views expressed by the authors are not necessarily those of the EC October 29, 2012 1
  • 2.
  • 3. Institute for Prospective Technological Studies IPTS: one of the seven institutes of the EC JRC IPTS Mission: to provide support to EU policy-making process by developing science- based responses to policy challenges that have both a socio- economic as well as a scientific/technological dimension
  • 4. Information Society Unit of JRC-IPTS October 29, 2012 4
  • 5. Outline 1. The evolving eInclusion policy landscape 2. The role of eInclusion Intermediaries in the Information Society 3. MIREIA - Measuring the Impact of eInclusion Intermediaries 4. The Way Forward and what´s in for you
  • 6. Setting the stage: the EU eInclusion policy  ICT play an essential role in supporting daily life in today's digital society  e-Inclusion means both inclusive ICT and the use of ICT to achieve wider inclusion objectives  e-Inclusion policy aims at reducing gaps in ICT usage and promoting the use of ICT to overcome exclusion, and improve economic performance, employment opportunities, quality of life, social participation and cohesion  Launched under the i2010 Agenda for realising the inclusive pillar of the Lisbon Strategy  Riga Ministerial Declaration in 2006  Vienna Ministerial Conference in 2008  It now features as an important element in the Digital Agenda for Europe, a flagship of the current Europe 2020 strategy  Under Pillar 6 - Enhancing digital literacy, skills and inclusion, the Commission proposes a series of measures to promote take-up of ICT by potentially disadvantaged groups, such as elderly, less-literate, low-income persons, etc.
  • 7. A changing Policy landscape for eInclusion  Renewed focus on Growth and Jobs in the current socio-economic context (e.g. New Employment Package adopted on 18/4/2012)  it becomes crucial to assess the impact of eInclusion initiatives so to convince “ICT outsiders” and to support mainstream of ICT use in non-ICT policies  eInclusion is closely related to EU policies on social inclusion, education and culture, regional development, innovation, industry and internal market  An agenda for new skills and new jobs  Youth on the move  European platform against poverty and social exclusion  Regional cohesion • especially in light of the current debate on the reform of the EU policy and instruments for social and economic cohesion
  • 8. Unleashing the power of the ´I2 paradigm´ • eInclusion is about both inclusive technological innovation and innovative ways to deliver inclusive policies by using ICTs • ’There are probably few fields where Inclusion and Innovation are so entwined and can in principle virtuously feed each other as that of inclusive services supported by ICTs • Technology driven innovation in service provision has an impact on economy and society and finds market sustainability only inasmuch as the adoption and appropriation of such services in everyday life activities are wide and expanding among citizens and across all value chains. • Yet this potential will not be unlocked until innovative policies and regulatory solutions, as well as investments by industry, expand their adoption. Source, EC Vienna Study (2009).
  • 9. The role of the eInclusion intermediaries (eI2) in the Information Society  eI2 play a crucial role especially due to their potential multiplier effects in promoting socio-economic inclusion at various levels (regional, local, community, thematic, etc.) and thus contribute exploiting the I2 paradigm  In spite of their crucial role, eI2 have received limited policy attention and there are important ‘knowledge gaps’  The variety of eInclusion intermediary actors in Europe is high  ‘Telecentres’ are assumed to be representative of the types of organisations and network organisations populating the vast field of eInclusion intermediary actors
  • 10. MIREIA Measuring the impact of eInclusion Intermediary actors on Digital Literacy, Skills, and Inclusion Goals  Characterising the role of eI2 actors involved in implementing eInclusion policies and better understand their policy potential  Developing a conceptual and methodological framework to assess impacts of ICT-enabled MIREIA la estrella services (eI2-mediated) in support of groups at (MIREIA the star)* *http://www.casadellibro.com/libro-mireia- risk of exclusion and to promote social inclusion, la-estrella-un-libro-musical-para-mirar-tocar- y-escuchar/9788434885240/864859 integration and employability
  • 11. MIREIA’s Rationale  The rationale of the research relies on the need to develop a shared methodological framework to measure the impact of eI2 actors on the socio-economic conditions of the target users they address  This project, done in close cooperation with key stakeholders, is expected to involve practitioner and design jointly a methodological framework to further enhance capacity, mobilise stakeholders and engage them to collect data so as to measure their impact  An indirect objective of the project is also to further link its results with EC supporting funding schemes (e.g. ICT-PSP-CIP, European Social Fund – ESF, and others)
  • 12. Research design: MIREIA’s Building Blocks Explanation and theories Task 1 – Literature Review Task 1 – Literature Review LR on Employability WP1 – eI2A WP1 – eI2A Characterisat Characterisat Task 2 – Locality Locality Mapping ion & ion & mapping in 3 selected Mapping Mapping areas Task 3 – EU Mapping EU Mapping Task 4 – Review of Methods indicators & methods WP2 – eI2 Impact Task 5 – IAF Development Design of IAF Assessment Framework Task 6 – Test of IAF ‘Piloting & Testing’
  • 13. Key activities Explanations and 2 Expert theories Workshops June 2012 June 2012 Task 1 Task 1 WP1 – WP1 – 1- MIREIA LR on Employability Characteris Characteris June 2012 June 2012 2- Employability ation & ation & Task 2 Locality Mapping May 2012 May 2012 Mapping of Mapping of Oct 2012 Oct 2012 eIA eIA Task 3 EU Mapping Jan 2013 Jan 2013 Task 4 Methods Stakeholders June 2012 June 2012 WP2 – Consultation Impact Task 5 Design of IAF Workshop Assessmen Sept 2012 Sept 2012 Draft IAF t Task 6 Pilot&Test 2013 2013 Sept 2012 Sept 2012 Framework
  • 14. MIREIA eI2-IAF  Objective:  To build and test an IAF to systematically collect end-users micro-data through grassroots organisations and aggregate it at various levels, in order to facilitate the measurement of outcomes and the estimation of the impact of those actors on employment, education and social inclusion Focus on the role of ICT for employability  'the combination of factors and processes that enable people to progress toward or find employment, to remain employed, and/or to advance in the workplace' (Brown, Hesketh, Williams, 2003; Fugate, Kinicki, Ashforth, 2004; Houston, 2005)  Evidence from literature shows that • the adoption of ICT increases the demand for skilled workers and reduces that for unskilled workers • Employment, wage trajectories and labour supply decisions along the life-cycle tend to be affected by the level of digital skills possessed by individuals • Access and ability to use ICT affects employability, by shaping the decision to enter the labour market and of investing in training, and the likelihood of obtaining/maintaining a job
  • 15. Unfolding ‘Impact Assessment’ in MIREIA  'a process aimed at structuring and supporting the development of policies’  identifies and assesses the problem at stake and the objectives pursued  identifies the main options for achieving the objective and analyses their likely impacts in the economic, environmental and social fields  outlines advantages and disadvantages of each option and examines possible synergies and trade-offs [European Commission, http://ec.europa.eu/governance/impact/index_en.htm]  The MIREIA eI2-IAF is to be considered as an hybrid mix of methodological approaches and practical methods being, at the same time:  a methodological framework to measure the impacts of eInclusion interventions implemented by eInclusion Intermediary actors  a practical tool-kit to provide guidelines and recommendations for the design and operationalization of monitoring and evaluation systems to be implemented by eInclusion Intermediary actors
  • 16. National Key elements for designing the MIREIA eI2 IAF Politics and policies IC Target Groups/ Beneficiaries T Socio-economic PEOPLE AT RISK Impacts Socio- Transactional environment EU policies demographic NEEDS Third sectorSpecific developmentseInclusion Impacts organisations CBOs Intermediaries Contextual Socio-economic Inclusion Private Disruptives School/training Variables / ICTs environment Sector centresSpecific MISSION Research GOALS Objectives Outputs Outomes Government Community Technology Administrative suppliers culture and Economics attitudes ........... ASSUMPTIONS / RISKS / LIMITATIONS
  • 17. Principles underpinning the MIREIA eI2-IAF  Under certain conditions, ICT-mediated interventions of eI2 can have a potential ‘amplifying’ effect capable of contributing to:  enabling empowerment mechanisms • (e.g. in terms of improving ICT skills and acquiring other skills than ICT, such as social skills, communication skills or labour market skills through ICT, as well as self-confidence, etc. which in turn can increase social capital formation)  enhancing outreach capabilities of individuals and groups either as part of the local community they belong too, but virtually at a global scale • (e.g. through networking and participating in dedicated 'spaces' for socializing and community- building, thus in turn improving social capital bonding and bridging, as individuals of various backgrounds are brought together beyond one's immediate social network)  offering new and innovative ways for economic participation in society • (e.g. increasing the opportunities for job-related search, training and self-employment or online activities allowing to engage in social and economic interactions)
  • 18. Methodological approach: A multi-level analysis Perspective/Target Type of Indicators Level of analysis Costs and benefits from Contribution of eI2 a policy and broader activities to ‘global Policy/Macro socio-economic Impacts’ on society and perspective economy at large Role of eI2 from an ‘Mediated effects in terms organizational/ of indirect outcomes Strategic/Meso institutional perspective /specific impacts eInclusion Direct benefits in terms of Operational/Micro and Exo Intermediary/services outputs/direct outcomes
  • 20. Employability relevant outcomes and (specific) impact dimensions  Direct and indirect effects of eI2 identified to be employability relevant:  Skilling: improvement of ICT skills and capabilities, thus leading to better opportunities to look for and apply for jobs  Empowerment: enhancement of confidence and motivation for learning, leading to an increased perception of the possibility to improve (individual/group) social and economic conditions (social capital formation);  Networking capacities: strengthening network ties and outreach potential (social capital bonding and bridging), leading to increase of the opportunities for socio-economic integration;  Job-placement: facilitate the possibility for accessing information on labour market and entrepreneurial opportunities, thus participating actively to the (local) economic development and contributing to socio-economic inclusion
  • 21. Where are we now? MIREIA’s Overview of activities Task 1 – Literature Review Experts and Stakeholders’ Consultations Experts and Stakeholders’ Consultations Task 2 – Locality Mapping Task 3 – EU Mapping Task 4 – Review of methods and indicators Task 5 – Development of the Impact Assessment Framework Task 6 – Test of the Impact Assessment Framework Way forward 2012 2013
  • 22. The way forward  Continue building the MIREIA Community of practice  Experts and stakeholders workshops and Online consultation  Linking to Telecentre Europe and other key stakeholders  Finalise the three ‘Exhaustive Locality mapping´ analysis  1. El Raval, Barcelona, Spain - Neighboroud  2. Sunderland, UK – Urban Area  3. Zemgale, Latvia – Rural Area  Start-up the ´Mapping of Telecentres´ at EU27 level  Executed by Telecentre-Europe (October 2012 – March 2013)  Characterisation of eI2 in Europe  to support to gain visibility and policy attention with regard to their contribution to policy goals
  • 23. The way forward  Develop the eI2 – IAF and ´test´ its validity in real life settings through ´applying´ its principles to 5 case study interventions  1. Community Hubs, UK Online Centres, UK  2. eSkills and your future profession, LDP/FRSI, Poland  3. Fast Track to IT, FIT, Ireland  4. Pane & Internet, Emilia Romagna Region, Italy  5. Social Innovation & Employability, Guadalinfo, Andalusia, Spain  Develop a 'full-fledged' operational framework including  a complete set of monitoring and evaluation indicators  guidelines, practical tools and instruments for monitoring and evaluation  Refine and validate the eI2 IAF through discussion with experts and stakeholders  develop recommendations for possibly generalising the MIREIA eI2-IAF at European level, through, for example, a 'large-scale' pilot and/or other policy and research actions.
  • 24. For further information about MIREIA: http://is.jrc.ec.europa.eu/pages/EAP/MIREIA.html gianluca.misuraca@ec.europa.eu cristina.torrecillas@ec.europa.eu

Notas del editor

  1. 1
  2. An agenda for new skills and jobs : to revitalize labour market reforms to help people gain the right skills for future jobs, to create new jobs and overhaul EU employment legislation; Youth on the move : to improve young people's chances of finding a job by helping students and trainees gain experience in other countries, and improving the quality and attractiveness of education and training in Europe; European platform against poverty and social exclusion : to bolster work at all levels to reach the agreed EU headline target of lifting at least 20 million people out of poverty and exclusion by 2020 In addition to this, the EU regional policy which supports job creation, competitiveness, economic growth, improved quality of life and sustainable development is also closely interconnected with the delivery of eInclusion, especially in light of the current debate on the reform of the EU Social Cohesion policy and instruments
  3. E.g. in providing digital literacy to excluded groups and using ICTs to support social inclusion of disadvantaged groups through acquiring new skills or for supporting them for instance in their search for employment there is still incomplete knowledge about who and how many these actors are, their funding sources, their role for improving socio-economic inclusion, the target groups they address, the services they provide, the social needs they fulfil, the impact of their actions from socio-economic and digital inclusion perspective, and finally their -ICT related- needs and how policy could support them
  4. E.g. in providing digital literacy to excluded groups and using ICTs to support social inclusion of disadvantaged groups through acquiring new skills or for supporting them for instance in their search for employment there is still incomplete knowledge about who and how many these actors are, their funding sources, their role for improving socio-economic inclusion, the target groups they address, the services they provide, the social needs they fulfil, the impact of their actions from socio-economic and digital inclusion perspective, and finally their -ICT related- needs and how policy could support them
  5. What eInclusion actors are, which services they provide, to which targets groups, how they operate and innovate, and how they can be calssifed Estimation of the size and distribution of the actors
  6. What eInclusion actors are, which services they provide, to which targets groups, how they operate and innovate, and how they can be calssifed Estimation of the size and distribution of the actors
  7. What eInclusion actors are, which services they provide, to which targets groups, how they operate and innovate, and how they can be calssifed Estimation of the size and distribution of the actors
  8. What eInclusion actors are, which services they provide, to which targets groups, how they operate and innovate, and how they can be calssifed Estimation of the size and distribution of the actors
  9. What eInclusion actors are, which services they provide, to which targets groups, how they operate and innovate, and how they can be calssifed Estimation of the size and distribution of the actors