Track 5 - Endless horizons? Addressing current concerns about learning analytics Authors: Francisco Michavila, Martín Martín-González, Jorge M. Martínez, Francisco J. García-Peñalvo and Juan Cruz-Benito https://www.youtube.com/watch?v=59kQglDGvFk&list=PLboNOuyyzZ877dubjmrEazO5rlRkLrAVg&index=3

1. Analyzing the employability and employment factors of
graduate students in Spain: The OEEU Information System
Francisco Michavila1
Martín Martín-González1
Jorge M. Martínez1
Francisco J. García-Peñalvo2
Juan Cruz-Benito2
1UNESCO Chair in University Management and Policy, Technical University of Madrid
2GRIAL Research Group, Department of Computers and Automatics, University of Salamanca
Contact:
juancb@usal.es / @_juancb
fgarcia@usal.es / @frangp
TEEM 2015
7 - 9 October 2105, Porto - Portugal

2. Outline
1. Introduction
2. Main considerations of the Observatory
3. Information sources and data acquisition strategies
4. The OEEU’s information system
5. First results
6. Conclusions
7. References
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15
2

3. 1. Introduction

4. Introduction
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15
4
The Observatory for University Employability and
Employment (OEEU) is a technical unit that collects,
produces, analyzes and disseminates information about
employability and employment of university graduates in
Spain

5. Introduction
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15
5
OEEU main goals
• To know the evolution of the employability and employment, and its
characteristics related to university graduates
• To develop a system and a uniform methodology for measuring
indicators of employability and employment of graduates
• To generate information on the employability and employment of
university comparable between regions, branches of study (knowledge)
and professional profiles

6. Introduction
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15
6
OEEU main goals
• To support the development of strategies and employment policies for
universities
• To understand the mechanisms and actions of the Spanish Universities
to promote employment and employability of their graduates
• To provide information to universities that favors the adjustment of
academic supply and training demands of the labor market

7. Introduction
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15
7
The completion of these goals could help to
• Develop new strategies for enhance and improve the employability and
employment of graduate students
• Improve the Universities' curricula and education procedures, especially
in this crisis context
• Introduce new data-driven strategies and new Institutional Intelligence
procedures in the Spanish University

8. 2. Main considerations of
the Observatory
Image by Bureau of Land Management
https://flic.kr/p/pQXtr7

9. Main considerations of the Observatory
1. Observatory project is a data-driven project that aims to serve
as a knowledge management system
2. The project is in the scope of emerging areas like Academic
Analytics or Institutional Intelligence
3. The data handled by the Observatory is very sensitive, due it
contains information about students’ gender, studies,
employment, wage, etc.
4. The Observatory also handles sensitive data about universities:
knowing the conclusions of the OEEU's studies could be
possible to infer the best universities, and their employability
metrics (and this can affect the Universities’ enrolment ratio)
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15
9

10. Main considerations of the Observatory
Risks related to the management of the sensitive information
1. The Universities want to protect their most sensitive data, for that,
they trust the Observatory for keeping them safe and anonymized. If
the Observatory does not assure it, Universities will leave the project
2. The data should be gathered and saved complying the Spanish
Personal Data Protection Act (usually named in Spanish as LOPD).
This is, avoiding the identification of the individual behind the data
3. Considering the Observatory’s singularity as data-driven project
about employability and employment (there are no others like it
running in the national scope), the data gathered is very
valuable, so the security, confidentiality and access control of
the information is mandatory
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15
10

11. 3. Information sources and
data acquisition strategies

12. Information sources and data acquisition strategies
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15
12
Information sources
1. Universities. They will provide administrative data about graduates by
uploading CSV files to the OEEU information system
2. Graduate students. They will complete the information provided by
universities through questionnaires responding about their
employment and other information unknown (almost at the moment)
by universities, Ministry, etc.
3. OEEU’s bank of knowledge. Prior to the data collection from the
other information sources, the OEEU defined a bank of knowledge
where is contained information about Spanish Universities, degrees,
taxonomies of competences, etc.

13. Information sources and data acquisition strategies
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15
13
More than 500 variables
related to each student

14. 4. The OEEU’s information
system
Image by edgenumbers
https://flic.kr/p/gKMLF

15. The OEEU’s information system
The Observatory’s information system is the technological product behind the
acquisition, management and analysis of the data
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15
15

16. The OEEU’s information system
It ensures the veracity and quality of data, as well as the proper distribution of
information and mainstreaming of the OEEU’s analysis results
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15
16

17. The OEEU’s information system
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15
17
Is based on a functionalities layers model
1. Support layer for processes and information flows: provides mechanisms,
interfaces and services needed for integrate each subsystem
2. Data persistence layer: stores and organizes the information in a proper
way
3. System for information collection
3.1 Subsystem for collecting information from the Universities
3.2 Subsystem for collecting information of graduates"
4. Information analysis system: analyse the information gathered by the
OEEU
5. Information reporting system: provide information to the users

18. The OEEU’s information system
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15
18

19. 5. First results

20. First results
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15
20
Regarding to the information
• 49 participant universities
• Administrative data from more than 134000 students graduated in the
course 2009-2010
• Questionnaires fulfilled by 13000 students
• The OEEU information system have a good bank of knowledge. The
bank of knowledge contains information that was public previously, as
well information that was not public previously or not available in an
adequate way to be used

21. First results
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15
21
Regarding to the technological product
• The Observatory has tools for collecting raw administrative information
from the universities and its students
• The Observatory has a system that generates custom questionnaires for
each student registered by the universities (customization based on the
responses, university, etc.)
• The Observatory has a system for data presentation and data analysis
that deals with the information gathered

22. First results
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15
22

23. First results
Demo
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15
23

24. 5. Conclusions
Digital-eye by onix15
http://www.deviantart.com/

25. Conclusions
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15
25
• The OEEU is developing a new fashion data driven product in the Spanish
University scope
• The use of the results generated by the Observatory could led to
review and improve the universities’ strategies for employability and
employment, as well an impulse for initiatives related to Institutional
Intelligence, Academic Analytics, etc.
• The first results of the OEEU information system are promising
regarding to the data quantity and the data utility
• In November 2015, the first analysis and conclusions will be public

26. References
Books by vladstudio
http://www.deviantart.com/

27. References
27
• Alcolea Picazo, J. and Pavón De Paula, S., 2013. Los datos como recurso estratégico Libro Blanco Inteligencia
Institucional en Universidades (pp. 17-43). Madrid, Spain: OCU (Oficina de Cooperación Universitaria).
• Baepler, P. and Murdoch, C.J., 2010. Academic analytics and data mining in higher education. International Journal
for the Scholarship of Teaching and Learning 4, 2, 17.
• Bichsel, J., 2012. Analytics in higher education: Benefits, barriers, progress, and recommendations. EDUCAUSE
Center for Applied Research
• Campbell, J.P., Deblois, P.B., and Oblinger, D.G., 2007. Academic analytics: A new tool for a new era. Educause
Review 42, 4, 40.
• García-Holgado, A., Cruz-Benito, J., and García- Peñalvo, F.J., 2015. Analysis of Knowledge Management
Experiences in Spanish Public Administration. In Proceedings of the Third International Conference on Technological
Ecosystems for Enhancing Multiculturality (TEEM'15) (Porto, Portugal, 7-9, October 2015), ACM.
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15

28. References
28
• Mcafee, A., Brynjolfsson, E., Davenport, T.H., Patil, D.J., and Barton, D., 2012. Big data. The management revolution.
Harvard business review 90, 10, 61-67.
• Patil, D.J., 2014. Data Jujitsu: The Art of Turning Data into Product. O'Reilly."
• Patil, D.J. and Mason, H., 2014. Data Driven. Creating a Data Culture. O'Reilly
• Rowley, J., 2007. The wisdom hierarchy: representations of the DIKW hierarchy. Journal of information science 33, 2
(April 1, 2007), 163-180. DOI= http://dx.doi.org/10.1177/0165551506070706.
• Zeleny, M., 1987. Management support systems: Towards integrated knowledge. Human systems management 7,
59-70. .
• Gómez Aguilar, D.A., García-Peñalvo, F.J., and Therón, R., 2014. Analítica Visual en eLearning. El Profesional de la
Información 23, 3, 233-242.
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15

29. How to cite this paper
29
How to cite this work:
• Michavila, F., Martín-González, M., Martínez, J. M., García-Peñalvo, F.J. and
Cruz-Benito, J. 2015. Analyzing the employability and employment factors of
graduate students in Spain: The OEEU Information System. In Proceedings of the
Third International Conference on Technological Ecosystems for Enhancing
Multiculturality (TEEM’15) (Porto, Portugal, October 7-9, 2015), G.R. Alves Ed.
ACM, New York, NY, USA. DOI=http://dx.doi.org/10.1145/2808580.2808622
Analyzing the employability and employment factors of graduate students in Spain: The OEEU Information System – TEEM’15

30. Analyzing the employability and employment factors of
graduate students in Spain: The OEEU Information System
Francisco Michavila1
Martín Martín-González1
Jorge M. Martínez1
Francisco J. García-Peñalvo2
Juan Cruz-Benito2
1UNESCO Chair in University Management and Policy, Technical University of Madrid
2GRIAL Research Group, Department of Computers and Automatics, University of Salamanca
Contact:
juancb@usal.es / @_juancb
fgarcia@usal.es / @frangp
TEEM 2015
7 - 9 October 2105, Porto - Portugal