Recognition of learning: Status, experiences and challenges - Carlos Delgado Kloos

1. Recognition of Learning:
Status, Experiences, and Challenges
SS5: eMadrid Special Session
Carlos Delgado Kloos (@cdkloos)
eMadrid Excellence Network
www.emadridnet.org
Scalable Digital Education for All
eMadrid Network
— UC3M (coordinator)
— UAM
— UCM
— UNED
— UPM
— URJC
EDUCON 2023 Kuwait, 2023-05-01--04
2

2. eMadrid Network
— 1 Jan 2010-31 Dec 2013 (-> 31 May 2014)
— 1 Oct 2014-31 Dec 2018
— 1 Jan 2019-31 Dec 2022 (-> 30 Apr 2023)
— Educational
Technologies
EDUCON 2023 Kuwait, 2023-05-01--04
3
eMadrid Network
— www.emadridnet.org
— Organized
— ~100 monthly seminars
— Talks, prizes
— 12 annual workshops
— EDUCON sessions since 2010
— Results
— Papers
— Consulting
EDUCON 2023 Kuwait, 2023-05-01--04
4

3. Session SS5 (Tue, 16:30-18:00, Room 9B)
1. …, Ruth Cobos (UAM):
Meta-Review of Recognition of
Learning in LMSs and MOOCs
2. Edmundo Tovar, … (UPM):
Recognizing lifelong learning
competences: a report of two cases
3. Carlos Delgado Kloos, … (UC3M):
Recognizing the Value of Recognition
in Education
4. Jaime Urquiza-Fuentes (URJC):
A study about the impact of rewards on student’s
engagement with the flipped classroom methodology
5. …, Manuel Castro, … (UNED):
Assessment and recognition in technical massive open
on-line courses with and without on-line laboratories
6. …, Baltasar Fernández Manjón (UCM):
Bootstrapping serious games
to assess learning through analytics
EDUCON 2023 Kuwait, 2023-05-01--04
5
UAM Presentation
1. Cristina Alonso-Fernández, Ruth Cobos (UAM):
Meta-Review of Recognition of Learning in LMSs and MOOCs
EDUCON 2023 Kuwait, 2023-05-01--04
6

4. UPM Presentation
2. Edmundo Tovar, Bernardo Tabuenca (UPM),
Wolfgang Greller (PHW), Nelson Piedra (UTPL):
Recognizing lifelong learning competences:
a report of two cases
EDUCON 2023 Kuwait, 2023-05-01--04
7
UC3M Presentation
3. Carlos Delgado Kloos, Carlos Alario-Hoyos,
Mª Blanca Ibáñez, Pedro M. Moreno-Marcos,
Pedro J. Muñoz-Merino, Iria Estévez-Ayres (UC3M):
Recognizing the Value of Recognition in Education
EDUCON 2023 Kuwait, 2023-05-01--04
8

5. URJC Presentation
4. Jaime Urquiza-Fuentes (URJC):
A study about the impact of rewards on student’s engagement
with the flipped classroom methodology
EDUCON 2023 Kuwait, 2023-05-01--04
9
UNED Presentation
5. Sergio Martín, Manuel Castro, Elio Sancristóbal, Gabriel Díaz,
Blanca Quintana, Rosario Gil, Félix García Loro, Clara Pérez,
Pedro Plaza, África López-Rey, German Carro Fernández,
Antonio Robles-Gómez, Miguel Rodríguez-Artacho,
Llanos Tobarra (UNED), José A. Ruipérez-Valiente (UMu, MIT):
Assessment and recognition in technical
massive open on-line courses with and without on-line laboratories
EDUCON 2023 Kuwait, 2023-05-01--04
10

6. UCM Presentation
6. Manuel Freire, Antonio Calvo Morata, Iván Martínez Ortiz,
Baltasar Fernández Manjón (UCM):
Bootstrapping serious games to assess learning through analytics
EDUCON 2023 Kuwait, 2023-05-01--04
11
EDUCON 2023 Kuwait, 2023-05-01--04
12

7. Recognizing the Value of Recognition in Education
Carlos Delgado Kloos, Carlos Alario-Hoyos, Mª Blanca Ibáñez,
Pedro M. Moreno-Marcos, Pedro J. Muñoz-Merino, Iria Estévez-Ayres
Universidad Carlos III de Madrid
www.it.uc3m.es/cdk, educate.uc3m.es, www.emadridnet.org
@cdkloos
Scalable Digital Education for All
Outline
1. What is recognition?
2. Formats for recognition
3. Uses cases at UC3M
4. Recognizing recognition
14
EDUCON 2023 Kuwait, 2023-05-01--04

8. 1. What is Recognition?
— Definition: Recognition is
“the appreciation or acclaim for an achievement, service, or ability”
-- Oxford Learner’s Dictionary
— All human beings need to be recognized
— Recognition is at the center of self-esteem
— It is also a way to signal to third parties
15
EDUCON 2023 Kuwait, 2023-05-01--04
Recognition
EDUCON 2023 Kuwait, 2023-05-01--04
16

9. Badges
— Typically, internal and informal form of recognition
used for motivation, engagement, and gamification
— Often image-oriented
17
EDUCON 2023 Kuwait, 2023-05-01--04
Credentials
— A credential can be a diploma that
represents the recognition of completion
of an educational program
issued by an institution
that is accredited to issue them
— It can be an official prerequisite
to pursue further studies or practice a profession
18
EDUCON 2023 Kuwait, 2023-05-01--04

10. Recognition and Assessment
EDUCON 2023 Kuwait, 2023-05-01--04
19
2. Formats for Recognition
— 1EdTech (formerly IMS Global)
— OpenBadges
— European Commission
— EDC
— EBSI
— ELM
— Many others…
20
EDUCON 2023 Kuwait, 2023-05-01--04

11. Open Badges 2.0
EDUCON 2023 Kuwait, 2023-05-01--04
21
Image
compul-
sory
Open Badges 3.0
EDUCON 2023 Kuwait, 2023-05-01--04
22
Image
optional
Extension of
W3C VC

12. W3C VC
— Verifiable Credentials Data Model v1.1
W3C Recommendation 03 March 2022
23
EDUCON 2023 Kuwait, 2023-05-01--04
EDC Credentials
24
EDUCON 2023 Kuwait, 2023-05-01--04
European Digital Credentials
for Learning

13. EBSI
EDUCON 2023 Kuwait, 2023-05-01--04
25
European
Blockchain
Services
Infrastructure
ELM
— Used for EDC and EBSI
— Extension of W3C VC
— Aligned with ELMO/EMREX
26
EDUCON 2023 Kuwait, 2023-05-01--04

14. ELMO/EMREX
— ELMO is based on the CEN standard EN 15981-2011 EuroLMAI
— EuroLMAI (European Learner Mobility Achievement Information)
is a data model describing assessments, primarily Diplomas,
Diploma Supplements and Transcripts of Records for higher educations
27
EDUCON 2023 Kuwait, 2023-05-01--04
Formats
Trend towards convergence, higher flexibility, and broader applicability
28
EDUCON 2023 Kuwait, 2023-05-01--04

15. 3. Uses cases at UC3M
A. Competition
B. Gamification
C. EDC Credentials
D. Digital Skills
E. EBSI Credentials
29
EDUCON 2023 Kuwait, 2023-05-01--04
A. Competition
— Competition can engage students in
educational activities
— Students gain recognition by their direct
performance on the activities and by
comparison with peers while competing
— Students can see
their partial ratings after each round and
their final rating after a tournament
— The ISCARE intelligent tutoring system
was designed
30
EDUCON 2023 Kuwait, 2023-05-01--04
P.J. Muñoz-Merino, M. Fernández Molina,
M. Muñoz-Organero, C. Delgado Kloos,
“An adaptive and innovative question-driven compe-
tition-based intelligent tutoring system for learning”,
Expert Systems with Applications,
39(8), 2010, 6932-6948

16. B. Gamification
— C programming language course
with gamification techniques
— Gamification mechanisms used:
points, badges, and leaderboard
— Half of the participants did 29% of extra work in
the gamified learning activity
— Collecting badges was the most effective driver
of participation and lack of badges
discouraged students from continuing work
— The Q-learning game platform was designed
31
EDUCON 2023 Kuwait, 2023-05-01--04
M.B. Ibáñez, A. Di Serio, C. Delgado Kloos,
“Gamification for Engaging Computer Science
Students in Learning Activities: A Case Study”,
IEEE Trans. on Learning Technologies,
7:3, Jul.-Sep. 2014, 291-301
C. EDC Credentials
— Diploma in
"Sustainability Applied to the
Fashion Industry Vogue-UC3M"
— Short program with 9 ECTS
— A digital credential was issued using EDC
32
EDUCON 2023 Kuwait, 2023-05-01--04
C. Alario-Hoyos, C. Delgado Kloos, “Experiences with Micro-Credentials at UC3M: Academic and Technological
Aspects”, EDUNINE2023: VII IEEE World Engineering Education Conference, Bogotá (Colombia), 12-15 Mar 2023

17. D. Digital Skills
— The “Digital University Backpack” is a program for
undergrads and recent graduates to learn digital skills
— Started in Jan 2023, it consists of 7 modules:
6 of 3 ECTS and 1 of 2 ECTS
— Inside each module, badges will be issued with
formative or summative purposes in Moodle
(with a plugin for issuing OpenBadges v2)
— For each of the 7 modules,
a digital EDC microcredential will be issued
33
EDUCON 2023 Kuwait, 2023-05-01--04
www.uc3m.es/
mochiladigital
D. Digital Skills
— The “Digital University Backpack” is a program for
undergrads and recent graduates to learn digital skills
— Started in Jan 2023, it consists of 7 modules:
6 of 3 ECTS and 1 of 2 ECTS
— Inside each module, badges will be issued with
formative or summative purposes in Moodle
(with a plugin for issuing OpenBadges v2)
— For each of the 7 modules,
a digital EDC microcredential will be issued
34
EDUCON 2023 Kuwait, 2023-05-01--04
www.uc3m.es/mochiladigital

18. E. EBSI Credentials
— CertiDigital is working to provide an EBSI-compatible
wallet to facilitate the process of issuing and storing
digital credentials with EBSI
35
EDUCON 2023 Kuwait, 2023-05-01--04
certidigital.es
4. Recognizing Recognition
— How important is recognition?
— What role should it play in instructional design?
36
EDUCON 2023 Kuwait, 2023-05-01--04

19. Constructive Alignment
EDUCON 2023 Kuwait, 2023-05-01--04
37
Constructive Alignment: Adding Recognition
EDUCON 2023 Kuwait, 2023-05-01--04
38

20. Badges and Credentials
EDUCON 2023 Kuwait, 2023-05-01--04
39
Recognition
— Recognition elements should be built into instructional design
in the same way as activities and assessments are
— They play an integral part of the educational experience
— both for formative and summative purposes
— both for internal and external signaling
— both inside of individual courses and across several courses
— The relationship between (some) badges and credentials is important
40
EDUCON 2023 Kuwait, 2023-05-01--04

21. Conclusion
— Digitalization touches everything
— Fragmentation through digitalization
— Smaller courses
— Smaller credentials
— Badges and credentials
— Like formative and summative assessment
— Course and transversal credentials by stacking up badges
— Important component of learning experience
41
EDUCON 2023 Kuwait, 2023-05-01--04
EDUCON 2023 Kuwait, 2023-05-01--04
42