"The OpenUp Ed Quality Framework in Action: How well does the "Learning to Learn" MOOC stack up?" was presented at the BizMOOC conference "Upgrading Business Competence Globally for Today and Tomorrow" at Krakow University of Economics on 9 November 2018. See: http://bizmooc.uek.krakow.pl/?page_id=4201

1. 2018 CC BY 4.0

2. The OpenUpED Quality
Framework in Action: How well
does the “Learning to Learn”
MOOC stack up?
BizMOOC Upgrading Business Competence Globally for Today and
Tomorrow conference
Cracow University of Economics, Crakow, Poland. 9 November 2018
Beck Pitt, PhD.
The Open University (UK) @BeckPitt
2018 CC BY 4.0

3. Aims
• Explore the idea of “Learning to Learn”
• Review the two MOOC produced to address
this Life Long Learning (LLL) competency
• Review the OpenupED Framework against the
“Learning to Learn” MOOC evaluation
2018 CC BY 4.0

4. Learning to Learn
“‘Learning to learn’ is the ability to pursue and persist in learning, to
organise one's own learning, including through effective management
of time and information, both individually and in groups. This
competence includes awareness of one's learning process and needs,
identifying available opportunities, and the ability to overcome
obstacles in order to learn successfully. This competence means
gaining, processing and assimilating new knowledge and skills as well
as seeking and making use of guidance. Learning to learn engages
learners to build on prior learning and life experiences in order to use
and apply knowledge and skills in a variety of contexts: at home, at
work, in education and training. Motivation and confidence are crucial
to an individual's competence.”
(European Commission, 2006)2018 CC BY 4.0

5. http://www.open.edu/openlearncreate/course/view.php?id=2696
4 week self-
paced course
Launched
September
2017
Reflective
course
Statement of
Participation
2018 CC BY 4.0

6. Understanding how learning takes place every
day;
Appreciation and development of existing skills;
Understand how to effectively learn with
MOOC;
Explore a range of digital skills and practices;
Develop a critical approach to online learning.
Learning Outcomes
2018 CC BY 4.0

7. People learning at work
The unemployed and students looking to
appreciate and build on their existing skill sets
Anyone with an interest in improving their
digital skills
People interested in digital citizenship
Those interested in using MOOC to learn
Target Audiences
2018 CC BY 4.0

8. Internal reviews: comparison with other MOOC,
review by internal teams
Learner reviews: Pre- and Post-course surveys
External expert feedback: Pre-launch review and
post-course via 5 focus groups
Own reflections, enrolment numbers,
certificates issued etc.
Evaluation Process
2018 CC BY 4.0

9. Image Credit: BizMOOC MOOC
Book via http://mooc-
book.eu/wp-
content/uploads/2018/10/eval-
desgin-1024x662.jpg

10. Openup Ed Framework
“…firmly rooted in the Open Education
movement” (Jansen, 2016)
2018 CC BY 4.0

11. Image credit: “MOOC – every letter is negotiable” is by @mathplourde and is licensed CC BY 2.0
https://en.wikipedia.org/wiki/Massive_open_online_course#/media/File:MOOC_poster_mathplourde.jpg

12. OpenupEd distinctive features Explanation
Openness to Learners
This captures aspects such as: open entry (no formal admission
requirements), freedom to study at time, place and pace of choice, and
flexible pathways. A broader perspective stresses the importance of
being open to learners’ needs and providing for a wide range of lifelong
learners.
Digital Openness
Courses should not only be freely available online but also allow
application of open licensing so that material and data can be reused,
remixed, reworked and redistributed (e.g. using CC BY-SA or similar).
Learner-centred approach
Courses should aid students to construct their own learning from a rich
environment and to share and communicate it with others; they should
not simply focus on the transmission of content knowledge to students.
Independent Learning
Courses should provide high quality materials to enable an independent
learner to progress through self-study.
Media-supported Interaction
Course materials should make the best use of online affordances
(interactivity, communication, collaboration) as well as rich media (video
and audio) to engage students in their learning.
Recognition Options
Successful course completion should be recognised as indicating
worthwhile educational achievement.
Quality Focus
There should be a consistent focus on quality in the production and
presentation of a course.
Spectrum of Diversity
Courses should be inclusive and accessible to a wide diversity of citizens;
they should allow a spectrum of approaches and contexts, accounting
for a variety of language, culture, setting, pedagogics and technologies.
Table1.ThedistinctivefeaturesofOpenupEdMOOCs(Jansen,
2016,p.5-6citingJansenetal,2016)

13. Excerpt from BizMOOC Review Template MOOC Design, licensed CC BY http://mooc-book.eu/index/learn-more/resources/
2018 CC BY 4.0

14. Excerpt from BizMOOC Review Template MOOC Design, licensed CC BY http://mooc-book.eu/index/learn-more/resources/
2018 CC BY 4.0

15. Feature
How this feature was addressed in the
Learning to Learn MOOC (iteration one)
Evaluation feedback
1 Openness to
Learners
No formal entry requirements;
LLL Competency “Learning to Learn”
fundamental to other competencies;
Created with a range of learners in mind and
accessible with no prior knowledge required;
Flexible in how learners use the sections but did
not have “flexible pathways”;
Open enrolment with no fixed start/end dates.
For most course participants this
was their first experience of
studying with a MOOC;
Positive feedback from both post-
course surveys on quality of
material, relevance, self-paced
nature of course, “clarity” and
activities (see Pitt et al, 2018
forthcoming, pgs. 27 & 32 & 33).
2 Digital
Openness
Course created using tried and tested existing
open content, where appropriate;
Both iterations of the MOOC licensed CC BY 4.0.
to enable reuse and remix etc.
All course content immediately available to
learners once signed in to OpenLearn Create.
Course was originally available to anyone
regardless of whether signed up or not,
however the course content was then wall-
gardened as this was deemed essential for
analytics/tracking of how the course was being
used.
OpenLearn Create sign-on process
was perceived as a barrier to
participation by some reviewers.
This is a platform restriction and
it’s not currently possible to
change the required information.

16. 8 Spectrum
of Diversity
Alt-attributes were included with
images.
Screen reader compatible material.
Course material used wide range of
resources and incorporated real life
experiences inc. MOOC study and
MOOC resources in non-English
languages.
MOOC delivered in English but due to
CC BY 4.0 license could be translated
into other languages;
Videos were not subtitled as some
were hosted outside of the course
platform and the course was on a tight
delivery schedule.
Wider range of non-English
language resources
included in second
iteration;
OpenLearn Create currently
not W3C and WCPG 2.0
compliant (the BizMOOC
project ideal standard);
Accessibility on some
mobile devices was
reported as an issue by
external/internal reviewers.

17. Agreed Changes
• More interactivity
• Reworked course content
with more interaction and
concrete outcomes
• More visual elements
• Changed title to “Digital
Skills, Digital Learning”
• Facilitated for set period
(See p24-5, Pitt et al, 2018)2018 CC BY 4.0
http://www.open.edu/openlearncreat
e/course/view.php?id=3127

18. Openness is a key dimension of MOOC
Quality and Evaluation: Openup Ed Framework
Think carefully about how you want to assess
impact and what that means for “openness”
Platform choice and functionality
Understand your learner
Recommendations
2018 CC BY 4.0

19. Thank you for
listening!
www.bizmooc.eu
www.mooc-book.eu
facebook.com/Bizmo
oc @Bizmoocbook
The European Commission support for the production of this publication does not constitute an endorsement of the
contents which reflects the views only of the authors, and the Commission cannot be held responsible for any use which
may be made of the information contained therein.
PictureCredit:“GiveThanks”byBeckPittislicensedCCBY2.0
https://www.flickr.com/photos/40959105@N00/45683192012/in/dateposted-public/
2018 CC BY 4.0

20. BizMOOC Tools and Templates (openly licensed): http://mooc-
book.eu/index/learn-more/resources/
Openup ED Framework: https://openuped.eu/mooc-features
Openup Ed Quality Frameworks for MOOCs: Webinar Recording
https://openuped.eu/mooc-features/15-english-content/news/284-quality-
frameworks-for-moocs-recordings-webinar-available
Existing MOOC quality models (Darco Jansen): http://mooc-
book.eu/index/learn-more/key-areas/quality/
Pitt, R. de los Arcos, B. Koppel, K. Miani, S and Sancin, C. (2018) Evaluation
report on Pilot MOOC1: Learning to Learn http://bizmooc.eu/wp-
content/uploads/2016/02/BizMOOC-R4.2a-Evaluation-Report-MOOC1-
LearningToLearn.pdf
Further Resources
2018 CC BY 4.0