SlideShare una empresa de Scribd logo
1 de 47
Open Education 2011:
A case study in OER within the LMS
John Rinderle   @JohnRinderle
Bill Jerome
OER within the LMS

Why the LMS?
Interoperability standards
Our approach and findings
Looking forward
   Opportunities and challenges
Discussion
Open Learning Initiative

Produce courses and course materials which enact
  instruction and support instructors

Provide open access to these courses and materials

Develop communities of use, research and development
  that enable evaluation and continuous improvement
Why the LMS?

Convenient for students and instructors
   Single sign on
   Single entry point
   Mix and match
   Coherent navigation
   Roster management
   Unified gradebook
   Learning analytics

Frequently requested by students and instructors
Why the LMS?

Increasing access is part of our core mission

Easier to find
  Metadata and search


Easier to consume
  Learning management systems


To extend the reach of OER, we must bring it to where it is
  needed, where it is convenient to use
Standards?
Not building blocks, modules, and plugins?


Too many platforms to target otherwise
  Moodle, Sakai, Blackboard, Desire2Learn, Canvas, …

Changing technology, changing standards

Are they “standards” in name only?
  We should not be surprised when standards work!

Confidence in mature, proven technologies
Which standard to choose?

OLI courses provide
  User profiles
  Persistent state
  Multiple assignments
  Scores
  Student work products
  Learning Dashboard


More than a simple content package!
IMS Learning Tools
Interoperability
Basic LTI
  Tool consumer, tool provider
  Trust relationship with the LMS
  Fields to identify user, course, etc.
  Simple, but powerful

Full LTI
  Grade exchange
  Multiple tool endpoints
  Much more complex
Basic LTI

Available for most LMS systems
Easy to develop tools
  Simple web request
Easy to consume tools
  No programming required
Pathway to more advanced features
Extensible
Low-cost implementation
Two Clicks: LMS Link
Two Clicks: Research Consent
Your Course
OLI in the LMS
Challenges

Technology
Policy
User Experience
Challenges: Technology
Some LMS products require an extension
  Requires institutional level support
  We want individual instructors to be able to adopt


Some implementations are buggy
  e.g. Internet Explorer on Moodle
  We wrote patch for basiclti4moodle


Basic LTI has few required fields
  Required, recommended, option fields
  Different products supply different data
Challenges: Process/Policy

Security and privacy concerns
  e.g. data ownership questions, security audits

Audit / control which tools instructors are using

Helping instructors get support from their institution
User Experience

   • Why is good user experience critical to adoption?
User Experience

   • Why is good user experience critical to adoption?
      • Using complex systems is easy for some, but
        much harder than one may expect for average
        users, instructors and students alike
User Experience

   • Why is good user experience critical to adoption?
      • Using complex systems is easy for some, but
        much harder than one may expect for average
        users, instructors and students alike

      • Instructors may not adopt a technology if it gives
        the appearance of complicating their lives
         • Setup
         • Workflow
User Experience

   • Why is good user experience critical to adoption?
      • Students who struggle with interfaces experience
        negative affect and their meta cognitive resources
        are not spent where we’d like for learning
Challenges: User Experience

   • Roster Management
      • No record until first student access from their LMS
      • Students never dropped from roster
      • Teaching assistants often unsupported
Challenges: User Experience

   • Gradebook / Learning Dashboard Tools
      • Grade exchange is very limited
      • Aiding instructors and students in locating no
        longer centralized scores
      • Access to reporting tools richer than grades
Challenges: User Experience

   • Login
      • Removed the link as it does not fully reflect user
        expectation
          • This proved unpopular
Challenges: User Experience

   • Bookmarking
      • Leads to unauthenticated visits that require
        redirects to LMS
         • Basic LTI does not support the direct back
Challenges: User Experience

   • Desktop Support
      • Who do user questions gets routed to?
      • OLI questions need to reach OLI help desk
      • LMS questions need to reach LMS help desk
Challenges: User Experience

   • Where do users have accounts: OLI or LMS
Challenges: User Experience

   • Where do users have accounts: OLI or LMS
      • Carnegie Mellon solution: both
      • Existing users solution: both
      • All others: LMS-only
Challenges: User Experience

   • Where do users have accounts: OLI or LMS
      • Carnegie Mellon solution: both
      • Existing users solution: both
      • All others: LMS-only
         • Unless you’re not using an LMS at all, then OLI only
Challenges: User Experience

   • Where do users have accounts: OLI or LMS
      • Carnegie Mellon solution: both
      • Existing users solution: both
      • All others: LMS-only
         • Unless you’re not using an LMS at all, then OLI only
            • Did you just now learn you could use your LMS but
               already setup your course? We can merge your
               accounts for you.
Challenges: User Experience

   • Where do users have accounts: OLI or LMS
      • Carnegie Mellon solution: both
      • Existing users solution: both
      • All others: LMS-only
         • Unless you’re not using an LMS at all, then OLI only
            • Did you just now learn you could use your LMS but
               already setup your course? We can merge your
               accounts for you.
                 • …unless you have students already registered
                   through OLI which might confuse them.
Challenges: User Experience

     • Where do users have accounts: OLI or LMS
        • Carnegie Mellon solution: both
        • Existing users solution: both
        • All others: LMS-only
            • Unless you’re not using an LMS at all, then OLI only
               • Did you just now learn you could use your LMS but
                  already setup your course? We can merge your
                  accounts for you.
                    • …unless you have students already registered
                      through OLI which might confuse them.

Not easy to communicate to novice users
Challenges: User Experience

Configuring / enabling tools in LMS is complex
  Above and beyond what an instructor should have to do



Figuring out if a system is compatible is complex
  Which vendor, product, version are you using?
  Are the appropriate extensions installed and enabled?
  We built a test and configure your LMS page
What’s next for OLI?

Configurable Entry Points
 Instructors customize LMS links to OLI

Full LTI
  Report outcomes to LMS gradebook

Tool Consumer
  Enable Basic LTI tools within OLI courses?
Looking Forward: Opportunities

Learning analytics
  Data for continuous improvement


Better user experience
  Anyone should be able to do it
Feedback Loops for Learning
Comprehensive View of Learning
Learning Analytics

How do we get there?
 Standards for data
 Data exchange API
 Platforms and tools
 Policy for data exchange

LMS interoperability and learning analytics should
 be automatic, not an afterthought.
Better User Experience

What about a familiar model?
OER App Store

Find OER from within the LMS

One click access to add to course

A basis for choice
  Evaluation, context of use information

Built in communities
Why hasn’t this happened
[sooner]?
Publishers are now preparing offerings
  – Pearson OpenClass
  – Commercial and open content
Why hasn’t this happened
[sooner]?
Technology?
Standards?
Institutional Policy?
Licensing?
Data Ownership?
Why hasn’t this happened?

We need platforms which makes it easy to create,
 share, find, use and evaluate OER

The user focus needs to be on the educators and
  learners consuming OER
Discussion
How does OER make greater inroads to the LMS?

Do you agree with the app store approach?
  What should an OER app store offer?


Does the app model extends or replace the content
  package?

Open and “closed”, free and commercial, side by side?

Next steps to make this happen?
Thank You
User Experience

   • ISO definition : a person's perceptions and responses
     that result from the use or anticipated use of a
     product, system or service.
      • Source: http://en.wikipedia.org/wiki/User_experience#Definitions
User Experience

   • ISO definition : a person's perceptions and responses
     that result from the use or anticipated use of a
     product, system or service.
      • Source: http://en.wikipedia.org/wiki/User_experience#Definitions


   • We incorporate usability study into the design,
     development, and evaluation of user experience

Más contenido relacionado

La actualidad más candente

Creating Online and Blended Learning
Creating Online and Blended LearningCreating Online and Blended Learning
Creating Online and Blended Learning
Andy Petroski
 
YouTestMe Classroom 2020 Presentation
YouTestMe Classroom 2020 PresentationYouTestMe Classroom 2020 Presentation
YouTestMe Classroom 2020 Presentation
Filip Dimitrijević
 

La actualidad más candente (20)

Thinking it through: Choosing the right Blackboard tool for the job | Neville...
Thinking it through: Choosing the right Blackboard tool for the job | Neville...Thinking it through: Choosing the right Blackboard tool for the job | Neville...
Thinking it through: Choosing the right Blackboard tool for the job | Neville...
 
Making Adoption Eesy | Tammy Robinson (University of Newcastle) & Mieke Post ...
Making Adoption Eesy | Tammy Robinson (University of Newcastle) & Mieke Post ...Making Adoption Eesy | Tammy Robinson (University of Newcastle) & Mieke Post ...
Making Adoption Eesy | Tammy Robinson (University of Newcastle) & Mieke Post ...
 
Creating & Sustaining Groups in Blackboard
Creating & Sustaining Groups in BlackboardCreating & Sustaining Groups in Blackboard
Creating & Sustaining Groups in Blackboard
 
YouTestMe Starter Presentation
YouTestMe Starter PresentationYouTestMe Starter Presentation
YouTestMe Starter Presentation
 
What About Moodle
What About MoodleWhat About Moodle
What About Moodle
 
Mozilla Open Badges and Mozilla Backpack -
Mozilla Open Badges and Mozilla Backpack - Mozilla Open Badges and Mozilla Backpack -
Mozilla Open Badges and Mozilla Backpack -
 
Hubert Managing The Content Explosion
Hubert Managing The Content ExplosionHubert Managing The Content Explosion
Hubert Managing The Content Explosion
 
Creating Online and Blended Learning
Creating Online and Blended LearningCreating Online and Blended Learning
Creating Online and Blended Learning
 
YouTestMe Classroom 2020 Presentation
YouTestMe Classroom 2020 PresentationYouTestMe Classroom 2020 Presentation
YouTestMe Classroom 2020 Presentation
 
Micro Instructional Design for Problem-Based and Game-Based Learning
Micro Instructional Design for Problem-Based and Game-Based LearningMicro Instructional Design for Problem-Based and Game-Based Learning
Micro Instructional Design for Problem-Based and Game-Based Learning
 
Wow! That’s a great use of Blackboard Collaborate | Mark Bailye & Foong Yee L...
Wow! That’s a great use of Blackboard Collaborate | Mark Bailye & Foong Yee L...Wow! That’s a great use of Blackboard Collaborate | Mark Bailye & Foong Yee L...
Wow! That’s a great use of Blackboard Collaborate | Mark Bailye & Foong Yee L...
 
Implementing an Online Learning Initiative
Implementing an Online Learning InitiativeImplementing an Online Learning Initiative
Implementing an Online Learning Initiative
 
The A-Z of E-learning
The A-Z of E-learningThe A-Z of E-learning
The A-Z of E-learning
 
Moodlerooms Enterprise Upgrade Process | Shirley Li (Macquarie University) & ...
Moodlerooms Enterprise Upgrade Process | Shirley Li (Macquarie University) & ...Moodlerooms Enterprise Upgrade Process | Shirley Li (Macquarie University) & ...
Moodlerooms Enterprise Upgrade Process | Shirley Li (Macquarie University) & ...
 
Blackboard Next Generation Upgrade and Support Plan
Blackboard Next Generation Upgrade and Support PlanBlackboard Next Generation Upgrade and Support Plan
Blackboard Next Generation Upgrade and Support Plan
 
Online Tests: Filling in the Gaps | Mary-Ann Shuker & Dr Suzzanne Owen - Grif...
Online Tests: Filling in the Gaps | Mary-Ann Shuker & Dr Suzzanne Owen - Grif...Online Tests: Filling in the Gaps | Mary-Ann Shuker & Dr Suzzanne Owen - Grif...
Online Tests: Filling in the Gaps | Mary-Ann Shuker & Dr Suzzanne Owen - Grif...
 
eAssessment Policy and Practice
eAssessment Policy and PracticeeAssessment Policy and Practice
eAssessment Policy and Practice
 
Instructional Design Model in E-learning
Instructional Design Model in E-learningInstructional Design Model in E-learning
Instructional Design Model in E-learning
 
Blended Learning - The Best Option
Blended Learning - The Best OptionBlended Learning - The Best Option
Blended Learning - The Best Option
 
Brightspace tools to positively impact student engagement
Brightspace tools to positively impact student engagementBrightspace tools to positively impact student engagement
Brightspace tools to positively impact student engagement
 

Similar a Open Education 2011: A case study in OER within the LMS

MOOCS@Work Working Group Session 3
MOOCS@Work Working Group Session 3MOOCS@Work Working Group Session 3
MOOCS@Work Working Group Session 3
LearningCafe
 
LDT650 asynchronous module - LMS Schoology - SBD (1) [Autosaved]
LDT650 asynchronous module - LMS Schoology - SBD (1) [Autosaved]LDT650 asynchronous module - LMS Schoology - SBD (1) [Autosaved]
LDT650 asynchronous module - LMS Schoology - SBD (1) [Autosaved]
kimberlydesigner1
 
2010 Edu tools
2010 Edu tools2010 Edu tools
2010 Edu tools
WCET
 
MOOCS@Work Working Group Session 2
MOOCS@Work Working Group Session 2MOOCS@Work Working Group Session 2
MOOCS@Work Working Group Session 2
LearningCafe
 

Similar a Open Education 2011: A case study in OER within the LMS (20)

Reduce the Cost of Online Learning & Training with Moodle LMS
Reduce the Cost of Online Learning & Training with Moodle LMSReduce the Cost of Online Learning & Training with Moodle LMS
Reduce the Cost of Online Learning & Training with Moodle LMS
 
Tips for Selecting the Right Learning Management System
Tips for Selecting the Right Learning Management SystemTips for Selecting the Right Learning Management System
Tips for Selecting the Right Learning Management System
 
MOOCS@Work Working Group Session 3
MOOCS@Work Working Group Session 3MOOCS@Work Working Group Session 3
MOOCS@Work Working Group Session 3
 
Costs Associated with an Open Source LMS
Costs Associated with an Open Source LMS Costs Associated with an Open Source LMS
Costs Associated with an Open Source LMS
 
How to choose the best lms
How to choose the best lmsHow to choose the best lms
How to choose the best lms
 
5R Open Course Design Framework, Fall 2015 version
5R Open Course Design Framework, Fall 2015 version5R Open Course Design Framework, Fall 2015 version
5R Open Course Design Framework, Fall 2015 version
 
Leveraging Your LMS to Meet Organizational Goals
Leveraging Your LMS to Meet Organizational GoalsLeveraging Your LMS to Meet Organizational Goals
Leveraging Your LMS to Meet Organizational Goals
 
7 Best Practices for your Moodle RFP
7 Best Practices for your Moodle RFP 7 Best Practices for your Moodle RFP
7 Best Practices for your Moodle RFP
 
Top 5 LMS Myths Debunked by Adobe Captivate Prime
Top 5 LMS Myths Debunked by Adobe Captivate PrimeTop 5 LMS Myths Debunked by Adobe Captivate Prime
Top 5 LMS Myths Debunked by Adobe Captivate Prime
 
LDT650 asynchronous module - LMS Schoology - SBD (1) [Autosaved]
LDT650 asynchronous module - LMS Schoology - SBD (1) [Autosaved]LDT650 asynchronous module - LMS Schoology - SBD (1) [Autosaved]
LDT650 asynchronous module - LMS Schoology - SBD (1) [Autosaved]
 
Blended learning systems
Blended learning systemsBlended learning systems
Blended learning systems
 
Top 7 hidden costs of deploying an lms
Top 7 hidden costs of deploying an lmsTop 7 hidden costs of deploying an lms
Top 7 hidden costs of deploying an lms
 
2010 Edu tools
2010 Edu tools2010 Edu tools
2010 Edu tools
 
Trends in digital learning
Trends in digital learningTrends in digital learning
Trends in digital learning
 
MOOCS@Work Working Group Session 2
MOOCS@Work Working Group Session 2MOOCS@Work Working Group Session 2
MOOCS@Work Working Group Session 2
 
Top 7 lms features for higher ed mar. 3
Top 7 lms features for higher ed   mar. 3Top 7 lms features for higher ed   mar. 3
Top 7 lms features for higher ed mar. 3
 
E-LEARNING
E-LEARNINGE-LEARNING
E-LEARNING
 
Total learning: The Intersection of Formal, Social and Experiential Learning
Total learning:  The Intersection of Formal, Social and Experiential LearningTotal learning:  The Intersection of Formal, Social and Experiential Learning
Total learning: The Intersection of Formal, Social and Experiential Learning
 
Learning Management System (LMS)
Learning Management System (LMS)Learning Management System (LMS)
Learning Management System (LMS)
 
Top 7 Hidden Costs of Deploying an LMS march 17
Top 7 Hidden Costs of Deploying an LMS   march 17Top 7 Hidden Costs of Deploying an LMS   march 17
Top 7 Hidden Costs of Deploying an LMS march 17
 

Último

Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 

Último (20)

Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
REMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptxREMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptx
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptx
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptxExploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptxCOMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 

Open Education 2011: A case study in OER within the LMS

  • 1. Open Education 2011: A case study in OER within the LMS John Rinderle @JohnRinderle Bill Jerome
  • 2. OER within the LMS Why the LMS? Interoperability standards Our approach and findings Looking forward Opportunities and challenges Discussion
  • 3. Open Learning Initiative Produce courses and course materials which enact instruction and support instructors Provide open access to these courses and materials Develop communities of use, research and development that enable evaluation and continuous improvement
  • 4. Why the LMS? Convenient for students and instructors Single sign on Single entry point Mix and match Coherent navigation Roster management Unified gradebook Learning analytics Frequently requested by students and instructors
  • 5. Why the LMS? Increasing access is part of our core mission Easier to find Metadata and search Easier to consume Learning management systems To extend the reach of OER, we must bring it to where it is needed, where it is convenient to use
  • 6. Standards? Not building blocks, modules, and plugins? Too many platforms to target otherwise Moodle, Sakai, Blackboard, Desire2Learn, Canvas, … Changing technology, changing standards Are they “standards” in name only? We should not be surprised when standards work! Confidence in mature, proven technologies
  • 7. Which standard to choose? OLI courses provide User profiles Persistent state Multiple assignments Scores Student work products Learning Dashboard More than a simple content package!
  • 8. IMS Learning Tools Interoperability Basic LTI Tool consumer, tool provider Trust relationship with the LMS Fields to identify user, course, etc. Simple, but powerful Full LTI Grade exchange Multiple tool endpoints Much more complex
  • 9. Basic LTI Available for most LMS systems Easy to develop tools Simple web request Easy to consume tools No programming required Pathway to more advanced features Extensible Low-cost implementation
  • 13. OLI in the LMS
  • 15. Challenges: Technology Some LMS products require an extension Requires institutional level support We want individual instructors to be able to adopt Some implementations are buggy e.g. Internet Explorer on Moodle We wrote patch for basiclti4moodle Basic LTI has few required fields Required, recommended, option fields Different products supply different data
  • 16. Challenges: Process/Policy Security and privacy concerns e.g. data ownership questions, security audits Audit / control which tools instructors are using Helping instructors get support from their institution
  • 17. User Experience • Why is good user experience critical to adoption?
  • 18. User Experience • Why is good user experience critical to adoption? • Using complex systems is easy for some, but much harder than one may expect for average users, instructors and students alike
  • 19. User Experience • Why is good user experience critical to adoption? • Using complex systems is easy for some, but much harder than one may expect for average users, instructors and students alike • Instructors may not adopt a technology if it gives the appearance of complicating their lives • Setup • Workflow
  • 20. User Experience • Why is good user experience critical to adoption? • Students who struggle with interfaces experience negative affect and their meta cognitive resources are not spent where we’d like for learning
  • 21. Challenges: User Experience • Roster Management • No record until first student access from their LMS • Students never dropped from roster • Teaching assistants often unsupported
  • 22. Challenges: User Experience • Gradebook / Learning Dashboard Tools • Grade exchange is very limited • Aiding instructors and students in locating no longer centralized scores • Access to reporting tools richer than grades
  • 23. Challenges: User Experience • Login • Removed the link as it does not fully reflect user expectation • This proved unpopular
  • 24. Challenges: User Experience • Bookmarking • Leads to unauthenticated visits that require redirects to LMS • Basic LTI does not support the direct back
  • 25. Challenges: User Experience • Desktop Support • Who do user questions gets routed to? • OLI questions need to reach OLI help desk • LMS questions need to reach LMS help desk
  • 26. Challenges: User Experience • Where do users have accounts: OLI or LMS
  • 27. Challenges: User Experience • Where do users have accounts: OLI or LMS • Carnegie Mellon solution: both • Existing users solution: both • All others: LMS-only
  • 28. Challenges: User Experience • Where do users have accounts: OLI or LMS • Carnegie Mellon solution: both • Existing users solution: both • All others: LMS-only • Unless you’re not using an LMS at all, then OLI only
  • 29. Challenges: User Experience • Where do users have accounts: OLI or LMS • Carnegie Mellon solution: both • Existing users solution: both • All others: LMS-only • Unless you’re not using an LMS at all, then OLI only • Did you just now learn you could use your LMS but already setup your course? We can merge your accounts for you.
  • 30. Challenges: User Experience • Where do users have accounts: OLI or LMS • Carnegie Mellon solution: both • Existing users solution: both • All others: LMS-only • Unless you’re not using an LMS at all, then OLI only • Did you just now learn you could use your LMS but already setup your course? We can merge your accounts for you. • …unless you have students already registered through OLI which might confuse them.
  • 31. Challenges: User Experience • Where do users have accounts: OLI or LMS • Carnegie Mellon solution: both • Existing users solution: both • All others: LMS-only • Unless you’re not using an LMS at all, then OLI only • Did you just now learn you could use your LMS but already setup your course? We can merge your accounts for you. • …unless you have students already registered through OLI which might confuse them. Not easy to communicate to novice users
  • 32. Challenges: User Experience Configuring / enabling tools in LMS is complex Above and beyond what an instructor should have to do Figuring out if a system is compatible is complex Which vendor, product, version are you using? Are the appropriate extensions installed and enabled? We built a test and configure your LMS page
  • 33.
  • 34. What’s next for OLI? Configurable Entry Points Instructors customize LMS links to OLI Full LTI Report outcomes to LMS gradebook Tool Consumer Enable Basic LTI tools within OLI courses?
  • 35. Looking Forward: Opportunities Learning analytics Data for continuous improvement Better user experience Anyone should be able to do it
  • 36. Feedback Loops for Learning
  • 38. Learning Analytics How do we get there? Standards for data Data exchange API Platforms and tools Policy for data exchange LMS interoperability and learning analytics should be automatic, not an afterthought.
  • 39. Better User Experience What about a familiar model?
  • 40. OER App Store Find OER from within the LMS One click access to add to course A basis for choice Evaluation, context of use information Built in communities
  • 41. Why hasn’t this happened [sooner]? Publishers are now preparing offerings – Pearson OpenClass – Commercial and open content
  • 42. Why hasn’t this happened [sooner]? Technology? Standards? Institutional Policy? Licensing? Data Ownership?
  • 43. Why hasn’t this happened? We need platforms which makes it easy to create, share, find, use and evaluate OER The user focus needs to be on the educators and learners consuming OER
  • 44. Discussion How does OER make greater inroads to the LMS? Do you agree with the app store approach? What should an OER app store offer? Does the app model extends or replace the content package? Open and “closed”, free and commercial, side by side? Next steps to make this happen?
  • 46. User Experience • ISO definition : a person's perceptions and responses that result from the use or anticipated use of a product, system or service. • Source: http://en.wikipedia.org/wiki/User_experience#Definitions
  • 47. User Experience • ISO definition : a person's perceptions and responses that result from the use or anticipated use of a product, system or service. • Source: http://en.wikipedia.org/wiki/User_experience#Definitions • We incorporate usability study into the design, development, and evaluation of user experience

Notas del editor

  1. Increase access, improve outcomes; educate more, better.
  2. One URL to rememberSign in with your university credentialsAdd your own assignmentsWhy duplicate/recreate these features in every new OER environment?
  3. Metadata: LRMI, Dublin Core, LOM, …Increasing access is part of our core mission. Bringing OLI to the LMS lowers another barrier to adoption: ease of use, in a familiar context.Whatever your feelings about LMS systems, the LMS is the familiar information hub of a course.A key factor in OER uptake is the ability of resources to be easily accessed, combined with other course materials, and presented in an appropriate context for learning. For many instructors, the learning management system (LMS) is the information hub of their course. To extend the reach of OER we feel it is critical for resources to be made easily accessible from within the LMS. This need is greater than providing a simple link. From the LMS, OERs should be discoverable to students and instructors who want to use them, support a single sign on interface, provide coherent navigation between LMS and OER, and seamlessly exchange key data (e.g. roster, grades, learning analytics).
  4. Standards can now accommodate applications (tools), not just simple content packages.Differences in how vendors have implemented standards in the past.
  5. OER is becoming increasingly sophisticated.
  6. Basic LTI: REST based, OAuth authentication, simple browser form POST
  7. Click 1: LMS navigation, Click 2: research consent formFall 2011: pilot (60 instructors, 1500 students)Spring 2012: general availability
  8. Did it work as expected?Standards designed as a technology, not to serve end user needs.Current standards lean towards content publishers and institutional needs, instead of instructors and learners who consume content.
  9. OER is no longer under the security radar (which, in a way, is good). Even though no new information is changing hands as compared to when OLI is used outside the LMS, institutions are more concerned about information security where systems connect. An advantage of Basic LTI is that there is no direct communication between the LMS and tool (e.g. OLI). The information comes from the LMS, but is exchanged through the user’s web browser. Privacy settings allow institutions to control what data is exchanged.
  10. There is UX work to do for entry points. Multiple links could be confusing.Allow instructors to choose the assignments for which we send scores back to the LMS.
  11. The most powerful feature of technology based instruction is the ability to embed assessment in each learning activity and use the resulting data to drive powerful feedback loops to the learner, the instructor, the course development team, and learningscience.
  12. While today’s standards allow learning environment to report simple score outcomes to the LMS, the more robust measures of learning required to drive learning analytics remain locked up in individual tools. The result is that it is difficult to mix resources and achieve a unified view of how learning is progressing and the overall effectiveness of the learning design. We feel this is a missed opportunity. The next generation of standards and LMS systems will need to simplify the discovery and adoption of OER and facilitate finer grained data exchange.
  13. Ease of Development:LMS interoperability and learning analytics should be automatic
  14. LMS systems and OER need a renewed focus on user experience. Acknowledge the work of OLI, Sakai, and others.