Works presented in this paper offer teachers and learners the opportunity to express their learning objects assessments and suggestions for use directly from a learning management system, and to store these annotations within a learning object repository. Annotations are thus stored when and where they become relevant. Thanks to an open and standardized architecture, these annotations can be widely shared and exploited in various contexts such as re-authoring, curriculum designs, or learning object retrieval. Indeed, annotations can represent a basis for a (personalized) quality-based sorting mechanism helping users to find and reuse learning resources that match with their preferences. An implementation focusing on Moodle and the Ariadne Knowledge Pool System validates our approach. Olivier Catteau, Philippe Vidal, Julien Broisin. Learning Object Virtualization Allowing for Learning Object Assessments and Suggestions for Use. Dans : IEEE International Conference on Advanced Learning Technologies (ICALT 2008), Santander, Espagne, 01/07/2008-05/07/2008, IEEE, p. 579-583, juillet 2008.

1. Learning Object Virtualization Allowing for Learning Object Assessments and Suggestions for Use Olivier CATTEAU, Philippe VIDAL, Julien BROISIN Institut de Recherche en Informatique de Toulouse

4. LO & Metadata Lifecycle Production Diffusion Use Re-Authoring Termination [ICALT ’ 06] Why assesments?

5. Production Ready-to-use Learning Object Are annotations objective? Production Diffusion Use Re-Authoring Termination Authoring Tools Metadata Author + Annotations LOR

8. Re-authoring (Feedback step) LOR User comments Improve Learning Object content, form or description Production Diffusion Use Re-Authoring Termination Teacher Student Learning Management System Subject Matter Expert Peer reviewing Suggestions for Use

9. What ’ s in the reality?

10. Existing Reviewing Systems MemoNote Azouaou & Desmoulins, A Flexible and Extensible Architecture for Context-Aware Annotation in E-Learning, ICALT ’ 06 LOR

11. Existing Reviewing Systems

12. Existing Reviewing Systems

13. Existing Reviewing Systems

14. Existing Reviewing Systems

15. Existing Reviewing Systems

16. Existing Reviewing Systems

17. Existing Reviewing Systems

18. Existing Reviewing Systems Qualitative &/or quantitative peer review with criteria by a domain expert User comments &/or quantitative evaluation Suggestions for use Evaluation Criteria according to LO types LOR Learning Management System

19. Existing Reviewing Systems Synthesis LOR Quantitative Review Qualitative Review Evalutech NO Peer review by domain expert Harvey Project NO Peer review + Classroom testing LORI Peer review MERLOT Peer review (2 domain experts) Member comments Wisconsin Online Public comments

23. Modified Annotation Category 8. Annotation 8.3 Description 8.2 Date 8.1 Entity 8. Annotation 8.3 Description 8.2 Date 8.1 ’ Contribute 8.1 ’.1 Entity 8.4 Annotation Type 8.5 Quality Level 8.1 ’.2 Role

24. Closer to the end user The LOV Design Search Importation Indexation Generation Specific API 1 Federation Layer Integration Layer Virtualization Layer Specific API 2 LOR 1 LOR 2 LOR WEB SERVICES PHP Storage of Learning Objects & Metadata PHP LOM ++ LOM ++ LMS 1 LMS 2 SOAP/HTTP Annotation ● Peer review ● Comments ● Comments ● Suggestion for use Subject Matter Expert ● Import ● Import Teacher ● LO selection Student ● Use ● Use

26. Implementation Search Importation Indexation Generation Specific API Federation Layer Integration Layer Virtualization Layer KPS ARIADNE WEB SERVICES PHP Storage of Learning Objects & Metadata LOM Annotation Moodle Roles: ● administrator ● course creator ● editing teacher ● teacher ● student ● guest + subject matter expert SOAP/HTTP

27. LO evaluations within the LMS Fast global evaluation Detailed evaluation Annotation Types: ● global ● suggestion for use ● content quality ● effectiveness ● ease to use

28. Annotation submission sequence : USER LMS AMS AWS KPS 1. Fill annotation form 2. Deliver annotation 3. Generate vCard, role, LOR location, LO id 4. Send annotation information 5. Update LO metadata

31. Thanks for your attention