2. WHY assess quality?
• Bad metadata “Invisible” resources
• Bad metadata Less “cool” things to do with
metadata (explain)
• Bad metadata Mess…
10/6/2010 WHY metadata for MY resources? 2
4. Metadata Quality Review
• In Organic.Edunet, mainly based on Bruce &
Hillman’s framework we’ve chosen some
criteria to assess metadata quality
• Produced a grid to review metadata records
– Using 5 point scales
– Using Yes/No questions
– Using free text field for comments
10/6/2010 WHY metadata for MY resources? 4
5.
6. Selected Criteria (1/2)
• Completeness
– Number of elements provided by the annotator,
compared to the total number of elements in AP
• Appropriateness
– Are the metadata values provided appropriate for
the targeted use?
10/6/2010 WHY metadata for MY resources? 6
7. Selected Criteria (2/2)
• Accuracy
– Do the values correspond to what is annotated?
– Do they reflect the actual resource?
• Consistency
– Are the values provided consistent with the
standard or the AP used?
10/6/2010 WHY metadata for MY resources? 7
9. Setting up
• Divide <total number of participants> with 3
• Create X groups of three
• Each group must have only one laptop open
• Roles
– One person to handle the laptop
– One person to keep notes (will be collected)
– One person to report back to the plenary
10/6/2010 WHY metadata for MY resources? 9
10. 1st Step
• Which two metadata elements would NOT be
useful for describing context specific resources?
• Report back by identifying:
– The context – field of interest (as a group)
– One element
– WHY this is not useful
10/6/2010 WHY metadata for MY resources? 10
Time in groups: 5’
Reporting back: 1’ per group
11. Getting all laptops involved
• Please open your laptops
• Visit: http://whymetadata.jimdo.com
– Under JTEL2010 / Workshop / Workshop resources
10/6/2010 WHY metadata for MY resources? 11
12. 10/6/2010 WHY metadata for MY resources? 12
Hi! I am Bruce & Hillman’s
“Repository Genie” &
I am here to grant you 3 wishes!
I can make your Learning Object
Repository score 100% in only
3 of the criteria presented!
The rest I will leave on the
annotators hands…
Choose wisely!!!
13. • Visit: http://whymetadata.jimdo.com
– Under JTEL2010 / Workshop / Workshop resources
• Read the criteria and what they actually mean
• Use the questionnaire to “wish” for 3 of them
– Reveal one wish in the end!
10/6/2010 WHY metadata for MY resources? 13
2nd Step
Time on your own: 5 mins
Reporting back: 5 seconds per person!
14. 3rd Step
• Imagine you have a big amount of resources.
How would you like to manage them?
– Traditional folder structure (Confolio)
– Tag-based folders (Google Docs, Flickr)
– Search-based folders (Thunderbird)
10/6/2010 WHY metadata for MY resources? 14
Time in groups: 5’
Reporting back: plenary & individually (on paper)
15. Questions to consider
• Is metadata quality linked to context?
• Do metadata quality criteria apply to all cases?
• Can the interface design ensure “high-quality”
metadata?
10/6/2010 WHY metadata for MY resources? 15
16. Thank you
• For the patience
• For your time
• For really participating & contributing
• One last thing to let us know how we did…
– http://whymetadata.jimdo.com
– Find Workshop/Questionnaire
10/6/2010 WHY metadata for MY resources? 16
17. End of session
Post Workshop Exercise
Develop a personalized metadata evaluation framework
Evaluate at least 10 LOs
Provide a 5 page description (per LO) of your findings
Deadline: Friday 6 pm
(there is enough time if you don't go swimming)
10/6/2010 17WHY metadata for MY resources?