The 10thWorkshop on Multimedia Metadata (SeMuDaTe‘09) Yiwei Cao, Ralf Klamma, and Dejan KovachevI Informatik 5 (Information Systems), RWTH Aachen University 2.12.2009 Graz, Austria

1. The 10th Workshop on Multimedia
Metadata (SeMuDaTe‘09)
Multimedia Processing on Multimedia Semantics
SeMuDaTe‘09
and Multimedia Context
Yiwei Cao
Ralf Klamma
Dejan Kovachev
Yiwei Cao, Ralf Klamma, and Dejan Kovachev
Informatik 5 (Information Systems), RWTH Aachen University
2.12.2009
Graz, Austria
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CKKo-1209-1

2. Agenda
 Introduction
– Motivation and problems
SeMuDaTe‘09
– Terminologies
 The multimedia information processing model
Yiwei Cao
Ralf Klamma – Multimedia metadata management
– Commsonomy: Folksonomy on community
Dejan Kovachev
 Conclusions and discussions
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CKKo-1209-2

3. Introduction
 Context awareness is important for mobile multimedia applications
SeMuDaTe‘09
Yiwei Cao
Ralf Klamma
Dejan Kovachev
 Uncertain information
everywhere
 Is semantics “only
grasped” in context?  Use of multimedia
semantics and
context information
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CKKo-1209-3

4. A Framework for Mobile Multimedia
Data Management with Uncertainty
SeMuDaTe‘09
Yiwei Cao
Ralf Klamma
Dejan Kovachev
Lehrstuhl Informatik 5
(Informationssysteme)
(Cao et al. in IJCSSE)
Prof. Dr. M. Jarke
I5-CKKo-1209-4

5. Recall the Scenario for Multimedia
Semantic Context Management
 Context data to enhance multimedia semantics
– GPS data -> Tribunes, Curves, etc. (Places)
SeMuDaTe‘09 – Time data -> Lap, Start, Finish, Box stop, etc. (Events)
– Racing car data –> Ferrari, McLaren-Mercedes, BMW-Sauber Community, etc. (Agents)
 For context-aware mobile community information systems
Yiwei Cao
Ralf Klamma
Dejan Kovachev
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CKKo-1209-5

6. Multimedia Semantics and
Multimedia Context
 Context in computer science: Multimedia Multimedia
situational or environmental semantics context
information [Abowd et al., 1999 ]
Computing
SeMuDaTe‘09
Context awareness Meaning
 context
– For multimedia input
– For multimedia search User
Yiwei Cao
Richness
Ralf Klamma
context
Dejan Kovachev
– For multimedia retrieval
 Information richness Physical
[Daft & Lengel, 1986] Precision
context
 Problem: multimedia
semantics and multimedia Machine Time/
readability location
context are not well combined
for mobile multimedia Community
Lehrstuhl Informatik 5
(Informationssysteme) information applications Context
Prof. Dr. M. Jarke
I5-CKKo-1209-6

7. Multimedia Metadata
 Multimedia metadata in use
– To enable data exchange with enhanced data interoperability
SeMuDaTe‘09 – To label multimedia items
– To describe multimedia collection items
– To record authenticity and access evidence
Yiwei Cao
Ralf Klamma
 MPEG-7
Dejan Kovachev
– Rich multimedia content description +
– Flexible schema +
– Ambiguous semantics of elements -
– Complexity -
– Large overhead for data transfer -
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CKKo-1209-7

8. Metadata Crosswalks
 Media interoperability and community heterogeneity
– Multimedia interoperability enhancement through metadata standards
SeMuDaTe‘09
– Strengthened by interdisciplinary cooperation within professional communities
– Crosswalks of metadata standards: schema mapping
Multimedia technologies: MPEG-7, MPEG-21
Heritage preservations: CIDOC CRM, Dublin Core
Yiwei Cao
Ralf Klamma
Dejan Kovachev
Geography and cartography: OGC GML, KML
 Metadata for multimedia semantics and multimedia context
− Multimedia semantics annotation as metadata
− Multimedia context expression as metadata
− User generated media and tagging
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CKKo-1209-8

9. Commsonomy
 Ontology does not work alone for multimedia semantics
 Community based Folksonomy defined and used within and across
SeMuDaTe‘09 communities of practice
 The triple model shows relationships between
– Users – resources (the tag model)
– Resources – resources (the RDF model)
Yiwei Cao
Ralf Klamma
Dejan Kovachev
 Do communities of practice use different tags for their domains?
– Four aspects: users tag resources in communities
– Collaborative: how users from different communities tag differently
on the same resource?
– Community based tag clouds?
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CKKo-1209-9

10. The Multimedia Information
Processing Model
SPARQL
Multimedia
SeMuDaTe‘09
resources
MPEG-7
Ontology A
(Commsonomy)
Yiwei Cao
Ontology B Context
Dublin Core
Ralf Klamma
OWL
Dejan Kovachev
Precise
RDFS Domain multimedia
TV-Anytime Information query results
RDF
EXIF
Community of
...
Practice (CoP)
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CKKo-1209-10

11. Conclusions and Discussions
 Use of multimedia semantics and multimedia context in combination
 Open questions on multimedia uncertainty
SeMuDaTe‘09 – How precise need multimedia semantics be?
– How precise need multimedia context be?
Multimedia Multimedia
Yiwei Cao
Ralf Klamma
semantics context Precise
Dejan Kovachev Precise computing
agent, context
object Uncertain
User Demo:
Uncertain context
concept Virtual Campfire -
Uncertain
physical Collaborative
Precise context
event Multimedia
Precise Semantization
Uncertain time with Mobile Social
status Software
Lehrstuhl Informatik 5 Uncertain
(Informationssysteme)
Prof. Dr. M. Jarke location
I5-CKKo-1209-11