3. System Architecture
Digital Content
Adaptation VV
Provider
(Virtual World,
(serious) game,
Virtual World Data
Representation R
simulator, DVD, …)
Adapta3on RV/VR Virtual World Data Representa3on V
Scope of this interna/onal
standard
Adapta3on RV Adapta3on VR
S S A A
Device Commands
Real Real
Real
World World World
2009/02/06 Chris,an Timmerer, Klagenfurt University, Austria 3
Dev2 Dev3
Dev1
4. Author’s Sensory Sensory
Inten3on to Effect Device
trigger Metadata Capabili3es
<elem‐1…/> <cap‐1…/>
single
<elem‐2…/> <cap‐2…/>
sense
RoSE
<elem‐3…/> <cap‐3…/>
. .
Engine
mul3ple
(inform.)
. .
senses
. .
<elem‐n…/> <cap‐n…/>
Scope of Standardiza/on
SEM elements/types provides tools for expressing sensory effects, i.e., the elements
may be used by content authors to trigger a single or mul,ple human senses. Note
that there is not necessarily a one‐to‐one mapping between senses and elements of
the sensory effect metadata.
SEM elements/types are mapped to commands that control sensory devices based on
their capabili,es. Note that there is not necessarily a one‐to‐one mapping between 4
2009/02/06 Chris,an Timmerer, Klagenfurt University, Austria
SEM elements and sensory device capabili,es.
5. Working Dra Structure
• Sensory Effect Descrip,on Language
– Basic building blocks: Descrip,onMetadata, Declara,on, Effect,
GroupOfEffects, Parameter
– Common aquot;ributes: XSI, ac,vate, dura,on, fade‐in, fade‐out, alt,
priority, intensity, posi,on, adaptType, adaptRange, autoExtrac,on,
– Low‐level datatypes: vacant
• Sensory Effect Vocabulary
– (Color) Light, Temperature, Wind, Vibra,on
– Flash Light, Water Sprayer, Perfumer/Scent, Fog, Window Blind/
Shadow, Sound, Color Correc,on
• Sensory Effect Context Descrip,ons
– User sensory preferences moved to MPEG‐V
– Sensory device capabili,es Control Informa3on
– Sensory device commands
2009/02/06 Chris,an Timmerer, Klagenfurt University, Austria 5
6. MPEG‐V SI References
• N9896, A Summary of the Representa,on of
Sensory Effects (RoSE)
• N10498, Requirements for MPEG‐V Version 3.2
• WD of Sensory Informa,on
• Ad‐hoc Group
N10475
– metaverse@lists.uni‐klu.ac.at
– hquot;p://lists.uni‐klu.ac.at/mailman/lis,nfo/metaverse
2009/02/06 Chris,an Timmerer, Klagenfurt University, Austria 6