Human Factors of XR: Using Human Factors to Design XR Systems
Artec english- 2011
1. ARTEC (Research Group)
(Research Group)
Advanced Research & Technological Expansion
in Computer Graphics
Dr. Pedro Morillo Tena
Instituto de Robótica (IRTIC)
Universitat de València (UVEG)
2. Summary
1. Introduction
2. Presentation of the research group: ARTEC
3. Human interaction metaphors
4. 2D/3D Tracking
5. Video-based interaction (AR)
A. Marker / Markerless approach
6. Sensing of real-word elements
7. Conclusions
3. Research groups at IRTC (UVEG)
•ARTEC- Advanced Research & Technological Expansion in
ARTEC-
Computer Graphics
•AUTISMO- Autism and Learning Difficulties Group
•LISSIT- Intelligent Transportation Systems (ITS)
LISSIT-
•LSYM- Modeling and Simulation Laboratory
•GSIC- Group of Information and Communication Systems
•SITRA- Image Processing and Computer Vision
4. IRTIC and the activities in VR an AR
ARTEC was funded in 1992 and has been oriented to the Research and
Development of 3D Real Time Systems including Virtual/Augmented Reality
technologies and Immersive Visualization Systems. Currently, the group is
composed of roughly 35 full-time researchers in the following research areas:
full-
• Basic Research in 3D Interactive Graphics, Multimodal Interaction, V/A R
• Virtual Architecture and Historic Reconstruction
• Driving Simulation
• High-Quality Terrain Visualization
• AR Systems for training and maintenance
• Entertainment and Learning Systems (Edutainment)
• Civil Simulation for Training and Educational purposes
• VR Systems for Industrial environments
• Custom devices for Immersive Visualization Systems (VISIONARC)
• X-DOF Motion Platforms
• Multiplatform Developments (Windows, OSX, and Linux)
• From Cluster computing support to mobile devices….
6. Virtual Reality
“Virtual Reality” involves the creation of a computer-generated
computer-
world that a person can interact with in such a way that he or she
believes that the virtual world is real
BMW Virtual Reality Center (Munich, Alemania)
7. Augmented Reality
The “Augmented Reality” generates a composite view for the user that is the
combination of the real scene viewed by the user and a virtual scene generated
by the computer that augments the scene with additional information
Project FTB: RA formación BMW (Bertolín)/Vodafone (Bonatel)
8. Basic input mechanisms for VR/AR Systems
• Mechanic Tracking
• Electromagnetic
• Ultrasounds
• Inertial systems
• Gyroscopes
• Localization (GPS ,etc)
• Optic/Infrared systems
• Marking/Markerless computer vision systems
• Sensing real elements (cabins, cockpits, levers, etc.)
11. 3D Tracking using infrareds & accelerometers
Mirror Metaphor: Real-Time motion capture in a CAVE environment
12. 3D Tracking using infrareds & accelerometers
BIOMIMO: Motion analysis for ergonomic purposes using Augmented Reality techniques
13. 3D Tracking using infrareds & accelerometers
BIOMIMO: Motion analysis for ergonomic purposes using Augmented Reality techniques
14. 3D Tracking using infrareds & accelerometers
Virtual Training Systems: PREVISOR, assembly of elements and driving of machinery in
construction site environments
15. 3D Tracking using infrareds & accelerometers
Virtual Training Systems: PREVISOR, assembly of elements and driving of machinery in
construction site environments
16. 3D Tracking using infrareds & accelerometers
Virtual Training Systems: ENSISAM II, collaborative training in processes for maritime rescue
17. 3D Tracking using infrareds & accelerometers
Virtual Training Systems: ENSISAM II, collaborative training in processes for maritime rescue
18. 3D Tracking using infrareds on screens
Virtual Training Systems: processes for a safe manipulation of electrical panelboards
19. 3D Tracking using infrareds on screens
Virtual Training Systems: processes for a safe manipulation of electrical panelboards
20. 3D Tracking using infrareds on screens
Virtual Training Systems: Multitouch surface platform for general purposes
21. Video-based interaction. Using AR marks
BIOMIMO II: Evaluation of virtual prototypes and control systems
Data Input
Critical Hardware
MoCap
Control Model
Simulation of the IDEAL Visualization of the
state REAL state
(Augmented Reality) (Virtual Reality)
22. Video-based interaction. Using AR marks
SUPERVISAR, ANGEL & SICURA-TUN: Training in action protocols using RA technologies
SICURA-
23. Video-based interaction. Using AR marks
FASYS: Absolutely Safe and Healthy Factory. Security protocols using Augmented Reality
Testing the FASYS system (TRW-Pamplona)
24. Video-based interaction. Markerless systems
PictogramROOM:
PictogramROOM: Using AR to enhance the communication skills in people with autism
26. Video-based interaction. Markerless systems
Orange ARFS: PROMOTION OF CULTURAL AND HERITAGE TOURIMS: Augmenting the
Sagrada Familia monument using mobile devices. Monitoring the evolution of the
constructions works for the Sagrada Familia monument
Combined Visualization:
3D Model Real World +
3D Model
Recognition Process
27. Video-based interaction. Markerless systems
Orange ARFS: PROMOTION OF CULTURAL AND HERITAGE
TOURIMS: Augmenting the Sagrada Familia monument using
mobile devices. Monitoring the evolution of the constructions
works for the Sagrada Familia monument
29. Video-based interaction. Markerless systems
Orange IntelligentEye: Urban navigation with contextual help using real-time image recognition
Services offered trhough Intennet
INTELLIGENT EYE
- Search server
- Database
- Classifier
Internet Mobile Client Mobile Client
(WebPages, videos, forms, etc.)
On-line information of the business establishment
Server
31. Interaction by sensing real-world objects
PREVISIM:
PREVISIM: A collaborative simulator for traffic risk prevention
32. Interaction by sensing real-world objects
Simulation systems oriented to increased the skills of crane operators: Stewart, Transtainer,..
33. Interaction by sensing real-world objects
ESTRIBOR: Simulation system oriented to the operation of rescue boats
ESTRIBOR:
34. ARTEC (Research Group)
(Research Group)
Advanced Research & Technological Expansion
in Computer Graphics
Dr. Pedro Morillo Tena
Instituto de Robótica (IRTIC)
Universitat de València (UVEG)