Se ha denunciado esta presentación.
Utilizamos tu perfil de LinkedIn y tus datos de actividad para personalizar los anuncios y mostrarte publicidad más relevante. Puedes cambiar tus preferencias de publicidad en cualquier momento.

Unspoken Challenges in AR and XR

271 visualizaciones

Publicado el

Ramesh Raskar at AWE 2018.
Lets go beyond our obession with HMDs and consider multi modal multiformat augmentation.

Publicado en: Ingeniería
  • Sé el primero en comentar

  • Sé el primero en recomendar esto

Unspoken Challenges in AR and XR

  1. 1. Raskar | MIT Media Lab Ramesh Raskar Assoc. Prof MIT Media Lab Unspoken Challenges in AR/VR:
  2. 2. Raskar | MIT Media Lab Multi-ModeMulti-Format
  3. 3. Raskar | MIT Media Lab Multi-ModeMulti-Format
  4. 4. Raskar | MIT Media Lab © Andrei State Augmented Human: Beyond X-ray vision
  5. 5. Raskar | MIT Media Lab Augmented Reality (AR) World Input Process Output World Sense beyond human ability Abstract Present within human ability
  6. 6. Raskar | MIT Media Lab Augmented Reality (AR) World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, Overlay Interaction Resolution, FoV, FPS, Optics Bounds of Physics + Perception
  7. 7. Raskar | MIT Media Lab Multi-ModeMulti-Format
  8. 8. Raskar | MIT Media Lab Multi-ModeMulti-Format IoT Perception Ergo, Hygiene Ethics Gestural Language
  9. 9. Raskar | MIT Media Lab Challenges in AR World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, 3D Overlay Interaction MultiModal MultiFormat IoT Training DataSets Perception Ergo, Hygiene Ethics Gestural Language EyeGlasses Laziness Authoring IoT
  10. 10. Raskar | MIT Media Lab World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, 3D Overlay Interaction MultiFormat IoT Training DataSets Ergo, Hygiene Ethics Gestural Language EyeGlasses Laziness Authoring IoT Challenges in AR MultiModal Perception
  11. 11. Raskar | MIT Media Lab South Park - Jurassic Park
  12. 12. Raskar | MIT Media Lab Photoreal Functional Realism NonPhotoRealistic Camera, Siggraph 2004 http://Raskar.info/NprCamera
  13. 13. Raskar | MIT Media Lab Realism Functional Photoreal Physical Non-visual Ferwerda 2003
  14. 14. Raskar | MIT Media Lab Realism Functional Photoreal Physical Non-visual Archaic neurosc + perception Few open datasets
  15. 15. Raskar | MIT Media Lab Head-mounted Display Projectors © Andrei State Multi-Mode Augmented Reality
  16. 16. Raskar | MIT Media Lab VienViewer Near-IR camera locates subcutaneous veins Project ‘veins’ onto skin. Coaxial IR camera + Projector
  17. 17. Raskar | MIT Media Lab hand-held display spatial see-through display head- mounted display retinal display Head-attached Body-attached spatial projector Spatial Augmented Reality 1998 Multi-Mode AR Real Object
  18. 18. Raskar | MIT Media Lab Virtual Reflectance Virtual Illumination InteractionVirtual Motion ShaderLamps 1997 - 2000
  19. 19. Raskar | MIT Media Lab Virtual Reflectance Virtual Illumination Lamps for Colorfully Shading the World 1997 - 2000
  20. 20. Raskar | MIT Media Lab Shader Lamps on a Saturn
  21. 21. Raskar | MIT Media Lab Guerilla Marketing FHM Magazine
  22. 22. Raskar | MIT Media Lab Augmented Reality (AR) World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, 3D Overlay Interaction MultiModal MultiFormat IoT Training DataSets Perception Ergo, Hygiene Ethics Gestural Language EyeGlasses Laziness Authoring IoT
  23. 23. Raskar | MIT Media Lab “People are lazy” Rob Lindeman, Benjamin Lok, Bill Baxter Cognitive or Physical Exertion Fatigue = Reduced Usage
  24. 24. Raskar | MIT Media Lab Gesture Lexicon Phone AR: No gesture No Controllers Natural Objects Open Data Sets
  25. 25. Raskar | MIT Media Lab Augmented Reality (AR) World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, 3D Overlay Interaction MultiModal MultiFormat IoT Training DataSets Perception Ergo, Hygiene Ethics Gestural Language EyeGlasses Laziness Authoring IoT
  26. 26. Phoropter
  27. 27. Pamplona, Mohan, Oliveira, Raskar ‘NETRA’ Eyeglasses Prescription on Headset
  28. 28. Raskar | MIT Media Lab Mk Haley Disney Imagineering “My peers working with VR get frustrated with women "ruining" the gear because of mascara, foundation, or moisturizer on their face. Or women being "difficult" if they have ponytails or other hairstyles..
  29. 29. Raskar | MIT Media Lab ‘Glassholes’ Ethics Info Asymmetry Visual filter bubbles ‘Turn off sensors’ Eye tracking
  30. 30. Raskar | MIT Media Lab Multi-ModeMulti-Format IoT Perception Ergo, Hygiene Ethics Gestural Language
  31. 31. Raskar | MIT Media Lab Poor Man’s Palace
  32. 32. Raskar | MIT Media Lab Poor Man’s Palace Augment the world, projectors and proxy geometry, controlling light every millimeter at every millisecond.
  33. 33. Fake World
  34. 34. Raskar | MIT Media Lab Acknowledgements • MERL • Amit Agrawal, Ashok Veeraraghavan, Ankit Mohan, Jack Tumblin, Jeroen van Baar, Paul Beardsley, Remo Ziegler, Thomas Willwacher, Srinivas Rao, Cliff Forlines, Paul Dietz, Joe Marks, Darren Leigh • Office of the Future grp UNC Chapel Hill • Greg Welch, Kok-lim Low, Deepak B’padhyay, Aditi Majumder, Michael Brown, Ruigang Yang • Henry Fuchs, Herman Towles • Wei-chao Chen • Camera Culture Group, MIT Media Lab • John Werner • Marco Jacobs • Mark Billinghurst, U S Australia • Sameer Rawal, DISQ, India • Tim Smith, Sevaleader • Alvaro Cassinelli, U of Tokyo • Benjamin Lok, U of Florida • Bill Baxter • Rob Lindenman, • Brett Jones • Mk Haley, Disney
  35. 35. Raskar | MIT Media Lab Challenges in AR World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, 3D Overlay Interaction MultiModal MultiFormat IoT Training DataSets Perception Ergo, Hygiene Ethics Gestural Language EyeGlasses Laziness Authoring IoT Free Book: raskar.info/book Slideshare.net/cameraculture

×