SlideShare una empresa de Scribd logo
1 de 38
Raskar | MIT Media Lab
Ramesh Raskar
Assoc. Prof
MIT Media Lab
Unspoken Challenges in AR/VR:
Raskar | MIT Media Lab
Multi-ModeMulti-Format
Raskar | MIT Media Lab
Multi-ModeMulti-Format
Raskar | MIT Media Lab
© Andrei State
Augmented Human:
Beyond X-ray vision
Raskar | MIT Media Lab
Augmented Reality (AR)
World Input Process Output World
Sense beyond
human ability Abstract
Present within
human ability
Raskar | MIT Media Lab
Augmented Reality (AR)
World Input Process Output World
Camera,
Location
Sensors
Identify,
Track,
Abstract
Display,
Overlay
Interaction
Resolution,
FoV, FPS,
Optics
Bounds of
Physics + Perception
Raskar | MIT Media Lab
Multi-ModeMulti-Format
Raskar | MIT Media Lab
Multi-ModeMulti-Format
IoT
Perception
Ergo,
Hygiene
Ethics
Gestural Language
Raskar | MIT Media Lab
Challenges in AR
World Input Process Output World
Camera,
Location
Sensors
Identify,
Track,
Abstract
Display,
3D Overlay
Interaction
MultiModal MultiFormat
IoT
Training
DataSets
Perception
Ergo, Hygiene
Ethics
Gestural Language
EyeGlasses
Laziness
Authoring
IoT
Raskar | MIT Media Lab
World Input Process Output World
Camera,
Location
Sensors
Identify,
Track,
Abstract
Display,
3D Overlay
Interaction
MultiFormat
IoT
Training
DataSets
Ergo, Hygiene
Ethics
Gestural Language
EyeGlasses
Laziness
Authoring
IoT
Challenges in AR
MultiModal
Perception
Raskar | MIT Media Lab
South Park - Jurassic Park
Raskar | MIT Media Lab
Photoreal Functional Realism
NonPhotoRealistic Camera, Siggraph 2004
http://Raskar.info/NprCamera
Raskar | MIT Media Lab
Realism
Functional
Photoreal
Physical
Non-visual
Ferwerda 2003
Raskar | MIT Media Lab
Realism
Functional
Photoreal
Physical
Non-visual
Archaic neurosc +
perception
Few open datasets
Raskar | MIT Media Lab
Head-mounted Display Projectors
© Andrei State
Multi-Mode Augmented Reality
Raskar | MIT Media Lab
VienViewer
Near-IR camera locates subcutaneous veins
Project ‘veins’ onto skin.
Coaxial IR camera
+ Projector
Raskar | MIT Media Lab
hand-held
display
spatial
see-through
display
head-
mounted
display
retinal
display
Head-attached Body-attached spatial
projector
Spatial Augmented Reality
1998
Multi-Mode AR
Real
Object
Raskar | MIT Media Lab
Virtual Reflectance Virtual Illumination
InteractionVirtual Motion
ShaderLamps
1997 - 2000
Raskar | MIT Media Lab
Virtual Reflectance Virtual Illumination
Lamps for Colorfully Shading
the World
1997 - 2000
Raskar | MIT Media Lab
Shader Lamps on a Saturn
Raskar | MIT Media Lab
Guerilla Marketing
FHM Magazine
Raskar | MIT Media Lab
Augmented Reality (AR)
World Input Process Output World
Camera,
Location
Sensors
Identify,
Track,
Abstract
Display,
3D Overlay
Interaction
MultiModal MultiFormat
IoT
Training
DataSets
Perception
Ergo, Hygiene
Ethics
Gestural Language
EyeGlasses
Laziness
Authoring
IoT
Raskar | MIT Media Lab
“People are lazy”
Rob Lindeman, Benjamin Lok, Bill Baxter
Cognitive or Physical Exertion
Fatigue = Reduced Usage
Raskar | MIT Media Lab
Gesture Lexicon
Phone AR: No gesture
No Controllers
Natural Objects
Open Data Sets
Raskar | MIT Media Lab
Augmented Reality (AR)
World Input Process Output World
Camera,
Location
Sensors
Identify,
Track,
Abstract
Display,
3D Overlay
Interaction
MultiModal MultiFormat
IoT
Training
DataSets
Perception
Ergo, Hygiene
Ethics
Gestural Language
EyeGlasses
Laziness
Authoring
IoT
Phoropter
Pamplona, Mohan, Oliveira, Raskar ‘NETRA’
Eyeglasses Prescription on Headset
Raskar | MIT Media Lab
Mk Haley
Disney Imagineering
“My peers working with VR get frustrated with
women "ruining" the gear
because of mascara, foundation, or moisturizer on their face. Or
women being "difficult"
if they have ponytails or other hairstyles..
Raskar | MIT Media Lab
‘Glassholes’ Ethics
Info Asymmetry
Visual filter bubbles
‘Turn off sensors’
Eye tracking
Raskar | MIT Media Lab
Multi-ModeMulti-Format
IoT
Perception
Ergo,
Hygiene
Ethics
Gestural Language
Raskar | MIT Media Lab
Poor Man’s Palace
Raskar | MIT Media Lab
Poor Man’s Palace
Augment the world, projectors and proxy geometry, controlling light every millimeter at every millisecond.
Fake World
Raskar | MIT Media Lab
Acknowledgements
• MERL
• Amit Agrawal, Ashok Veeraraghavan,
Ankit Mohan, Jack Tumblin, Jeroen van
Baar, Paul Beardsley, Remo Ziegler,
Thomas Willwacher, Srinivas Rao, Cliff
Forlines, Paul Dietz, Joe Marks, Darren
Leigh
• Office of the Future grp UNC Chapel Hill
• Greg Welch, Kok-lim Low, Deepak
B’padhyay, Aditi Majumder,
Michael Brown, Ruigang Yang
• Henry Fuchs, Herman Towles
• Wei-chao Chen
• Camera Culture Group, MIT
Media Lab
• John Werner
• Marco Jacobs
• Mark Billinghurst, U S Australia
• Sameer Rawal, DISQ, India
• Tim Smith, Sevaleader
• Alvaro Cassinelli, U of Tokyo
• Benjamin Lok, U of Florida
• Bill Baxter
• Rob Lindenman,
• Brett Jones
• Mk Haley, Disney
Raskar | MIT Media Lab
Challenges in AR
World Input Process Output World
Camera,
Location
Sensors
Identify,
Track,
Abstract
Display,
3D Overlay
Interaction
MultiModal MultiFormat
IoT
Training
DataSets
Perception Ergo, Hygiene
Ethics
Gestural Language
EyeGlasses
Laziness
Authoring
IoT
Free Book: raskar.info/book
Slideshare.net/cameraculture

Más contenido relacionado

Similar a Unspoken Challenges in AR and XR

"Making the Invisible Visible: Within Our Bodies, the World Around Us and Bey...
"Making the Invisible Visible: Within Our Bodies, the World Around Us and Bey..."Making the Invisible Visible: Within Our Bodies, the World Around Us and Bey...
"Making the Invisible Visible: Within Our Bodies, the World Around Us and Bey...Edge AI and Vision Alliance
 
Raskar Emtech2010 Mar Final
Raskar Emtech2010 Mar FinalRaskar Emtech2010 Mar Final
Raskar Emtech2010 Mar FinalEmTech
 
The Singularity is Here - SXSWi 2011
The Singularity is Here - SXSWi 2011The Singularity is Here - SXSWi 2011
The Singularity is Here - SXSWi 2011Mindgrub Technologies
 
Николаос Мавридис. От Интерактивных роботов к Человеку-машинному облаку
Николаос Мавридис. От Интерактивных роботов к Человеку-машинному облакуНиколаос Мавридис. От Интерактивных роботов к Человеку-машинному облаку
Николаос Мавридис. От Интерактивных роботов к Человеку-машинному облакуSkolkovo Robotics Center
 
Before your immortality!
Before your immortality!Before your immortality!
Before your immortality!UBMCanon
 
The Internet of Things, Ambient Intelligence, and the Move Towards Intelligen...
The Internet of Things, Ambient Intelligence, and the Move Towards Intelligen...The Internet of Things, Ambient Intelligence, and the Move Towards Intelligen...
The Internet of Things, Ambient Intelligence, and the Move Towards Intelligen...George Vanecek
 
Wearable ggd brescia2
Wearable ggd brescia2Wearable ggd brescia2
Wearable ggd brescia2Zoe Romano
 
703372-Metaverse PPTX-4-3.pptx
703372-Metaverse PPTX-4-3.pptx703372-Metaverse PPTX-4-3.pptx
703372-Metaverse PPTX-4-3.pptxAvinash603728
 
SlideEgg_703372-Metaverse PPTX.pptx
SlideEgg_703372-Metaverse PPTX.pptxSlideEgg_703372-Metaverse PPTX.pptx
SlideEgg_703372-Metaverse PPTX.pptxvalluvanskalai
 
Branches Of Robotics
Branches Of RoboticsBranches Of Robotics
Branches Of Roboticsparthmullick
 
Sixth Sense Technology
Sixth Sense TechnologySixth Sense Technology
Sixth Sense Technologyijtsrd
 
IoT 3.0 : Connected Living in an Everything-Digital World
IoT 3.0 : Connected Living in an Everything-Digital WorldIoT 3.0 : Connected Living in an Everything-Digital World
IoT 3.0 : Connected Living in an Everything-Digital WorldFahim Kawsar
 
Live Social Semantics @ ESWC2010
Live Social Semantics @ ESWC2010Live Social Semantics @ ESWC2010
Live Social Semantics @ ESWC2010Martin Szomszor
 

Similar a Unspoken Challenges in AR and XR (20)

"Making the Invisible Visible: Within Our Bodies, the World Around Us and Bey...
"Making the Invisible Visible: Within Our Bodies, the World Around Us and Bey..."Making the Invisible Visible: Within Our Bodies, the World Around Us and Bey...
"Making the Invisible Visible: Within Our Bodies, the World Around Us and Bey...
 
Raskar Emtech2010 Mar Final
Raskar Emtech2010 Mar FinalRaskar Emtech2010 Mar Final
Raskar Emtech2010 Mar Final
 
Raskar Emtech2010 Mar Final
Raskar Emtech2010 Mar FinalRaskar Emtech2010 Mar Final
Raskar Emtech2010 Mar Final
 
The Singularity is Here - SXSWi 2011
The Singularity is Here - SXSWi 2011The Singularity is Here - SXSWi 2011
The Singularity is Here - SXSWi 2011
 
Николаос Мавридис. От Интерактивных роботов к Человеку-машинному облаку
Николаос Мавридис. От Интерактивных роботов к Человеку-машинному облакуНиколаос Мавридис. От Интерактивных роботов к Человеку-машинному облаку
Николаос Мавридис. От Интерактивных роботов к Человеку-машинному облаку
 
MixedReality.pptx
MixedReality.pptxMixedReality.pptx
MixedReality.pptx
 
Before your immortality!
Before your immortality!Before your immortality!
Before your immortality!
 
Metaverse.pdf
Metaverse.pdfMetaverse.pdf
Metaverse.pdf
 
The Internet of Things, Ambient Intelligence, and the Move Towards Intelligen...
The Internet of Things, Ambient Intelligence, and the Move Towards Intelligen...The Internet of Things, Ambient Intelligence, and the Move Towards Intelligen...
The Internet of Things, Ambient Intelligence, and the Move Towards Intelligen...
 
Augmented reality
Augmented realityAugmented reality
Augmented reality
 
IoT
IoTIoT
IoT
 
Virtual Reality.
Virtual Reality.Virtual Reality.
Virtual Reality.
 
Wearable ggd brescia2
Wearable ggd brescia2Wearable ggd brescia2
Wearable ggd brescia2
 
703372-Metaverse PPTX-4-3.pptx
703372-Metaverse PPTX-4-3.pptx703372-Metaverse PPTX-4-3.pptx
703372-Metaverse PPTX-4-3.pptx
 
SlideEgg_703372-Metaverse PPTX.pptx
SlideEgg_703372-Metaverse PPTX.pptxSlideEgg_703372-Metaverse PPTX.pptx
SlideEgg_703372-Metaverse PPTX.pptx
 
Metaverse .pdf
Metaverse .pdfMetaverse .pdf
Metaverse .pdf
 
Branches Of Robotics
Branches Of RoboticsBranches Of Robotics
Branches Of Robotics
 
Sixth Sense Technology
Sixth Sense TechnologySixth Sense Technology
Sixth Sense Technology
 
IoT 3.0 : Connected Living in an Everything-Digital World
IoT 3.0 : Connected Living in an Everything-Digital WorldIoT 3.0 : Connected Living in an Everything-Digital World
IoT 3.0 : Connected Living in an Everything-Digital World
 
Live Social Semantics @ ESWC2010
Live Social Semantics @ ESWC2010Live Social Semantics @ ESWC2010
Live Social Semantics @ ESWC2010
 

Más de Camera Culture Group, MIT Media Lab

God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar Camera Culture Group, MIT Media Lab
 
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...Camera Culture Group, MIT Media Lab
 
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...Camera Culture Group, MIT Media Lab
 

Más de Camera Culture Group, MIT Media Lab (20)

Raskar Sig2017 Siggraph Achievement Award Talk
Raskar Sig2017 Siggraph Achievement Award TalkRaskar Sig2017 Siggraph Achievement Award Talk
Raskar Sig2017 Siggraph Achievement Award Talk
 
Lost Decade of Computational Photography
Lost Decade of Computational PhotographyLost Decade of Computational Photography
Lost Decade of Computational Photography
 
Covid Safe Paths
Covid Safe PathsCovid Safe Paths
Covid Safe Paths
 
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
 
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
 
Raskar PhD and MS Thesis Guidance
Raskar PhD and MS Thesis GuidanceRaskar PhD and MS Thesis Guidance
Raskar PhD and MS Thesis Guidance
 
Geo-spatial Research: Transition from Analysis to Synthesis
Geo-spatial Research: Transition from Analysis to SynthesisGeo-spatial Research: Transition from Analysis to Synthesis
Geo-spatial Research: Transition from Analysis to Synthesis
 
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
 
Multiview Imaging HW Overview
Multiview Imaging HW OverviewMultiview Imaging HW Overview
Multiview Imaging HW Overview
 
Time of Flight Cameras - Refael Whyte
Time of Flight Cameras - Refael WhyteTime of Flight Cameras - Refael Whyte
Time of Flight Cameras - Refael Whyte
 
Leap Motion Development (Rohan Puri)
Leap Motion Development (Rohan Puri)Leap Motion Development (Rohan Puri)
Leap Motion Development (Rohan Puri)
 
Compressed Sensing - Achuta Kadambi
Compressed Sensing - Achuta KadambiCompressed Sensing - Achuta Kadambi
Compressed Sensing - Achuta Kadambi
 
Coded Photography - Ramesh Raskar
Coded Photography - Ramesh RaskarCoded Photography - Ramesh Raskar
Coded Photography - Ramesh Raskar
 
Stereo and 3D Displays - Matt Hirsch
Stereo and 3D Displays - Matt HirschStereo and 3D Displays - Matt Hirsch
Stereo and 3D Displays - Matt Hirsch
 
Introduction to Camera Challenges - Ramesh Raskar
Introduction to Camera Challenges - Ramesh RaskarIntroduction to Camera Challenges - Ramesh Raskar
Introduction to Camera Challenges - Ramesh Raskar
 
Developing "True HDR" for the iPhone
Developing "True HDR" for the iPhoneDeveloping "True HDR" for the iPhone
Developing "True HDR" for the iPhone
 
Computer Vision Introduction
Computer Vision IntroductionComputer Vision Introduction
Computer Vision Introduction
 
Introduction to Photography
Introduction to PhotographyIntroduction to Photography
Introduction to Photography
 
Light Field Photography Introduction
Light Field Photography IntroductionLight Field Photography Introduction
Light Field Photography Introduction
 
Introduction to Light Fields
Introduction to Light FieldsIntroduction to Light Fields
Introduction to Light Fields
 

Último

S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptxS1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptxSCMS School of Architecture
 
Moment Distribution Method For Btech Civil
Moment Distribution Method For Btech CivilMoment Distribution Method For Btech Civil
Moment Distribution Method For Btech CivilVinayVitekari
 
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKARHAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKARKOUSTAV SARKAR
 
Wadi Rum luxhotel lodge Analysis case study.pptx
Wadi Rum luxhotel lodge Analysis case study.pptxWadi Rum luxhotel lodge Analysis case study.pptx
Wadi Rum luxhotel lodge Analysis case study.pptxNadaHaitham1
 
data_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdfdata_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdfJiananWang21
 
Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptx
Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptxOrlando’s Arnold Palmer Hospital Layout Strategy-1.pptx
Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptxMuhammadAsimMuhammad6
 
A Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna MunicipalityA Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna MunicipalityMorshed Ahmed Rahath
 
DeepFakes presentation : brief idea of DeepFakes
DeepFakes presentation : brief idea of DeepFakesDeepFakes presentation : brief idea of DeepFakes
DeepFakes presentation : brief idea of DeepFakesMayuraD1
 
Thermal Engineering -unit - III & IV.ppt
Thermal Engineering -unit - III & IV.pptThermal Engineering -unit - III & IV.ppt
Thermal Engineering -unit - III & IV.pptDineshKumar4165
 
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptxHOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptxSCMS School of Architecture
 
Thermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - VThermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - VDineshKumar4165
 
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...drmkjayanthikannan
 
COST-EFFETIVE and Energy Efficient BUILDINGS ptx
COST-EFFETIVE  and Energy Efficient BUILDINGS ptxCOST-EFFETIVE  and Energy Efficient BUILDINGS ptx
COST-EFFETIVE and Energy Efficient BUILDINGS ptxJIT KUMAR GUPTA
 
Kuwait City MTP kit ((+919101817206)) Buy Abortion Pills Kuwait
Kuwait City MTP kit ((+919101817206)) Buy Abortion Pills KuwaitKuwait City MTP kit ((+919101817206)) Buy Abortion Pills Kuwait
Kuwait City MTP kit ((+919101817206)) Buy Abortion Pills Kuwaitjaanualu31
 
"Lesotho Leaps Forward: A Chronicle of Transformative Developments"
"Lesotho Leaps Forward: A Chronicle of Transformative Developments""Lesotho Leaps Forward: A Chronicle of Transformative Developments"
"Lesotho Leaps Forward: A Chronicle of Transformative Developments"mphochane1998
 
Computer Lecture 01.pptxIntroduction to Computers
Computer Lecture 01.pptxIntroduction to ComputersComputer Lecture 01.pptxIntroduction to Computers
Computer Lecture 01.pptxIntroduction to ComputersMairaAshraf6
 
Thermal Engineering Unit - I & II . ppt
Thermal Engineering  Unit - I & II . pptThermal Engineering  Unit - I & II . ppt
Thermal Engineering Unit - I & II . pptDineshKumar4165
 

Último (20)

S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptxS1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
 
Moment Distribution Method For Btech Civil
Moment Distribution Method For Btech CivilMoment Distribution Method For Btech Civil
Moment Distribution Method For Btech Civil
 
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKARHAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
 
Wadi Rum luxhotel lodge Analysis case study.pptx
Wadi Rum luxhotel lodge Analysis case study.pptxWadi Rum luxhotel lodge Analysis case study.pptx
Wadi Rum luxhotel lodge Analysis case study.pptx
 
data_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdfdata_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdf
 
Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptx
Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptxOrlando’s Arnold Palmer Hospital Layout Strategy-1.pptx
Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptx
 
A Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna MunicipalityA Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna Municipality
 
DeepFakes presentation : brief idea of DeepFakes
DeepFakes presentation : brief idea of DeepFakesDeepFakes presentation : brief idea of DeepFakes
DeepFakes presentation : brief idea of DeepFakes
 
Thermal Engineering -unit - III & IV.ppt
Thermal Engineering -unit - III & IV.pptThermal Engineering -unit - III & IV.ppt
Thermal Engineering -unit - III & IV.ppt
 
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptxHOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
 
Thermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - VThermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - V
 
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
 
COST-EFFETIVE and Energy Efficient BUILDINGS ptx
COST-EFFETIVE  and Energy Efficient BUILDINGS ptxCOST-EFFETIVE  and Energy Efficient BUILDINGS ptx
COST-EFFETIVE and Energy Efficient BUILDINGS ptx
 
Kuwait City MTP kit ((+919101817206)) Buy Abortion Pills Kuwait
Kuwait City MTP kit ((+919101817206)) Buy Abortion Pills KuwaitKuwait City MTP kit ((+919101817206)) Buy Abortion Pills Kuwait
Kuwait City MTP kit ((+919101817206)) Buy Abortion Pills Kuwait
 
"Lesotho Leaps Forward: A Chronicle of Transformative Developments"
"Lesotho Leaps Forward: A Chronicle of Transformative Developments""Lesotho Leaps Forward: A Chronicle of Transformative Developments"
"Lesotho Leaps Forward: A Chronicle of Transformative Developments"
 
Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7
Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7
Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7
 
Computer Lecture 01.pptxIntroduction to Computers
Computer Lecture 01.pptxIntroduction to ComputersComputer Lecture 01.pptxIntroduction to Computers
Computer Lecture 01.pptxIntroduction to Computers
 
Integrated Test Rig For HTFE-25 - Neometrix
Integrated Test Rig For HTFE-25 - NeometrixIntegrated Test Rig For HTFE-25 - Neometrix
Integrated Test Rig For HTFE-25 - Neometrix
 
Thermal Engineering Unit - I & II . ppt
Thermal Engineering  Unit - I & II . pptThermal Engineering  Unit - I & II . ppt
Thermal Engineering Unit - I & II . ppt
 
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak HamilCara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
 

Unspoken Challenges in AR and XR

  • 1. Raskar | MIT Media Lab Ramesh Raskar Assoc. Prof MIT Media Lab Unspoken Challenges in AR/VR:
  • 2. Raskar | MIT Media Lab Multi-ModeMulti-Format
  • 3. Raskar | MIT Media Lab Multi-ModeMulti-Format
  • 4. Raskar | MIT Media Lab © Andrei State Augmented Human: Beyond X-ray vision
  • 5. Raskar | MIT Media Lab Augmented Reality (AR) World Input Process Output World Sense beyond human ability Abstract Present within human ability
  • 6. Raskar | MIT Media Lab Augmented Reality (AR) World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, Overlay Interaction Resolution, FoV, FPS, Optics Bounds of Physics + Perception
  • 7. Raskar | MIT Media Lab Multi-ModeMulti-Format
  • 8. Raskar | MIT Media Lab Multi-ModeMulti-Format IoT Perception Ergo, Hygiene Ethics Gestural Language
  • 9. Raskar | MIT Media Lab Challenges in AR World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, 3D Overlay Interaction MultiModal MultiFormat IoT Training DataSets Perception Ergo, Hygiene Ethics Gestural Language EyeGlasses Laziness Authoring IoT
  • 10. Raskar | MIT Media Lab World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, 3D Overlay Interaction MultiFormat IoT Training DataSets Ergo, Hygiene Ethics Gestural Language EyeGlasses Laziness Authoring IoT Challenges in AR MultiModal Perception
  • 11. Raskar | MIT Media Lab South Park - Jurassic Park
  • 12. Raskar | MIT Media Lab Photoreal Functional Realism NonPhotoRealistic Camera, Siggraph 2004 http://Raskar.info/NprCamera
  • 13. Raskar | MIT Media Lab Realism Functional Photoreal Physical Non-visual Ferwerda 2003
  • 14. Raskar | MIT Media Lab Realism Functional Photoreal Physical Non-visual Archaic neurosc + perception Few open datasets
  • 15. Raskar | MIT Media Lab Head-mounted Display Projectors © Andrei State Multi-Mode Augmented Reality
  • 16. Raskar | MIT Media Lab VienViewer Near-IR camera locates subcutaneous veins Project ‘veins’ onto skin. Coaxial IR camera + Projector
  • 17. Raskar | MIT Media Lab hand-held display spatial see-through display head- mounted display retinal display Head-attached Body-attached spatial projector Spatial Augmented Reality 1998 Multi-Mode AR Real Object
  • 18. Raskar | MIT Media Lab Virtual Reflectance Virtual Illumination InteractionVirtual Motion ShaderLamps 1997 - 2000
  • 19. Raskar | MIT Media Lab Virtual Reflectance Virtual Illumination Lamps for Colorfully Shading the World 1997 - 2000
  • 20. Raskar | MIT Media Lab Shader Lamps on a Saturn
  • 21. Raskar | MIT Media Lab Guerilla Marketing FHM Magazine
  • 22. Raskar | MIT Media Lab Augmented Reality (AR) World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, 3D Overlay Interaction MultiModal MultiFormat IoT Training DataSets Perception Ergo, Hygiene Ethics Gestural Language EyeGlasses Laziness Authoring IoT
  • 23.
  • 24.
  • 25.
  • 26. Raskar | MIT Media Lab “People are lazy” Rob Lindeman, Benjamin Lok, Bill Baxter Cognitive or Physical Exertion Fatigue = Reduced Usage
  • 27. Raskar | MIT Media Lab Gesture Lexicon Phone AR: No gesture No Controllers Natural Objects Open Data Sets
  • 28. Raskar | MIT Media Lab Augmented Reality (AR) World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, 3D Overlay Interaction MultiModal MultiFormat IoT Training DataSets Perception Ergo, Hygiene Ethics Gestural Language EyeGlasses Laziness Authoring IoT
  • 30. Pamplona, Mohan, Oliveira, Raskar ‘NETRA’ Eyeglasses Prescription on Headset
  • 31. Raskar | MIT Media Lab Mk Haley Disney Imagineering “My peers working with VR get frustrated with women "ruining" the gear because of mascara, foundation, or moisturizer on their face. Or women being "difficult" if they have ponytails or other hairstyles..
  • 32. Raskar | MIT Media Lab ‘Glassholes’ Ethics Info Asymmetry Visual filter bubbles ‘Turn off sensors’ Eye tracking
  • 33. Raskar | MIT Media Lab Multi-ModeMulti-Format IoT Perception Ergo, Hygiene Ethics Gestural Language
  • 34. Raskar | MIT Media Lab Poor Man’s Palace
  • 35. Raskar | MIT Media Lab Poor Man’s Palace Augment the world, projectors and proxy geometry, controlling light every millimeter at every millisecond.
  • 37. Raskar | MIT Media Lab Acknowledgements • MERL • Amit Agrawal, Ashok Veeraraghavan, Ankit Mohan, Jack Tumblin, Jeroen van Baar, Paul Beardsley, Remo Ziegler, Thomas Willwacher, Srinivas Rao, Cliff Forlines, Paul Dietz, Joe Marks, Darren Leigh • Office of the Future grp UNC Chapel Hill • Greg Welch, Kok-lim Low, Deepak B’padhyay, Aditi Majumder, Michael Brown, Ruigang Yang • Henry Fuchs, Herman Towles • Wei-chao Chen • Camera Culture Group, MIT Media Lab • John Werner • Marco Jacobs • Mark Billinghurst, U S Australia • Sameer Rawal, DISQ, India • Tim Smith, Sevaleader • Alvaro Cassinelli, U of Tokyo • Benjamin Lok, U of Florida • Bill Baxter • Rob Lindenman, • Brett Jones • Mk Haley, Disney
  • 38. Raskar | MIT Media Lab Challenges in AR World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, 3D Overlay Interaction MultiModal MultiFormat IoT Training DataSets Perception Ergo, Hygiene Ethics Gestural Language EyeGlasses Laziness Authoring IoT Free Book: raskar.info/book Slideshare.net/cameraculture