8. Raskar | MIT Media Lab
Multi-ModeMulti-Format
IoT
Perception
Ergo,
Hygiene
Ethics
Gestural Language
9. Raskar | MIT Media Lab
Challenges in AR
World Input Process Output World
Camera,
Location
Sensors
Identify,
Track,
Abstract
Display,
3D Overlay
Interaction
MultiModal MultiFormat
IoT
Training
DataSets
Perception
Ergo, Hygiene
Ethics
Gestural Language
EyeGlasses
Laziness
Authoring
IoT
10. Raskar | MIT Media Lab
World Input Process Output World
Camera,
Location
Sensors
Identify,
Track,
Abstract
Display,
3D Overlay
Interaction
MultiFormat
IoT
Training
DataSets
Ergo, Hygiene
Ethics
Gestural Language
EyeGlasses
Laziness
Authoring
IoT
Challenges in AR
MultiModal
Perception
11. Raskar | MIT Media Lab
South Park - Jurassic Park
12. Raskar | MIT Media Lab
Photoreal Functional Realism
NonPhotoRealistic Camera, Siggraph 2004
http://Raskar.info/NprCamera
13. Raskar | MIT Media Lab
Realism
Functional
Photoreal
Physical
Non-visual
Ferwerda 2003
14. Raskar | MIT Media Lab
Realism
Functional
Photoreal
Physical
Non-visual
Archaic neurosc +
perception
Few open datasets
21. Raskar | MIT Media Lab
Guerilla Marketing
FHM Magazine
22. Raskar | MIT Media Lab
Augmented Reality (AR)
World Input Process Output World
Camera,
Location
Sensors
Identify,
Track,
Abstract
Display,
3D Overlay
Interaction
MultiModal MultiFormat
IoT
Training
DataSets
Perception
Ergo, Hygiene
Ethics
Gestural Language
EyeGlasses
Laziness
Authoring
IoT
23.
24.
25.
26. Raskar | MIT Media Lab
“People are lazy”
Rob Lindeman, Benjamin Lok, Bill Baxter
Cognitive or Physical Exertion
Fatigue = Reduced Usage
27. Raskar | MIT Media Lab
Gesture Lexicon
Phone AR: No gesture
No Controllers
Natural Objects
Open Data Sets
28. Raskar | MIT Media Lab
Augmented Reality (AR)
World Input Process Output World
Camera,
Location
Sensors
Identify,
Track,
Abstract
Display,
3D Overlay
Interaction
MultiModal MultiFormat
IoT
Training
DataSets
Perception
Ergo, Hygiene
Ethics
Gestural Language
EyeGlasses
Laziness
Authoring
IoT
31. Raskar | MIT Media Lab
Mk Haley
Disney Imagineering
“My peers working with VR get frustrated with
women "ruining" the gear
because of mascara, foundation, or moisturizer on their face. Or
women being "difficult"
if they have ponytails or other hairstyles..
32. Raskar | MIT Media Lab
‘Glassholes’ Ethics
Info Asymmetry
Visual filter bubbles
‘Turn off sensors’
Eye tracking
33. Raskar | MIT Media Lab
Multi-ModeMulti-Format
IoT
Perception
Ergo,
Hygiene
Ethics
Gestural Language
35. Raskar | MIT Media Lab
Poor Man’s Palace
Augment the world, projectors and proxy geometry, controlling light every millimeter at every millisecond.
37. Raskar | MIT Media Lab
Acknowledgements
• MERL
• Amit Agrawal, Ashok Veeraraghavan,
Ankit Mohan, Jack Tumblin, Jeroen van
Baar, Paul Beardsley, Remo Ziegler,
Thomas Willwacher, Srinivas Rao, Cliff
Forlines, Paul Dietz, Joe Marks, Darren
Leigh
• Office of the Future grp UNC Chapel Hill
• Greg Welch, Kok-lim Low, Deepak
B’padhyay, Aditi Majumder,
Michael Brown, Ruigang Yang
• Henry Fuchs, Herman Towles
• Wei-chao Chen
• Camera Culture Group, MIT
Media Lab
• John Werner
• Marco Jacobs
• Mark Billinghurst, U S Australia
• Sameer Rawal, DISQ, India
• Tim Smith, Sevaleader
• Alvaro Cassinelli, U of Tokyo
• Benjamin Lok, U of Florida
• Bill Baxter
• Rob Lindenman,
• Brett Jones
• Mk Haley, Disney
38. Raskar | MIT Media Lab
Challenges in AR
World Input Process Output World
Camera,
Location
Sensors
Identify,
Track,
Abstract
Display,
3D Overlay
Interaction
MultiModal MultiFormat
IoT
Training
DataSets
Perception Ergo, Hygiene
Ethics
Gestural Language
EyeGlasses
Laziness
Authoring
IoT
Free Book: raskar.info/book
Slideshare.net/cameraculture