Spatial computing is a new form of computing that combines computer vision and artificial intelligence to seamlessly integrate visual content into the real world around us. Read more about the tools, devices, platforms and implications for these technologies that can be used in learning, teaching and more. Presented at Computers in Libraries 2019 with Alex Haber (Head of Education at Magic Leap), Washington D.C.

1. Taking the
Magical Leap
with Immersive
Technologies in
Libraries

2. Immersive Technologies imitate or extend our physical world via digital simulations
to give us the sense of immersion (i.e., to be completely absorbed into something.)

3. What is XR?
Source: https://goo.gl/rnAijE

4. XR is Extended Reality
• The X is a variable that can stand for anything.
• Right now, it includes 360°/360°virtual reality (VR), true VR, augmented
reality (AR) mixed reality (MR), spatial computing, holograms, etc. It’s the
full spectrum of Immersive Technology.
• Devices supporting these forms of immersive applications can be referred
to as XR devices.
• XR technologies are being seen in many industries (e.g., art, education, real
estate, medicine, engineering, entertainment, interior design, music,
libraries, etc.).
Source: https://goo.gl/bgyBC1

5. Source: http://goo.gl/51gGTb
Essentially, a computer is trying to trick your brain into believing that
you are in a completely different environment.
Virtual reality completely shuts one out
from the rest of the world while being surrounded by digital
content. A head-mounted display (HMD) displays the image
which is modified when one moves their head and/or interacts
with the content via other input modalities (e.g., hand
controllers, voice commands, MRTouch etc.)

7. Multi-Sensory Mask
For VR Headsets
https://feelreal.com

8. Image: http://goo.gl/HkQHlE
Augmented Reality
superimposes digital elements
over physical reality.

9. Mainstream AR Apps

10. Remember Google Glasses?
Fit: Adjustable nosepads and durable frame fits any face. Extra
nosepads in two sizes.
Display : High resolution display is the equivalent of a 25-inch-high
definition screen from eight feet away.
Camera: Photos - 5 MP; Videos - 720p
Audio: Bone Conduction Transducer
Connectivity: Wi-Fi - 802.11b/g; Bluetooth
Storage: 12 GB of usable memory, synced with Google cloud storage.
16 GB Flash total.
Battery: One day of typical use. Some features, like video recording,
are more battery intensive.
Charger: Included Micro USB cable and charger.

11. Adding AR Features via Browsers!
Source: https://goo.gl/vopDg6

12. Mixed Reality (MR) real and virtual worlds to produce new environments and
visualizations where physical and digital objects co-exist and interact in real time.

13. The Weather Channel’s “immersive mixed reality” (IMR) videos are intense!
Video: https://youtu.be/69nUZmQ2w8A

14. Overlaid Instructions Using a HoloLens2
Source: https://goo.gl/SMYu7i

15. .occipital.com

16. Spatial Computing combines computer vision and artificial intelligence to
seamlessly integrate visual content into the real-world around us.
Use physical space as a medium to interact with technology.

17. Technology
Taking the Magical Leap:
Background on Spatial Computing 17

18. EIC_PartnershipdiscussionwithRCL_vFinal-02.pptx
Technology moves fast and
Spatial Computing is the new frontier
MMS
2G
Internet
3G
Video
4G
Voice
1G
Voice
PSTN
5G+
Computing and
communications
convergence on
one device
Evolution of
communication
devices
Evolution of
personal
computing
devices

19. EIC_PartnershipdiscussionwithRCL_vFinal-02.pptx
We've come a long way to create Magic Leap One
The Beast
First Magic Leap Prototype
2014
WD3
Magic Leap Wearable Demo
2016
Magic Leap One
First truly Spatial Computing device,
convenient for prolonged usage
U.S. release on August 8, 2018
2018

20. EIC_PartnershipdiscussionwithRCL_vFinal-02.pptx
Magic Leap One is a uniquely differentiated spatial
computing device
Lightwear Lightpack Control
• Industry leading operating range
• Physiologically safe clipping planes
• Highest volume viewing frustum
• Real-time eye tracking
• Spatialized audio
• 6 DoF controller
• Gesture tracking
• Voice recognition
• Multi-modal input
• Dedicated computer
vision processor
• Persistent objects
• High powered chipset
• Biometric ID

21. EIC_PartnershipdiscussionwithRCL_vFinal-02.pptx
Magic Leap Studios | Project Create
Video: https://youtu.be/K5246156rcQ

22. Technology
Taking the Magical Leap:
Sptial Computing in Education 22

23. Multiple people interact with one
shared landscape.

24. Everyone in the group can see and interact
with the content in the room.

25. One person opens her personal drive to
access a file and shares with the rest of
the group.

26. 26
Our Approach: Forging a Transformative Partnership
ML Technical Support
&
Advisory Services
Spatial Computing
Sandbox
Learning Resources
Application
Development
Course / Project
Integration
Technical Research Collaboration

27. 27
Within 5 months of releasing our first product, Magic Leap Education has launched, forged partnerships and is
beginning to revolutionize the education sector across the country!
100+
800+
700+
Higher / secondary education and library partners in
the spatial computing community
Magic Leap One demos given to students, faculty and
administration
Application developers building / ready to build
educational content on Magic Leap One
ML Education: A Movement is Building...

28. CONFIDENTIAL
Thank You!
28
For more info, contact Alex Haber
ahaber@magicleap.com

29. Spatial: collaborate from anywhere in AR!
https://spatial.is
Video at: https://youtu.be/PG3tQYlZ6JQ

31. Source: https://goo.gl/hqdVvi

32. https://www.magicleap.com/stories/blog/magicverse

33. What can go wrong?
Ethical issues?

34. “The library represents a window
to a larger world.”
Barack Obama

36. VR Apps: https://goo.gl/U1xaqU

37. Images by Chris Demmons and Chad Mairn

39. CoSpaces Edu and Merge
Cube VR/AR Workshops

40. CoSpaces AR
Video: https://goo.gl/wdkfPR
Imagine kids creating their own AR environments to view
inside a blank cardboard box room?!

41. • Structure Sensor w/ Skanect
• Merge Cubes
• Merge VR Goggles
• 3D scanning projects for AR/VR
Source: https://goo.gl/Ee1W2j
Video: https://goo.gl/ZhxqzW
New workshops!
Video: https://goo.gl/A3EHAE
https://structure.io

42. Partnering with Museums!
360° and 3D scanning project, Seminole Historical Society
3D scanned object in VR, prototype for Imagine Museum
Showing artist/philanthropist, Trish Duggan,
what is possible using Magic Leap.
A meeting about VR inside VR.
Holograms via MERGE Cube

43. Social Experiment: meeting inside VR to
discuss a VR conference to be held in VR.
Powered by www.rumii.net

44. Potential Library Partnerships and Vendor Discounts with Magic Leap.
https://tblc.org https://neflin.org https://www.seflin.org

45. Supplemental Resources

46. Best tools for building an augmented reality experience
For Programmers:
Vuforia - Deliver AR innovation with the market-leading Vuforia platform
Kudan AR - Artificial Perception technologies
Wikitude - location-based, marker or markerless AR experiences
For Non-programmers:
Blippbuilder - Transform packaging, ads, magazines, posters and more.
HP Reveal - Adding value to printed content through visual interactivity
Source: https://goo.gl/1yLalY

47. ARCore (formerly Project Tango)
Source: https://goo.gl/7LkoxQ

48. ARKit (iOS)https://developer.apple.com/arkit/
Follow: https://twitter.com/madewithARKit

49. Get the SDK and learn more at https://www.vuforia.com

50. KinectVR – room scale full-body tracking

51. Godot Engine Now Has OpenVR and AR Support!
Source: https://goo.gl/eFqLw6
Download at https://godotengine.org

52. WebGL (Web Graphics Library) is a JavaScript API for
rendering interactive 3D and 2D graphics within any
compatible web browser without the use of plug-ins.
Source: https://goo.gl/UdqnLV
https://get.webgl.org

53. WebVR
Image source: https://goo.gl/mZ14xU
https://webvr.info

54. A-FrameA web framework for building virtual reality experiences
https://aframe.io

55. 360° Photo using Mozilla's A-Frame VR framework to
render it in the browser using WebGL
Try it!
RoundMe 360° iLab tour: https://goo.gl/QY8cJw
Dr. Sylvia Earle's childhood home, Seminole Historical Society, Low Season live

56. .com
https://gurivr.com/stories/create
GuriVR is actually the A-Frame library. Let’s try an
“intuitive, straightforward way to set up VR
experiences through an editor interface.”

57. https://glitch.com

58. https://cospaces.io/edu

59. CONFIDENTIAL
Thank You!
59
For more info, contact Alex Haber
ahaber@magicleap.com

60. Contact me!