1.
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor
Immersive Sydney - #WebXRWeek

2.
What is Immersive?

3.
What is Immersive?

4.
What is Immersive?

5.
Who am I?
Rob Manson, CEO & co-founder
https://awe.media

6.
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards

7.
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert

8.
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
W3C

9.
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
W3C
Khronos Group

10.
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
W3C
Khronos Group
ISO

11.
A brief history of awe…

12.
How did we get here?

13.
How did we get here?

14.
How did we get here?

15.
How did we get here?

16.
How did we get here?

17.
How did we get here?

18.
How did we get here?

19.
How did we get here?

20.
How did we get here?
2017
The web gets
Computer Vision!

21.
What predictions did we get right?
Mixed Reality will be possible in the web

22.
What predictions did we get right?
Mixed Reality will be possible in the web
ARStandards Workshop Seoul, 2010

23.
What predictions did we get right?
Mixed Reality Web Standards test harness

24.
What predictions did we get right?
Mixed Reality Web Standards test harness
isweb3here.com, 2011

25.
What predictions did we get right?
OS-level pose tracking would be released

26.
What predictions did we get right?
OS-level pose tracking would be released
W3C WebVR Workshop, 2016

27.
But getting the timing right
is really hard…

28.
But Tim is only right
if you give up too soon!

29.
Now it’s June 2018 and
#WebXR is here!

30.
So what is XR (Extended Reality)?

31.
Virtual Reality?
The terms virtual worlds, virtual cockpits, and virtual workstations
were used to describe specific projects.
In 1989, Jaron Lanier, CEO of VPL, coined the term virtual reality
to bring all of the virtual projects under a single rubric.
The term therefore typically refers to three-dimensional realities implemented
with stereo viewing goggles and reality gloves.
Myron Krueger - 1991
Image Credit Image CreditImage Credit

32.
Augmented Reality?
Augmented Reality allows the user to see the real world,
with virtual objects superimposed upon or composited with the real world.
1. Combines the real and virtual, 2. Is interactive in real time, 3. Is registered in 3D
Ron Azuma - 1997
Image Credit

33.
Mixed Reality?
Image Credit
Paul Milgram - 1994

34.
Mixed Reality & Holograms?
Image Credit

35.
Extended Reality?
Image Credit

36.
Image Credit

37.
Here’s the different ways
you can interact with
Extended Reality

38.
Extended Reality Interaction Mode – Public
- Whole body in fov
- More spectators
- Limited distribution

39.
Extended Reality Interaction Mode – Personal
- Upper/whole body in fov
- Fewer spectators
- Wider distribution

40.
Extended Reality Interaction Mode – Private
- Extremities or head in fov
- 1-2 direct participants
- Wider distribution & locations

41.
Extended Reality Interaction Mode – Private
- Extremities or head in fov
- 1-2 direct participants
- Wider distribution & locations
This is where
#WebXR plays

42.
Extended Reality Interaction Mode – Intimate x 3
Tethered VR

43.
Mobile VR
Extended Reality Interaction Mode – Intimate x 3
Tethered VR

44.
Mobile VR Mobile AR/MR/XR
Extended Reality Interaction Mode – Intimate x 3
Tethered VR

45.
Extended Reality Interaction Mode – Intimate
- Only extremities in fov
- 1 direct participant
- Pervasive but currently limited distribution
#WebXR
works here
now too

46.
What are the different
types of tracking

47.
3 Degrees of Freedom head tracking (simple 3DoF VR)
This uses IMU/Gyro to track the angle you are looking at
Image Credit

48.
6 Degrees of Freedom head tracking (6DoF VR)
This adds positional tracking so you can also walk around
Image Credit

49.
6 Degrees of Freedom geolocation tracking (Geo AR)
This uses Gyro & GPS so you can move around the world
Image Credit

50.
Fiducial marker tracking (Marker AR)
This uses simple computer vision
Image Credit

51.
Natural image tracking (NFT AR)
This uses more sophisticated computer vision
Image Credit
This works on over
3 Billion browsers
right now!
awe has the only web based
natural image tracking
solution available today
Digital object Natural image

52.
Visual Inertial Odometry (VIO - ARKit/ARCore)
This combines computer vision & IMU sensor data
Image Credit

53.
What does #WebXR deliver?

54.
#WebXR gives you 6DoF tracking
This is delivered by ARCore/ARKit
Image Credit

55.
#WebXR gives simple plane detection
You can fire rays to detect where they intersect a plane
Image Credit

56.
#WebXR gives controller input
You can use hand controllers to reach into your scene
Image Credit

57.
#WebXR gives you access to the camera intrinsics
You can access the projectionMatrix of the camera
Image Credit

58.
#WebXR gives you access to the video frames
You can access the pixels from each frame
Image Credit

59.
#WebXR gives you support for multiple eyes
You can create stereo VR
Image Credit

60.
#WebXR gives you support for multiple eyes
You can create stereo VR & see-thru experiences
Image Credit
Stereo cameras

61.
What doesn’t #WebXR deliver?
(yet)

62.
#WebXR does NOT give you the point cloud
You can not currently access the features detected
Image Credit

63.
#WebXR does NOT give you the real planes
You can not currently work out where planes end
Image Credit

64.
#WebXR does NOT give you wide adoption (yet)
You can not rely on lots of capable browsers in the wild
Image Credit

65.
But #WebXR
has some advantages
previous AR didn’t

66.
Lets look at how
Extended Reality has been
playing out in the market

67.
VR awareness exploded recently!
Because VR has physical “things” to sell
Image Credit

68.
New VR devices captured people’s imagination
The power of the s-curve
Image Credit

69.
But HMD sales haven’t matched the hype
Image Credit

70.
Where are we now?
In reality, VR is a tiny tiny market right now (& so is AR)
Image Credit

71.
ARKit & ARCore brought the s-curve to AR
And distribution is growing quickly because it’s baked in
Image Credit

72.
But look at what’s happening in the global mobile market?
Image Credit

73.
This is where #WebXR comes in!

74.
Image Credit
The proposed WebVR API has evolved into the WebXR API

75.
Image Credit
Mozilla have an XR specific browser

76.
Image Credit
An iOS app now

77.
Image Credit
Chrome have embraced the WebXR API

78.
Image Credit
Android now

79.
Image Credit
Mainstream support arrives in September

80.
Image Credit
Supported devices?

81.
Image Credit
But how long will it take for Safari on iOS to find it’s way?
They took 6 years with WebRTC!

82.
Immersive Computing will become Pervasive
Image Credit
What else is likely in the future?

83.
What are the real market trends?
This will take more than 3-5 years
Image Credit

84.
Mainstream adoption won’t “start” until at least 2020
Image Credit
How long until we get our magic glasses?

85.
But the next wave is already starting…
Video Credit
Standalone devices that deliver stereo see-thru with world tracking

86.
And next wave devices are already here!
Image Credit
The Lenovo Mirage Solo works with #WebXR & is shipping now

87.
Our focus is to make it easy for you to
create & share AR/VR/XR Experiences
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor

88.
Using the browser on your
iPhone, Android, Computer & HMD!
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor

89.
Image Credit
BTW: If you’re heading to ISMAR this year…

90.
Right now you can try our
#WebXR demos created using awe
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor

91.
And we’re releasing our new
#WebXR editor in July
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor

92.
Questions / Demos / Discussion
Google WebXR Codelab
https://codelabs.developers.google.com/codelabs/ar-with-webxr/
WebAR Demos
https://magic.awe.io
Create your own for free at https://try.awe.media
WebXR Demos
awe solar system (come and checkout on our devices)
awe anatomy explorer (come and checkout on our devices)
awe room explorer (come and checkout on our devices)
https://googlecodelabs.github.io/ar-with-webxr/final/
https://web-education-ar-demo.appspot.com/
https://immersive-web.github.io/webxr-samples/
https://apainter.webxrexperiments.com/