Immersive Sydney - #WebXRWeek

Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor
Immersive Sydney - #WebXRWeek

Who am I?
Rob Manson, CEO & co-founder 
https://awe.media

Who am I?
Rob Manson, CEO & co-founder 
https://awe.media
The original evangelist for Mixed Reality using open Web Standar...

How did we get here?
2017
The web gets
Computer Vision!

What predictions did we get right?
Mixed Reality will be possible in the web

Mixed Reality will be possible in the web 
ARStandards Workshop Seoul, 2010

Mixed Reality Web Standards test harness

Mixed Reality Web Standards test harness 
isweb3here.com, 2011

OS-level pose tracking would be released

OS-level pose tracking would be released 
W3C WebVR Workshop, 2016

But getting the timing right 
is really hard…

But Tim is only right 
if you give up too soon!

Now it’s June 2018 and
#WebXR is here!

So what is XR (Extended Reality)?

Virtual Reality?
The terms virtual worlds, virtual cockpits, and virtual workstations
were used to describe specific proje...

Augmented Reality?
Augmented Reality allows the user to see the real world,
with virtual objects superimposed upon or comp...

Mixed Reality?
Image Credit
Paul Milgram - 1994

Mixed Reality & Holograms?
Image Credit

Extended Reality?
Image Credit

Here’s the different ways 
you can interact with
Extended Reality

Extended Reality Interaction Mode – Public
- Whole body in fov
- More spectators
- Limited distribution

Extended Reality Interaction Mode – Personal
- Upper/whole body in fov
- Fewer spectators
- Wider distribution

Extended Reality Interaction Mode – Private
- Extremities or head in fov
- 1-2 direct participants
- Wider distribution & ...

Extended Reality Interaction Mode – Intimate x 3
Tethered VR

Mobile VR
Tethered VR

Mobile VR Mobile AR/MR/XR
Tethered VR

Extended Reality Interaction Mode – Intimate
- Only extremities in fov
- 1 direct participant
- Pervasive but currently li...

What are the different
types of tracking

3 Degrees of Freedom head tracking (simple 3DoF VR)
This uses IMU/Gyro to track the angle you are looking at
Image Credit

6 Degrees of Freedom head tracking (6DoF VR)
This adds positional tracking so you can also walk around
Image Credit

6 Degrees of Freedom geolocation tracking (Geo AR)
This uses Gyro & GPS so you can move around the world
Image Credit

Fiducial marker tracking (Marker AR)
This uses simple computer vision
Image Credit

Natural image tracking (NFT AR)
This uses more sophisticated computer vision
Image Credit
This works on over
3 Billion bro...

Visual Inertial Odometry (VIO - ARKit/ARCore)
This combines computer vision & IMU sensor data
Image Credit

#WebXR gives you 6DoF tracking
This is delivered by ARCore/ARKit
Image Credit

#WebXR gives simple plane detection
You can fire rays to detect where they intersect a plane
Image Credit

#WebXR gives controller input
You can use hand controllers to reach into your scene
Image Credit

#WebXR gives you access to the camera intrinsics
You can access the projectionMatrix of the camera
Image Credit

#WebXR gives you access to the video frames
You can access the pixels from each frame
Image Credit

#WebXR gives you support for multiple eyes
You can create stereo VR
Image Credit

#WebXR gives you support for multiple eyes
You can create stereo VR & see-thru experiences
Image Credit
Stereo cameras

What doesn’t #WebXR deliver?
(yet)

#WebXR does NOT give you the point cloud
You can not currently access the features detected
Image Credit

#WebXR does NOT give you the real planes
You can not currently work out where planes end
Image Credit

#WebXR does NOT give you wide adoption (yet)
You can not rely on lots of capable browsers in the wild
Image Credit

But #WebXR
has some advantages
previous AR didn’t

Lets look at how
Extended Reality has been 
playing out in the market

VR awareness exploded recently!
Because VR has physical “things” to sell
Image Credit

New VR devices captured people’s imagination
The power of the s-curve
Image Credit

But HMD sales haven’t matched the hype
Image Credit

Where are we now?
In reality, VR is a tiny tiny market right now (& so is AR)
Image Credit

ARKit & ARCore brought the s-curve to AR
And distribution is growing quickly because it’s baked in
Image Credit

But look at what’s happening in the global mobile market?
Image Credit

This is where #WebXR comes in!

Image Credit
The proposed WebVR API has evolved into the WebXR API

Image Credit
Mozilla have an XR specific browser

Image Credit
Chrome have embraced the WebXR API

Image Credit
Mainstream support arrives in September

Image Credit
Supported devices?

Image Credit
But how long will it take for Safari on iOS to find it’s way?
They took 6 years with WebRTC!

Immersive Computing will become Pervasive
Image Credit
What else is likely in the future?

What are the real market trends?
This will take more than 3-5 years
Image Credit

Mainstream adoption won’t “start” until at least 2020
Image Credit
How long until we get our magic glasses?

But the next wave is already starting…
Video Credit
Standalone devices that deliver stereo see-thru with world tracking

And next wave devices are already here!
Image Credit
The Lenovo Mirage Solo works with #WebXR & is shipping now

Our focus is to make it easy for you to 
create & share AR/VR/XR Experiences
Rob Manson, CEO & co-founder - https://awe.me...

Using the browser on your
iPhone, Android, Computer & HMD!
Rob Manson, CEO & co-founder - https://awe.media - follow me on...

Image Credit
BTW: If you’re heading to ISMAR this year…

Right now you can try our 
#WebXR demos created using awe
Rob Manson, CEO & co-founder - https://awe.media - follow me on ...

And we’re releasing our new
#WebXR editor in July
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter ...

Questions / Demos / Discussion
Google WebXR Codelab 
https://codelabs.developers.google.com/codelabs/ar-with-webxr/
WebAR ...