1.
Mixed Reality and Product
Management
Vikas Batra
Feb 2017

2.
Product Management Role
Define Product...
Viable
Valuable
UsableFeasible
2

3.
The Objective
 Augmented Reality and Virtual Reality
 Examine
 Competitive Advantage ?
 Address New Market/Customer Segment ?
 Process of Assessment
3

4.
Spatial User Interface
 New Compute Interface
Redefines human interaction with Physical Objects and Physical Space
1. 3-Dimensional, Computer-generated, Graphical Spatial View
1. augments actual physical view (Augmented Reality), or
2. eliminates actual physical view (Virtual Reality)
2. Hands Free. Controlled by hands gestures, head/body movements
4

5.
Spatial User Interface
Source Microsoft
5

6.
Compute Interface Evolution
Command Line
Interface
Graphical User
Interface
Touch Screen Voice
Interface
Spatial User Interface
2D Screen – Text 2D Screen – Graphical 2D Screen – Graphical Speakers 3D Spatial Projection
Keyboard Keyboard
Mouce
Touch Screen Mic Camera. InfraRed Sensors
Key press Mouse move, clicks Swipe, Pinch Speak Hand gestures
Head/Body movement
MS–DOS Windows, Mac Smartphones, Tablets,
etc.
Echo, Siri,
Google
Assistant
Head Mounted Display,
Smart Glasses
6

7.
Virtual Reality(VR)7

8.
Virtual Reality - Phone Based8

9.
Virtual Reality – Head Mounted Display9

10.
Virtual Reality – Gaming Console
Source: Sony
Sony PlayStation VR
10

11.
Virtual Reality – PC Based
Source: Facebook/Oculus/Endgadet
Facebook Oculus
Development Platform
Facebook Oculus
Rift and Touch
11

12.
Creating Virtual Reality Content
 Capture
 Store
 Edit
 Transmit
 Playback
Nokia Ozo 360
Camera
Source: Nokia
12

13.
Augmented Reality(AR)13

14.
On TV14

15.
On Mobile Phone
 Lets see it in action
15

16.
On Mobile Phone - Tango
 Depth Sensing
 Motion Tracking
 Google Tango Application
Development Platform
Lenovo Pahb2 Pro
16

17.
On Mobile Phone – Tango
See Before you Buy
Wayfair View App on Tango
17

18.
Visualization in 3D Space
Visualize Wi-Fi Signal Coverage
Signal Mapper App on Tango
By Signal Garden
18

19.
On Smart Glasses
Microsoft HoloLens ODG R-8 Smart Glasses
19

20.
Optics
Holographic WaveguideCurved CombinerFlat Combiner
Display
Lens
Computer Graphics
Actual Physical View
20

21.
Smart Glasses
 40+ Smart Glasses
 AugmentedReality.org ww.arglassesbuyersguide.com

Source: AugmentedReality.org
21

22.
Software
 Recognize and Track Environment
 Define AR Experiences
 Execute AR Experiences
 Integration with Existing Systems
 50+ AR Authoring Platforms/SDKs
 Comparison at Social Compare
http://socialcompare.com/en/comparison/augmented-reality-sdks
22

23.
End-User Interface
Source Microsoft
23

24.
The Big Picture24
Internet of Things
Artificial Intelligence/
Analytics
Humans
Data
Automated
Control
Data
Manual
Control
‘Pull’
‘ Contextually
Relevant Push’

25.
The Promise
 Augmented Reality
 3-Dimensional, Augmented Views (Audio-Video)
 Hands Free Operation - Input/output from hand gestures, voice,
camera, sensors …
 Larger, adjustable display area
 Greater Comfort,
 Always with you. ‘Contextually Relevant Push’
 Virtual Reality
 Immersive Experiences
Significantly better end-user experience
compared to Smartphone/PC/Tablets
25

26.
The Challenges
 Technical
 Optics
 Weight
 Battery Life
 Bandwidth/Delay
 Business
 Price
 Content
 Application Platforms and Eco-system
26

27.
Trends
 ~4B VC funding since 2014
 Big Players
 Miniaturization
 Optics
 Lower Prices
 5G Wireless Networks
 WiGig/802.11ad
27

28.
Example Uses Cases28

29.
Use Cases Areas
Physical Objects
Physical Space
Immersive Experiences
29

30.
Use Cases – Physical Objects
 Design
 Assemble
 Warehouse/Logistics
 Operate/Use
 Maintain
 Support. I See What You See
 Survey
 Education/Training
Execute a Procedure
30

31.
Use Cases – Physical Spaces
 Architecture/Interior Design
 Navigation
 Venue Experiences e.g. Museums
 See Before You Buy
 3-D Visualization in Space
 Language Translation
 …
31

32.
Uses Cases – Immersive Experiences
 Gaming
 Social Virtual Experience
 Movies
 Theme Parks
 Live Events – Every Viewer on Prime Seat
 Virtual Tours
 Before to travel
 Real Estate
 …
 Holoportation
32

33.
What will you define?
33

34.
The Process34

35.
Assessment Process
Define Concept
Identify and Capture Value
•End Customers, Organization, Partners
Usability
Viability
• Customer ROI/Time
• Impact to organization (e.g. CBA, Users,
Usage Time)
• Partners (CBA)
Risks
Assess Concept
Refine Value, Usability, Viability, and
Risks
Prototype
•Objective
•Deliverable
•Cost/Effort
•Time/Schedule
Develop Prototype
Refine Value, Usability, Viability and
Risks
Product Development
•Scope
•Cost/Effort
•Time/Schedule
Go To Market, Support etc.
Perform
Assessment?
Develop
Prototype?
Develop
Product?
35

36.
Questions ?36

37.
Back Up37

38.
Example Use Cases
 3D Virtual Design
 Design prior to development
 Visualize prior to purchase
 Execute Procedure. Hands-free, 3D AR, Audio
assisted
 Physical Object: Install, Operate, Maintain Example ;
Boeing Example ; Nokia Small Cell
 Surgical/Medical Procedure
 Pick and Pack
 Surveys, Navigation
 Always On
 Self/Environment Monitoring, Compliance
 Non intrusive Alerting, Audio output
 Contextual Situation Awareness
 Push Contextually Relevant Information
 IOT Enabled Machine Visibility and Control
 Multi party conference
 I see what you see
 Remote Expert, Customer Support, etc.
 3D Non-real time Video for Training Example
 Contextual Marketing
 Larger Viewing Area, Non intrusive
 Contextually relevant
 Holo-portation. Real Time Communication
 3D Virtual Travel
 3D Immersive Entertainment
 ….
38

39.
See before you buy
Wayfair View App on Tango
39

40.
Design
SketchUp Viewer
Trimble Inc.
40
Meta 2 Glasses
Meta

41.
Execute a Procedure
AR Car Repair Solution
Continental Corporation
41
Hands Free Instructions in the Field
Epson/Atheer

42.
Medical
VeinViewer
ChristieMed
42

43.
Interior Design
InContext Solutions
43

44.
Education
HoloAnatomy by
Case Western Reserve University
HoloHeart by
Made In Point GmbH
44

45.
Navigation
Aircraft Navigation
Aero Glass
Indoor Navigation to the shelf/aisle
Aisle 411
-
45

46.
Navigation
Car Navigation.
Navdy
46

47.
Support
Skype. Microsoft
47

48.
Venue Experience
Source EPSON
48

49.
Virtual Keyboard/Key pad
Augumenta Interaction Platform
HoloLens 3D3 Keyboard
49

50.
Live Events50
Live Events – US Open Golf
NextVR

51.
51
Spectacles
SnapChat

52.
Technology Components
 Optics (Waveguide, Curved Surface Combiner)
 Gesture Recognition and Control
 Voice Recognition and Control
 Depth Sensing
 Inertial Measurement Unit (IMU)
 Context Aware – Computing
 3D Video/Audio, Capture, Editing, and Transmission
 Augmented Reality Authoring Software Platform
52

53.
Enterprise AR Value Chain
Nokia Internal Use. Confidential.
Components
• Qualcomm
• TI
• Intel
• Nvidia
• AMD
•…
• Samsung
• Lumus
• Rochester Optical
•….
Smart Glasses
• ODG
• Intel/Recon
• Epson
• Vuzix
• Daqri (Helmet)
• Google
• Microsoft
• Meta
• Lenovo
• MagicLeap
Connectivity
• Nokia, Ericsson, Huawei
• Cisco, Brocade/Ruckus,
HPE/Aruba..
Applications
Development
• APX Labs/UpSkill
• PTC
• Atheer
• Wikitude
• Augumenta
• Daqri,
• Pristine
• UBIMax
• Incontext Solutions
• Surgical Theater
• …
System
Integration
• IBM
• Accenture
• HP
•…
• Nokia Services ?
Operations &
Management
• AirWatch by vmware
• Augmate
•Nokia Impact (MDM)?

54.
End User Experience
At Home
Source Microsoft
54

55.
End User Experience
Source: Microsoft HoloLens
55

56.
End User Experience
Source: Microsoft HoloLens
Everywhere Else
Source ODG,
56

57.
Questions to Ask
 Can it enable meeting existing customer needs better ?
 Can it enable meeting an unmet customer need?
 Are there new customer segments that can now become attractive?
 Can it improve monetization ? E.g. moving subscriber from free to premium offering?
 Can it enable higher Productivity?
 Can it enable higher Quality?
 Can it enable greater Safety?
 Can it help with Compliance requirements?
Directly from VR HMD/AR Smart Glasses and Technology building blocks
57

58.
Resources
 www.arglassesbuyersguide.com/
 www.augmentedworldexpo.com/
 Augmented Reality for Enterprise Alliance (AREA)
www.thearea.org/
 Karl Guttag on Technology www.kguttag.com
 Depth Sensing Technologies Comparison
http://www.ti.com/lsds/ti/sensing-products/optical-
sensors/3d-time-of-flight-sensors-technology-
comparison.page
58