ARKit in Practice

1. ARKit in Practice Luis Abreu, Sr. UX Designer, ribot.co.uk twitter.com/lmjabreu

2. ARCoreARKit

3. Agenda • How is Mobile AR diﬀerent • A technical overview • Thinking about AR • AR in Practice

5. Scale.

6. Top AR/VR Solutions ARKit ARCore PSVR Vive Platform iPhone 6S>, iPad Pro/2017 Pixel 1/2, S8 PS4 PC/Mac Replaces Visual/Audio Visual/Audio Visual/Audio Visual/Audio Field of View Screen Screen/Full Full Full Session Time Short Short Short-Long Short-Long Tracking Internal Internal External Internal Interaction Touch/Motion/Face Touch/Motion/Face Move/Traditional Controller Vive Controller User Base 400M 23M 0.9M 0.5M Other • Plane Detection • Light Estimation* • Vision API • CoreML** • TrueDepth*** • Offline NLP • Plane Detection • Light Estimation • Visual Core**** … … Entry Cost £450 £600 £600 £1500 * Directional lighting on iPhone X TrueDepth Camera ** Faster with dedicated hardware on A11 *** Only on iPhone X **** Only on Pixel 2

7. Top AR/VR Solutions ARKit ARCore PSVR Vive Platform iPhone 6S>, iPad Pro/2017 Pixel 1/2, S8 PS4 PC/Mac Replaces Visual/Audio Visual/Audio Visual/Audio Visual/Audio Field of View Screen Screen/Full Full Full Session Time Short Short Short-Long Short-Long Tracking Internal Internal External Internal Interaction Touch/Motion/Face Touch/Motion/Face Move/Traditional Controller Vive Controller User Base 400M 23M 0.9M 0.5M Other • Plane Detection • Light Estimation* • Vision API • CoreML** • TrueDepth*** • Offline NLP • Plane Detection • Light Estimation • Visual Core**** … … Entry Cost £450 £600 £600 £1500 * Directional lighting on iPhone X TrueDepth Camera ** Faster with dedicated hardware on A11 *** Only on iPhone X **** Only on Pixel 2

9. 400M ARKit iOS Devices iPhone 6S, iPhone 7, iPhone 8, iPhone X, iPad Pro, iPad 2017 source: http://fortune.com/2017/03/06/apple-iphone-use-worldwide/

10. 23M ARCore Android Devices Pixel 1, Pixel 2, Samsung S8 source: BGR, ARS Technica

12. ARKit • Inside-out world tracking • Plane detection • Light estimation • Rendering

25. +y -y -z +z +x -x Camera

26. Metric Scale

33. SceneKit SpriteKit Metal

34. Reuse 3D Models and Code Just plug the camera into ARKit’s positioning data

35. developer.apple.com/videos/wwdc2017

37. AR on its own is worthless

40. 🐟

41. Intent

42. Find opportunities

46. Find problems that need solving

47. Design solutions

48. BJ Fogg’s Behavior Model X = T × (M + A)

49. X = T × (M + A)X = T × (M + A)

50. X = T × (M + A)X = T × (M + A)

51. X = T × (M + A)X = T × (M + A)

52. Motivation X = T × (M + A)X = T × (M + A) Avoiding pain or seeking pleasure in the short/long-term, physical and psychological (e.g. social) e.g. I’m feeling a bit sleepy, ugh 😴

53. Ability X = T × (M + A)X = T × (M + A) Being able to adopt a solution, involves time, money, physical and mental eﬀort, social deviance e.g. I could go to Coﬀee@33 but Small Batch is across the road and I’ve got a meeting in 10min so… guess what I’m gonna do 🙈

54. Trigger X = T × (M + A) Triggers compensate for lack of Motivation or Ability. X = T × (M + A) e.g. show how much money I’m loosing (Motivation) and how little time I need to ﬁx it (Ability).

55. BJ Fogg’s Behavior Model X = T × (M + A)

56. Estimote

57. Be your worst competitor

58. How could this fail?

59. The problem is real,but do people use my product?

60. Is my product used for what I think it is?

61. Do I really know my customers?

62. MeasureKit

65. Do I know my competitors?

66. MeasureKit App Store

67. MeasureKit Measure Tape

68. Winner Measure Tape

69. AR removes Physical and Time constraints

70. Opportunities Education Healthcare Media Authoring Architecture Art Construction Air & Space Travel Gaming Assisted Living Retail Real Estate Logistics Utilities

71. No need to buy,wait,try,return #retailproblems

75. Instant “vision”

80. TrueDepth

83. AR removes Physical and Time constraints

84. AR…adds Physical and Time constraints?

85. In psychology,the scarcity heuristic is a mental shortcut that places a value on an item based on how easily it might be lost,especially to competitors. Scarcity Heuristic, Wikipedia

86. AR on its own is worthless

87. Stop.

88. Create with Intent

90. Feature or Focus?

91. Warby Parker Feature

93. Amazon Feature

95. MeasureKit Focus

97. Challenges of AR

98. Challenges of AR • Onboarding • Immersion • Interaction • Error Handling • …

99. Onboarding Awareness and usage of AR

100. AR Badge Icon-Only

104. Onboarding Language Do Don't Unable to find a surface. Try moving to the side or repositioning your phone. Unable to find a plane. Adjust tracking. Tap a location to place the [name of object to be placed]. Tap a plane to anchor an object. Try turning on more lights and moving around. Insufficient features. Try moving your phone slower. Excessive motion detected.

106. Immersion How do you make the experience convincing?

108. Interaction Adding and Manipulating Objects, Controlling Characters

110. More than Gestures

113. Error Handling Get me out of here!

114. Helpful Error Messages Problem Possible suggestion Insufficient features detected Try turning on more lights and moving around. Excessive motion detected Try moving your phone slower. Surface detection takes too long Try moving around, turning on more lights, and making sure your phone is pointed at a sufficiently textured surface.

115. Thank you.

116. Your advice is welcome Tell me how I could make this presentation more useful to you twitter.com/lmjabreu Luis Abreu, Sr. UX Designer, ribot.co.uk

ARKit in Practice

Recommended

Recommended

More Related Content

Recently uploaded

Recently uploaded (20)

Featured

Featured (20)

ARKit in Practice