SlideShare una empresa de Scribd logo
1 de 39
CHALLENGES IN DESIGNING A
                                   MENU SYSTEM WITH DEPTH
                                  MOTION SENSOR TECHNOLOGY

                                                    Shachar Oz
                                                 Game & UX Designer
                                                Omek Interactive Studios




© Omek Interactive, Ltd. All rights reserved.
MENUS ARE FORGOTTEN ABOUT .
                            OR, WHAT CAN DRIVE USERS CRAZY ?




© Omek Interactive, Ltd. All rights reserved.
© Omek Interactive, Ltd. All rights reserved.
MENU SYSTEM DESIGN GUIDELINES

             • Confident users understand:
                               – where they are
                               – where they were
                               – what can they do
                               – how can they do it




© Omek Interactive, Ltd. All rights reserved.
3D DEPTH SENSOR
                            OR, WHAT IS IT ?




© Omek Interactive, Ltd. All rights reserved.
3D DEPTH SENSOR
                            OR, WHAT IS IT ?




© Omek Interactive, Ltd. All rights reserved.
TOUCH-BASED TECHNOLOGY




© Omek Interactive, Ltd. All rights reserved.
TOUCH-LESS TECHNOLOGY




© Omek Interactive, Ltd. All rights reserved.
TOUCH-LESS TECHNOLOGY




© Omek Interactive, Ltd. All rights reserved.
DEPTH MOTION CAPTURE



              Body tracking                    × Tangible feedback
              Natural gestures                 × 100% stability
              Free from controllers            × Accuracy




© Omek Interactive, Ltd. All rights reserved.
CHALLENGES
                            OR, HOW TECHNOLOGY INFLUENCE DESIGN ?




© Omek Interactive, Ltd. All rights reserved.
CHALLENGES OF MOTION CAPTURE

             • Feeling of a click :
                  virtual tangibility
             • Active & inactive modes
             • Am I in control ?
             • Inner delay of the interface




© Omek Interactive, Ltd. All rights reserved.
CHALLENGES OF MOTION CAPTURE

             • Feeling of a click
             • Active & inactive modes :
                  differentiate between user behaviors
             • Am I in control ?
             • Inner delay of the interface




© Omek Interactive, Ltd. All rights reserved.
CHALLENGES OF MOTION CAPTURE

             • Feeling of a click
             • Active & inactive modes
             • Am I in control ?
                  feedback for the users
             • Inner delay of the interface




© Omek Interactive, Ltd. All rights reserved.
CHALLENGES OF MOTION CAPTURE

             •             Feeling of a click
             •             Active & inactive modes
             •             Am I in control ?
             •             Inner delay of the interface :
                              cannot predict the user




© Omek Interactive, Ltd. All rights reserved.
DEALING WITH CHALLENGES
                            SELECTING AND SCROLLING ITEMS




© Omek Interactive, Ltd. All rights reserved.
Selecting Items
             • Click gesture :
                  imitate mouse
             • Hot-spot
             • Grand gesture
             • Swipe in
             • Grab gesture



© Omek Interactive, Ltd. All rights reserved.
© Omek Interactive, Ltd. All rights reserved.
Selecting Items
             • Click gesture
             • Hot-spot
             • Grand gesture :
                   grandiose arm movement
             • Swipe in
             • Grab gesture



© Omek Interactive, Ltd. All rights reserved.
Selecting Items
             • Click gesture
             • Hot-spot
             • Grand gesture
             • Swipe in :
                   continuous
                   feedback
             • Grab gesture


© Omek Interactive, Ltd. All rights reserved.
Selecting Items
             •             Click gesture
             •             Hot-spot
             •             Grand gesture
             •             Swipe in
             •             Grab gesture :
                               pinch or fist



© Omek Interactive, Ltd. All rights reserved.
Selecting Items




                                                                            Gran




                                                                                                    Grab
                                                Click




                                                                             d ge
                                                              Hot-




                                                                                         Swip


                                                                                                     gest
                                                      g
                                                   estu




                                                                                 sture
                                                                   sp




                                                                                          e in


                                                                                                       ure
                                                                 ot
                                                     re

                  Responsiveness                          v             x           v           v           v


                  Active &                                v             x           v           ½          ½
                  inactive
                  Stablilty                               x             v           v           v          ½



                  Comfortable                             ½             v           x           v           v



                  Usability                               v             v           x           ½          ½




© Omek Interactive, Ltd. All rights reserved.
Scrolling Items
             • 2D cursor :
                  imitate mouse
             • 1D cursor
             • Static active spot
             • Dynamic active spot
             • Grand gesture



© Omek Interactive, Ltd. All rights reserved.
Scrolling Items
             • 2D cursor
             • 1D cursor :
                   scroll on one axis
             • Static active spot
             • Dynamic active spot
             • Grand gesture



© Omek Interactive, Ltd. All rights reserved.
Scrolling Items
             • 2D cursor
             • 1D cursor
             • Static active spot :
                  magnifying glass
             • Dynamic active spot
             • Grand gesture



© Omek Interactive, Ltd. All rights reserved.
Scrolling Items
             • 2D cursor
             • 1D cursor
             • Static active spot
             • Dynamic active spot :
                  magnifying glass++
             • Grand gesture



© Omek Interactive, Ltd. All rights reserved.
Scrolling Items
             •             2D cursor
             •             1D cursor
             •             Static active spot
             •             Dynamic active spot
             •             Grand gesture :
                              grandiose arm
                              movements


© Omek Interactive, Ltd. All rights reserved.
Scrolling Items




                                                                                       Gran
                                                                          Stati

                                                                                          activ
                                                                                           Dyna t
                                                2D c


                                                             1D c




                                                                                            d ge
                                                                              spot
                                                                               c act

                                                                                               e spo


                                                                                                sture
                                                    urso


                                                                 urso




                                                                                                 mic
                                                                                ive
                                                         r

                  Responsiveness
                                                                      r
                                                        v            v           ½          v       v


                  Active &                              v            v           x          v       v
                  inactive
                  Stablilty                            ½             v           ½          v       v



                  Comfortable                           v           ½            v          ½       x



                  Usability                             v            v           ½          v       x




© Omek Interactive, Ltd. All rights reserved.
Pagination
             • Just another button: hot-spot / click
             • Grand gesture: Minority Report
             • Drag n’ drop: scroll the entire list




© Omek Interactive, Ltd. All rights reserved.
User Real Location
             •             Camera view: what the camera sees?
             •             B&W: grey scale colors
             •             Freeze!: control over the character
             •             Trapezoid: view playfield from up
             •             Note over character: main area of concern




© Omek Interactive, Ltd. All rights reserved.
Feeling of a Click




© Omek Interactive, Ltd. All rights reserved.
CONCLUSIONS
                            OR, WHAT DID WE LEARN ?




© Omek Interactive, Ltd. All rights reserved.
Conclusions
             • Tracking:
                  essential constant feedback
             • Gesture:
                  toggle action modes




© Omek Interactive, Ltd. All rights reserved.
Conclusions
             • Tracking:
                  essential constant feedback
             • Gesture:
                  toggle action modes




© Omek Interactive, Ltd. All rights reserved.
User Expectations
             • One hand based control scheme
             • Grandiose gestures only once in a while
             • Constant feedback for each movement




© Omek Interactive, Ltd. All rights reserved.
Depth Sensor Menu Design Guidelines

             •             Consistency
             •             Simplicity
             •             Feeling of control
             •             Feedback
             •             Comfortable




© Omek Interactive, Ltd. All rights reserved.
Future Experiments
             • Sound based feedback (for blind)
             • Speech based / speech components




© Omek Interactive, Ltd. All rights reserved.
References
             •             Frosted Glass / CAMPAR
             •             EyeSight
             •             Dance Central / Harmonix
             •             Adrenaline Misfits / Konami
             •             Omek Interactive Studios
             •             Media Center / Primesense
             •             PointGrab
             •             Powerup Heroes / Ubisoft

             • Huang J., White R.W., Buscher G. (2012). User See, User
               Point: Gaze and Cursor Alignment in Web Search.
               CHI’12, May 5–10, 2012, Austin, Texas, USA

© Omek Interactive, Ltd. All rights reserved.
Thank You For Listening ,

         Shachar Oz
        Game & UX Designer
      Omek Interactive Studios
     www.OmekInteractive.com
   Shachar@OmekInteractive.com

Más contenido relacionado

Destacado

3DTV Transmission Aspects
3DTV Transmission Aspects3DTV Transmission Aspects
3DTV Transmission Aspects
Raoni Lourenço
 
"The OpenCV Open Source Computer Vision Library: Latest Developments," a Pres...
"The OpenCV Open Source Computer Vision Library: Latest Developments," a Pres..."The OpenCV Open Source Computer Vision Library: Latest Developments," a Pres...
"The OpenCV Open Source Computer Vision Library: Latest Developments," a Pres...
Edge AI and Vision Alliance
 
TV vs Metaverse - The Mixed Reality Perfect Storm
TV vs Metaverse - The Mixed Reality Perfect StormTV vs Metaverse - The Mixed Reality Perfect Storm
TV vs Metaverse - The Mixed Reality Perfect Storm
Gary Hayes
 
Processor powerpoint
Processor powerpointProcessor powerpoint
Processor powerpoint
brennan_jame
 

Destacado (20)

Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango
Jared Finder (Google) Creating Mixed Reality Apps and Games with Project TangoJared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango
Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango
 
Laurel Fitts - The Power of Mixed Reality
Laurel Fitts - The Power of Mixed RealityLaurel Fitts - The Power of Mixed Reality
Laurel Fitts - The Power of Mixed Reality
 
3DTV Transmission Aspects
3DTV Transmission Aspects3DTV Transmission Aspects
3DTV Transmission Aspects
 
Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...
Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...
Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...
 
KaoNet: Face Recognition and Generation App using Deep Learning
KaoNet: Face Recognition and Generation App using Deep LearningKaoNet: Face Recognition and Generation App using Deep Learning
KaoNet: Face Recognition and Generation App using Deep Learning
 
"The OpenCV Open Source Computer Vision Library: Latest Developments," a Pres...
"The OpenCV Open Source Computer Vision Library: Latest Developments," a Pres..."The OpenCV Open Source Computer Vision Library: Latest Developments," a Pres...
"The OpenCV Open Source Computer Vision Library: Latest Developments," a Pres...
 
Tangible Interfaces & Mixed Reality : A step toward digital augmented enviro...
Tangible Interfaces & Mixed Reality :  A step toward digital augmented enviro...Tangible Interfaces & Mixed Reality :  A step toward digital augmented enviro...
Tangible Interfaces & Mixed Reality : A step toward digital augmented enviro...
 
Intro to HoloLens Development + Windows Mixed Reality
Intro to HoloLens Development + Windows Mixed RealityIntro to HoloLens Development + Windows Mixed Reality
Intro to HoloLens Development + Windows Mixed Reality
 
Computer Vision, Deep Learning, OpenCV
Computer Vision, Deep Learning, OpenCVComputer Vision, Deep Learning, OpenCV
Computer Vision, Deep Learning, OpenCV
 
Mixed reality
Mixed realityMixed reality
Mixed reality
 
Virtual, Augmented & Mixed Reality Matrix: Brand Reach & User Immersion
Virtual, Augmented & Mixed Reality Matrix: Brand Reach & User ImmersionVirtual, Augmented & Mixed Reality Matrix: Brand Reach & User Immersion
Virtual, Augmented & Mixed Reality Matrix: Brand Reach & User Immersion
 
The Rise Of Mixed Reality Advertising + Digital Signage
The Rise Of Mixed Reality Advertising + Digital SignageThe Rise Of Mixed Reality Advertising + Digital Signage
The Rise Of Mixed Reality Advertising + Digital Signage
 
Mixed Reality met Microsoft HoloLens
Mixed Reality met Microsoft HoloLensMixed Reality met Microsoft HoloLens
Mixed Reality met Microsoft HoloLens
 
"High-resolution 3D Reconstruction on a Mobile Processor," a Presentation fro...
"High-resolution 3D Reconstruction on a Mobile Processor," a Presentation fro..."High-resolution 3D Reconstruction on a Mobile Processor," a Presentation fro...
"High-resolution 3D Reconstruction on a Mobile Processor," a Presentation fro...
 
Next Frontiers of Marketing: Virtual & Mixed Reality, Artificial Intelligence...
Next Frontiers of Marketing: Virtual & Mixed Reality, Artificial Intelligence...Next Frontiers of Marketing: Virtual & Mixed Reality, Artificial Intelligence...
Next Frontiers of Marketing: Virtual & Mixed Reality, Artificial Intelligence...
 
An intro to 4D
An intro to 4DAn intro to 4D
An intro to 4D
 
TV vs Metaverse - The Mixed Reality Perfect Storm
TV vs Metaverse - The Mixed Reality Perfect StormTV vs Metaverse - The Mixed Reality Perfect Storm
TV vs Metaverse - The Mixed Reality Perfect Storm
 
Processor powerpoint
Processor powerpointProcessor powerpoint
Processor powerpoint
 
Dl16 305 ohare_presentation
Dl16 305 ohare_presentationDl16 305 ohare_presentation
Dl16 305 ohare_presentation
 
Technology and Society - HP Case Study
Technology and Society - HP Case StudyTechnology and Society - HP Case Study
Technology and Society - HP Case Study
 

Último

call girls in Dakshinpuri (DELHI) 🔝 >༒9953056974 🔝 genuine Escort Service 🔝✔️✔️
call girls in Dakshinpuri  (DELHI) 🔝 >༒9953056974 🔝 genuine Escort Service 🔝✔️✔️call girls in Dakshinpuri  (DELHI) 🔝 >༒9953056974 🔝 genuine Escort Service 🔝✔️✔️
call girls in Dakshinpuri (DELHI) 🔝 >༒9953056974 🔝 genuine Escort Service 🔝✔️✔️
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men 🔝dehradun🔝 Escor...
➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men  🔝dehradun🔝   Escor...➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men  🔝dehradun🔝   Escor...
➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men 🔝dehradun🔝 Escor...
amitlee9823
 
Anamika Escorts Service Darbhanga ❣️ 7014168258 ❣️ High Cost Unlimited Hard ...
Anamika Escorts Service Darbhanga ❣️ 7014168258 ❣️ High Cost Unlimited Hard  ...Anamika Escorts Service Darbhanga ❣️ 7014168258 ❣️ High Cost Unlimited Hard  ...
Anamika Escorts Service Darbhanga ❣️ 7014168258 ❣️ High Cost Unlimited Hard ...
nirzagarg
 
How to Build a Simple Shopify Website
How to Build a Simple Shopify WebsiteHow to Build a Simple Shopify Website
How to Build a Simple Shopify Website
mark11275
 
➥🔝 7737669865 🔝▻ dharamshala Call-girls in Women Seeking Men 🔝dharamshala🔝 ...
➥🔝 7737669865 🔝▻ dharamshala Call-girls in Women Seeking Men  🔝dharamshala🔝  ...➥🔝 7737669865 🔝▻ dharamshala Call-girls in Women Seeking Men  🔝dharamshala🔝  ...
➥🔝 7737669865 🔝▻ dharamshala Call-girls in Women Seeking Men 🔝dharamshala🔝 ...
amitlee9823
 
Verified Trusted Call Girls Adugodi💘 9352852248 Good Looking standard Profil...
Verified Trusted Call Girls Adugodi💘 9352852248  Good Looking standard Profil...Verified Trusted Call Girls Adugodi💘 9352852248  Good Looking standard Profil...
Verified Trusted Call Girls Adugodi💘 9352852248 Good Looking standard Profil...
kumaririma588
 
Abortion Pills in Oman (+918133066128) Cytotec clinic buy Oman Muscat
Abortion Pills in Oman (+918133066128) Cytotec clinic buy Oman MuscatAbortion Pills in Oman (+918133066128) Cytotec clinic buy Oman Muscat
Abortion Pills in Oman (+918133066128) Cytotec clinic buy Oman Muscat
Abortion pills in Kuwait Cytotec pills in Kuwait
 
ab-initio-training basics and architecture
ab-initio-training basics and architectureab-initio-training basics and architecture
ab-initio-training basics and architecture
saipriyacoool
 
Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...
Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...
Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...
nirzagarg
 
Just Call Vip call girls dharamshala Escorts ☎️9352988975 Two shot with one g...
Just Call Vip call girls dharamshala Escorts ☎️9352988975 Two shot with one g...Just Call Vip call girls dharamshala Escorts ☎️9352988975 Two shot with one g...
Just Call Vip call girls dharamshala Escorts ☎️9352988975 Two shot with one g...
gajnagarg
 
Editorial design Magazine design project.pdf
Editorial design Magazine design project.pdfEditorial design Magazine design project.pdf
Editorial design Magazine design project.pdf
tbatkhuu1
 

Último (20)

call girls in Dakshinpuri (DELHI) 🔝 >༒9953056974 🔝 genuine Escort Service 🔝✔️✔️
call girls in Dakshinpuri  (DELHI) 🔝 >༒9953056974 🔝 genuine Escort Service 🔝✔️✔️call girls in Dakshinpuri  (DELHI) 🔝 >༒9953056974 🔝 genuine Escort Service 🔝✔️✔️
call girls in Dakshinpuri (DELHI) 🔝 >༒9953056974 🔝 genuine Escort Service 🔝✔️✔️
 
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
 
➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men 🔝dehradun🔝 Escor...
➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men  🔝dehradun🔝   Escor...➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men  🔝dehradun🔝   Escor...
➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men 🔝dehradun🔝 Escor...
 
Anamika Escorts Service Darbhanga ❣️ 7014168258 ❣️ High Cost Unlimited Hard ...
Anamika Escorts Service Darbhanga ❣️ 7014168258 ❣️ High Cost Unlimited Hard  ...Anamika Escorts Service Darbhanga ❣️ 7014168258 ❣️ High Cost Unlimited Hard  ...
Anamika Escorts Service Darbhanga ❣️ 7014168258 ❣️ High Cost Unlimited Hard ...
 
How to Build a Simple Shopify Website
How to Build a Simple Shopify WebsiteHow to Build a Simple Shopify Website
How to Build a Simple Shopify Website
 
➥🔝 7737669865 🔝▻ dharamshala Call-girls in Women Seeking Men 🔝dharamshala🔝 ...
➥🔝 7737669865 🔝▻ dharamshala Call-girls in Women Seeking Men  🔝dharamshala🔝  ...➥🔝 7737669865 🔝▻ dharamshala Call-girls in Women Seeking Men  🔝dharamshala🔝  ...
➥🔝 7737669865 🔝▻ dharamshala Call-girls in Women Seeking Men 🔝dharamshala🔝 ...
 
Just Call Vip call girls Nagpur Escorts ☎️8617370543 Starting From 5K to 25K ...
Just Call Vip call girls Nagpur Escorts ☎️8617370543 Starting From 5K to 25K ...Just Call Vip call girls Nagpur Escorts ☎️8617370543 Starting From 5K to 25K ...
Just Call Vip call girls Nagpur Escorts ☎️8617370543 Starting From 5K to 25K ...
 
call girls in Kaushambi (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝...
call girls in Kaushambi (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝...call girls in Kaushambi (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝...
call girls in Kaushambi (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝...
 
Verified Trusted Call Girls Adugodi💘 9352852248 Good Looking standard Profil...
Verified Trusted Call Girls Adugodi💘 9352852248  Good Looking standard Profil...Verified Trusted Call Girls Adugodi💘 9352852248  Good Looking standard Profil...
Verified Trusted Call Girls Adugodi💘 9352852248 Good Looking standard Profil...
 
Abortion Pills in Oman (+918133066128) Cytotec clinic buy Oman Muscat
Abortion Pills in Oman (+918133066128) Cytotec clinic buy Oman MuscatAbortion Pills in Oman (+918133066128) Cytotec clinic buy Oman Muscat
Abortion Pills in Oman (+918133066128) Cytotec clinic buy Oman Muscat
 
Sector 104, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 104, Noida Call girls :8448380779 Model Escorts | 100% verifiedSector 104, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 104, Noida Call girls :8448380779 Model Escorts | 100% verified
 
High Profile Escorts Nerul WhatsApp +91-9930687706, Best Service
High Profile Escorts Nerul WhatsApp +91-9930687706, Best ServiceHigh Profile Escorts Nerul WhatsApp +91-9930687706, Best Service
High Profile Escorts Nerul WhatsApp +91-9930687706, Best Service
 
Top Rated Pune Call Girls Koregaon Park ⟟ 6297143586 ⟟ Call Me For Genuine S...
Top Rated  Pune Call Girls Koregaon Park ⟟ 6297143586 ⟟ Call Me For Genuine S...Top Rated  Pune Call Girls Koregaon Park ⟟ 6297143586 ⟟ Call Me For Genuine S...
Top Rated Pune Call Girls Koregaon Park ⟟ 6297143586 ⟟ Call Me For Genuine S...
 
ab-initio-training basics and architecture
ab-initio-training basics and architectureab-initio-training basics and architecture
ab-initio-training basics and architecture
 
Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...
Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...
Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...
 
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
 
Just Call Vip call girls dharamshala Escorts ☎️9352988975 Two shot with one g...
Just Call Vip call girls dharamshala Escorts ☎️9352988975 Two shot with one g...Just Call Vip call girls dharamshala Escorts ☎️9352988975 Two shot with one g...
Just Call Vip call girls dharamshala Escorts ☎️9352988975 Two shot with one g...
 
Editorial design Magazine design project.pdf
Editorial design Magazine design project.pdfEditorial design Magazine design project.pdf
Editorial design Magazine design project.pdf
 
💫✅jodhpur 24×7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...
💫✅jodhpur 24×7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...💫✅jodhpur 24×7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...
💫✅jodhpur 24×7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...
 
Hire 💕 8617697112 Meerut Call Girls Service Call Girls Agency
Hire 💕 8617697112 Meerut Call Girls Service Call Girls AgencyHire 💕 8617697112 Meerut Call Girls Service Call Girls Agency
Hire 💕 8617697112 Meerut Call Girls Service Call Girls Agency
 

Challenges in Designing a Menu System with Touch-less Technology

  • 1. CHALLENGES IN DESIGNING A MENU SYSTEM WITH DEPTH MOTION SENSOR TECHNOLOGY Shachar Oz Game & UX Designer Omek Interactive Studios © Omek Interactive, Ltd. All rights reserved.
  • 2. MENUS ARE FORGOTTEN ABOUT . OR, WHAT CAN DRIVE USERS CRAZY ? © Omek Interactive, Ltd. All rights reserved.
  • 3. © Omek Interactive, Ltd. All rights reserved.
  • 4. MENU SYSTEM DESIGN GUIDELINES • Confident users understand: – where they are – where they were – what can they do – how can they do it © Omek Interactive, Ltd. All rights reserved.
  • 5. 3D DEPTH SENSOR OR, WHAT IS IT ? © Omek Interactive, Ltd. All rights reserved.
  • 6. 3D DEPTH SENSOR OR, WHAT IS IT ? © Omek Interactive, Ltd. All rights reserved.
  • 7. TOUCH-BASED TECHNOLOGY © Omek Interactive, Ltd. All rights reserved.
  • 8. TOUCH-LESS TECHNOLOGY © Omek Interactive, Ltd. All rights reserved.
  • 9. TOUCH-LESS TECHNOLOGY © Omek Interactive, Ltd. All rights reserved.
  • 10. DEPTH MOTION CAPTURE  Body tracking × Tangible feedback  Natural gestures × 100% stability  Free from controllers × Accuracy © Omek Interactive, Ltd. All rights reserved.
  • 11. CHALLENGES OR, HOW TECHNOLOGY INFLUENCE DESIGN ? © Omek Interactive, Ltd. All rights reserved.
  • 12. CHALLENGES OF MOTION CAPTURE • Feeling of a click : virtual tangibility • Active & inactive modes • Am I in control ? • Inner delay of the interface © Omek Interactive, Ltd. All rights reserved.
  • 13. CHALLENGES OF MOTION CAPTURE • Feeling of a click • Active & inactive modes : differentiate between user behaviors • Am I in control ? • Inner delay of the interface © Omek Interactive, Ltd. All rights reserved.
  • 14. CHALLENGES OF MOTION CAPTURE • Feeling of a click • Active & inactive modes • Am I in control ? feedback for the users • Inner delay of the interface © Omek Interactive, Ltd. All rights reserved.
  • 15. CHALLENGES OF MOTION CAPTURE • Feeling of a click • Active & inactive modes • Am I in control ? • Inner delay of the interface : cannot predict the user © Omek Interactive, Ltd. All rights reserved.
  • 16. DEALING WITH CHALLENGES SELECTING AND SCROLLING ITEMS © Omek Interactive, Ltd. All rights reserved.
  • 17. Selecting Items • Click gesture : imitate mouse • Hot-spot • Grand gesture • Swipe in • Grab gesture © Omek Interactive, Ltd. All rights reserved.
  • 18. © Omek Interactive, Ltd. All rights reserved.
  • 19. Selecting Items • Click gesture • Hot-spot • Grand gesture : grandiose arm movement • Swipe in • Grab gesture © Omek Interactive, Ltd. All rights reserved.
  • 20. Selecting Items • Click gesture • Hot-spot • Grand gesture • Swipe in : continuous feedback • Grab gesture © Omek Interactive, Ltd. All rights reserved.
  • 21. Selecting Items • Click gesture • Hot-spot • Grand gesture • Swipe in • Grab gesture : pinch or fist © Omek Interactive, Ltd. All rights reserved.
  • 22. Selecting Items Gran Grab Click d ge Hot- Swip gest g estu sture sp e in ure ot re Responsiveness v x v v v Active & v x v ½ ½ inactive Stablilty x v v v ½ Comfortable ½ v x v v Usability v v x ½ ½ © Omek Interactive, Ltd. All rights reserved.
  • 23. Scrolling Items • 2D cursor : imitate mouse • 1D cursor • Static active spot • Dynamic active spot • Grand gesture © Omek Interactive, Ltd. All rights reserved.
  • 24. Scrolling Items • 2D cursor • 1D cursor : scroll on one axis • Static active spot • Dynamic active spot • Grand gesture © Omek Interactive, Ltd. All rights reserved.
  • 25. Scrolling Items • 2D cursor • 1D cursor • Static active spot : magnifying glass • Dynamic active spot • Grand gesture © Omek Interactive, Ltd. All rights reserved.
  • 26. Scrolling Items • 2D cursor • 1D cursor • Static active spot • Dynamic active spot : magnifying glass++ • Grand gesture © Omek Interactive, Ltd. All rights reserved.
  • 27. Scrolling Items • 2D cursor • 1D cursor • Static active spot • Dynamic active spot • Grand gesture : grandiose arm movements © Omek Interactive, Ltd. All rights reserved.
  • 28. Scrolling Items Gran Stati activ Dyna t 2D c 1D c d ge spot c act e spo sture urso urso mic ive r Responsiveness r v v ½ v v Active & v v x v v inactive Stablilty ½ v ½ v v Comfortable v ½ v ½ x Usability v v ½ v x © Omek Interactive, Ltd. All rights reserved.
  • 29. Pagination • Just another button: hot-spot / click • Grand gesture: Minority Report • Drag n’ drop: scroll the entire list © Omek Interactive, Ltd. All rights reserved.
  • 30. User Real Location • Camera view: what the camera sees? • B&W: grey scale colors • Freeze!: control over the character • Trapezoid: view playfield from up • Note over character: main area of concern © Omek Interactive, Ltd. All rights reserved.
  • 31. Feeling of a Click © Omek Interactive, Ltd. All rights reserved.
  • 32. CONCLUSIONS OR, WHAT DID WE LEARN ? © Omek Interactive, Ltd. All rights reserved.
  • 33. Conclusions • Tracking: essential constant feedback • Gesture: toggle action modes © Omek Interactive, Ltd. All rights reserved.
  • 34. Conclusions • Tracking: essential constant feedback • Gesture: toggle action modes © Omek Interactive, Ltd. All rights reserved.
  • 35. User Expectations • One hand based control scheme • Grandiose gestures only once in a while • Constant feedback for each movement © Omek Interactive, Ltd. All rights reserved.
  • 36. Depth Sensor Menu Design Guidelines • Consistency • Simplicity • Feeling of control • Feedback • Comfortable © Omek Interactive, Ltd. All rights reserved.
  • 37. Future Experiments • Sound based feedback (for blind) • Speech based / speech components © Omek Interactive, Ltd. All rights reserved.
  • 38. References • Frosted Glass / CAMPAR • EyeSight • Dance Central / Harmonix • Adrenaline Misfits / Konami • Omek Interactive Studios • Media Center / Primesense • PointGrab • Powerup Heroes / Ubisoft • Huang J., White R.W., Buscher G. (2012). User See, User Point: Gaze and Cursor Alignment in Web Search. CHI’12, May 5–10, 2012, Austin, Texas, USA © Omek Interactive, Ltd. All rights reserved.
  • 39. Thank You For Listening , Shachar Oz Game & UX Designer Omek Interactive Studios www.OmekInteractive.com Shachar@OmekInteractive.com

Notas del editor

  1. I work at studios of omekOutside you see my day jobI’m a uxNot about the game
  2. Menus are forgotten, Bad UI system can drive users crazy
  3. In order for users not be mad…
  4. In one look, at any time, the user understands:Where they areWhere they wereWhat can they doHow can they do it
  5. 5 minWhat is it? Sensor gives data of the distance from the camera per pixel. Bat like view of the worldDemo: video tracking viewerhttp://youtu.be/UGGKh3cyc7w?t=1m00s
  6. 5 minWhat is it? Sensor gives data of the distance from the camera per pixel. Bat like view of the worldDemo: video tracking viewerhttp://youtu.be/UGGKh3cyc7w?t=1m00s
  7. Keyboard, push buttonsJoystickMouseTouch screen
  8. Augmented realityVoice recognitionFace recognitionEye tracking (gaze)Brain-wave controlDepth motion capture
  9. Augmented realityVoice recognitionFace recognitionEye tracking (gaze)Brain-wave controlDepth motion capture
  10. Gives:Body tracking: 3D position and rotationNatural gestures: body languageFree from controllers: wet hands, accessibility Not give: Tangibility feedback100% stable & responsiveness (not yet)Small & accurate action square: 10cm X 10cm (Windows mouse)
  11. 5 min
  12. I can touch a button and still it will not do anything. I know when I am going to press a button. No errors.I can make the movement of clicking even without clicking. No errors.We want to create a no error environment for that tech as well.What is the amount of feedback we should give, to create the virtual tangibility?
  13. User research shows 4 main types of actions with cursor: inactive, reading, action (click/ scroll ..), examineWith mouse you have accurate control of cursor. Again no errors.How can we know when the user wants to select or just to look at items?
  14. Confidence How do we give the user the feeling that the application knows their identity and position?Where are they at? Does the app recognize them? Does it understand what the user is trying to do?
  15. The app cannot predict what the user wants to do. It tracks movement.Therefore there is always a small delay between the user decision to make an action, and the gesture itself. We need to design the feedback to be as quick as possible or to be combined with the user’s motion.
  16. Click : imitate the mouse, move a cursor across the screen and push hand forward to select. Remember position before a few framesProblem: Non detectableBig movement relative to the sourcehttp://youtu.be/VLzHtsRgEBY?t=1m 1:00-1:20
  17. 2. Hot spot : stand and wait……..We don’t like waiting! Web development, ui design, etc. Problem: not differentiate between selection and scrolling. Kinect hub emphasized that difference by starting the selection process only after the cursor is above the item and not moving. This caused even more delay in the selection processKinect menu 0:39 http://vimeo.com/16779301
  18. 3. Significant gesture : body as a keyboard. Problem:uncomfortable and unusable Need trainingExamples:Adrenaline Misfits / Konami : (gesture based menu) http://youtu.be/vA6xfK7bl94?t=2m10s http://youtu.be/UGGKh3cyc7w?t=2m45s
  19. 4. Tracking based : swipe gesture with constant feedback for the process and option to cancel at any point.Problems:Differentiate between 2 modes.Needed to be taught.Examples:Fruit Ninja / Microsofthttp://www.youtube.com/watch?NR=1&feature=fvwp&v=yeu9qOEUJ-gPowerup Heroes / Ubisoft: (improved Dance Central’s UI)http://www.youtube.com/watch?v=3WWyLuAZKjUOption 2- http://youtu.be/ZBh_1cO9EeE?t=1m50s
  20. 5. Grab gesture : relatively Intuitive. Grab gesture (drag n drop).Problems:Not that stable.Too accurate.requires high quality camera data, and currently to stand close to camera. Examples:http://www.youtube.com/watch?v=W6eSUJFSRaA/*http://www.youtube.com/watch?v=NKjkQLxwTekhttp://www.youtube.com/watch?v=itmfARsVx5w
  21. More ways:Wave gestureCircle gestureRelease (pull hand back) Move to a special spot
  22. Move cursor freely : imitating mouse. Normal guiProblem:unstable. Delay.Simple solutions:Big buttons. Relatively large movements.Stabling the cursor. Centering it to the item.Examples:HotSpot_item
  23. Tracking based : cursor marked slightly (solve some navigation). Constant feedback. Constant active item.Leave menu from top or bottom.Examples:Powerup heroes
  24. No cursor. Main active spot :Scroll on one axis.Problem:navigation issue (where am i?). Slow reactionExamples:Media center live
  25. When click, stable cursorExample:Jinni live or video 0:40
  26. No cursor, gesture basedExamples:Adrenaline misfitsPanasonic demoMedia Center / Canesta http://youtu.be/3pekrVJU_hg?t=2m40s
  27. Simple button: hot-spot / clickSignificant gesture:Minority ReportDrag n’ drop
  28. Cursor: what if camera doesn’t work? Or user not identified?Camera view: what the camera sees?B&W: grey scale colorsFreeze!: control over the characterTrapezoid: view playfield from upNote over character: main area of concern
  29. Examples:http://youtu.be/jORsG8AG72I?t=1m50s
  30. 4 min
  31. Constant feedback about cursor, selection progress & physical locationTracking based methods  more stable, comfortable, usable  constant feedback Gesture based selection  faster, show serious timeShowing a cursor  not a must
  32. Constant feedback about cursor, selection progress & physical locationTracking based methods  more stable, comfortable, usable  constant feedback Gesture based selection  faster, show serious timeShowing a cursor  not a must
  33. User expectations:One hand based control schemeGrandiose gestures only once in a whileConstant feedback for each movement: physical, joint
  34. Back to basics:Consistency:Do not change model of controlSimplicity:Do not use 2 models of controldo not use more than 1 handEasily understand the scale and the modelFeeling of control:Physically comfortable for the userEmotionally comfortable for the userOption to cancel & undoAble to wander around without false actions. Allow user to think and play without errorsFeedback:Make sure the user get the adequate feedback for the his actions