UX Fellows Gesture Study 2013

Thumbs up to natural gesture
interfaces?
Kelly Goto & Michael Wörmann
UXPA Conference 2013
Washington DC

Introducing UX Fellows
● Worldwide user experience research
● 23 partner companies
● Joint quality levels and processes
● UX expertise + local culture expertise

High quality UX research in 35+ countries

Introducing gotomedia
● San Francisco, California
● Contextual research
● Iterative prototyping and
testing
● Responsive, multi-device
experiences

Introducing Facit Digital
● Munich, Germany
● Qual and quant UX
research & consulting
● ITV, desktop & mobile
UX
● Specialized lab facilities

C: I like!
B: I guess I ate
something wrong
A: I think I need to
see a dentist
D: That meal is
really tasty
What are these people trying to tell us?
D: That meal is
really tasty

Freehand gesture technology is entering
our lives

Pointing gestures and semantic gestures

Semantic gestures
● Gestures with an associated meaning
● No need for an additional GUI
● Potentially more efficient
Challenges
● Presumably influenced by local cultures
● Some cultures might be more predisposed to the use of
gestures than othersSemantic gesture for
mission control on a
Mac

The UX Fellows Gesture Study
Which semantic gestures would people
from various cultures spontaneously use
to control consumer electronic devices?
● Country differences?
● Country clusters?
● Underlying metaphors?
● Acceptance?

We compared spontaneous gesture
behavior in 18 countries.
RU
CN
IN
AU
AR
CA
US
MX
ES
FR
UK
IT
FI
DE
NL
BE
KRTR

Setting
15 min
Warm-up: everyday gestures

Examined Commands
Switch on device
Volume up
Channel up
Context info for current program
Channel down
Share current program
Volume down
Mute volume
Pause current program
Homepage
EPG
backward navigation in menus
Confirm on-screen dialog (OK)
Deny on-screen dialog (cancel)
Pause video-on-demand (VOD)
Restart VOD
Fast forward VOD
Rewind VOD
Skip chapter VOD
Previous chapter VOD
Stop VOD
Switch off device
P+
P-

Sample
Persons who are able to imagine a gesture-control scenario for a TV.
● Regular usage of a recent HD flat TV (max. 5-6 years of age) and
other CE devices and services
● High interest in consumer electronics
● Regular usage of a touch device
● No Xbox Kinect and gesture-enabled TV users
● Potential buyers of international "premium" CE brands
(no national, retailer or "no name" brands)

Sample
sample
socio-economic
background
country

Sample
51%49%
16
65 years
32
18 countries
x 20 subjects
= 360 participants
min
max
mean

Commonality of gestures
0
2
4
6
8
10
12
14
16
18
no. of countries with the same main gesture
no.ofcountries
high medium low

Commands with high commonality
Volume down
Volume up
Pause VOD
Rewind VOD
Fast forward VOD

Volume down
Volume up
Pause VOD
Rewind VOD
Fast forward VOD
Commonality 18 of 18
Difficulty (1-5) 1.8
Q: How do you turn down the volume?

Volume down
Volume up
Pause VOD
Rewind VOD
Fast forward VOD
Q: How do you turn up the volume?

Volume down
Volume up
Pause VOD
Rewind VOD
Fast forward VOD
NL
Q: How do you pause viewing a film?

Volume down
Volume up
Pause VOD
Rewind VOD
Fast forward VOD
NL
Q: How would you pause the current TV program?

Volume down
Volume up
Pause VOD
Rewind VOD
Fast forward VOD
AU, UK
NL
Q: How do you rewind? (with an image being shown)

Volume down
Volume up
Pause VOD
Rewind VOD
Fast forward VOD
AU, UK
NL
Q: You are watching a boring scene, how do you fast-forward (with an image being shown)?

Volume down
Volume up
Pause VOD
Rewind VOD
Fast forward VOD
CN, IT, KR
Q: You have chosen a film from an online video library. The TV asks you "do you really want to buy the film?" How do you answer "yes"?

Commands with medium commonality
Channel up
Channel down
Stop VOD
Mute volume
Skip chapter VOD

Channel up
Channel down
Stop VOD
Mute volume
Skip chapter VOD
P+
AU, ES, KR, US
CA
Q: You are zapping through the TV programs: How do you change from channel 15 to channel 16 for example?

Channel up
Channel down
Stop VOD
Mute volume
Skip chapter VOD
AU, ES, KR, UK, US
CA
P-
Q: You are zapping through the TV programs: How do you change from channel 16 to channel 15 for example?

Channel up
Channel down
Stop VOD
Mute volume
Skip chapter VOD
CN, KR
FI, RU
NL
Q: How would you stop watching the film altogether (because you want to do something different)?

Channel up
Channel down
Stop VOD
Mute volume
Skip chapter VOD
AU, CN, MX
BE
UK
FI, RU
Q: How do you set the volume to "mute"?

Channel up
Channel down
Stop VOD
Mute volume
Backward navigation in menus
Skip chapter VOD
AU, BE, CA
AR, RU
ES, MX, US
Q: Imagine that you were looking for a film in an online video library. You have gone to the comedies section and have chosen the description of a
single movie. Now you want to return to the previous set of options (all of the comedies). Which gesture would you use for that?

Channel up
Channel down
Stop VOD
Mute volume
Skip chapter VOD
AU, CN, RU, TR
KR
AR, BE, IT, MX
Q: How do you express that you don’t want to buy it?
Commonality 9 of 18

Channel up
Channel down
Stop VOD
Mute volume
Skip chapter VOD
BE, CN, ES, FI, FR, IN, MX, UK
NL
Q: How would you skip to the next chapter of the film?
Commonality 9 of 18

Commands with low commonality
Switch on device
Switch off device
Restart VOD
EPG
Homepage

Switch on device
Switch off device
Restart VOD
EPG
Homepage
BE, FR, US
KR
DE, IT
TR
CNCA
FI
Q: How would you switch on the TV?
Commonality 8 of 18

Switch on device
Switch off device
Restart VOD
EPG
Homepage
ES, MX, NL
CA
IN, KR
RU
AR TR
Q: How would you switch off the TV? Note: No common gesture in Italy
Commonality 7 of 18

Switch on device
Switch off device
Restart VOD
EPG
Homepage
BE, CN, ES, FI, FR,
MX, NL
UK
IN, US
Q: How would you return to the previous chapter of the film?
Commonality 8 of 18

Switch on device
Switch off device
Restart VOD
EPG
Homepage
AU, ES, KR, MX AR, DE
BE
NL RU
US
Q: How do you start it (film) again? Note: No common gesture in UK
Commonality 7 of 18

Switch on device
Switch off device
Restart VOD
EPG
Homepage
CN, FR, IN
FI
AR, TR
MX
NL
KR
RU
US
Q: How would you share with your friends what you are currently watching or listening to? Note: No common gesture in UK
Commonality 6 of 18

Switch on device
Switch off device
Restart VOD
EPG
Homepage
AU, US
CN, FI, IN,
KR, RU
BE, UK TR
NL
MX
Q: You'd like to see an overview of tonight's TV programs of the main channels (EPG). How do you activate this function with a hand gesture?
Note: No common gesture in Italy
Commonality 5 of 18

Switch on device
Switch off device
Restart VOD
EPG
Homepage
FR, KR, RU
AU, FI
CN, IN, TR
AR
DE
BE
ES US
UK
Q: How would you get more information for the running TV program?
Commonality 4 of 18

Switch on device
Switch off device
Restart VOD
EPG
Homepage
AR, AU, MX
DENL, UK
FI
BE, IN
US
CA, ES, TR
Q: Now you want to go to the initial set of options - that means the first options you see when you switch on the device.
Note: No common gesture in Italy
Commonality 4 of 18

Direct vs. abstract gestures
We observed two kinds of gestures.
● "Direct" gestures
o strongly influenced by touch devices
● Abstract gestures
o basis in language, iconography and metaphors
o associated with more complex tasks
o lower intercultural commonality

Average gesture difficulty by country
1.0
1.5
2.0
2.5
3.0
TR FR MX AR IN FI CN RU NL DE AU US BE ES CA IT KR UK
Everyday gestures CE gestures
difficulty
min
max 5,0
…

Average gesture difficulty by country
1.0
1.5
2.0
2.5
3.0
FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR
CE gestures
difficulty
min
max 5,0
…

General acceptance
● Our 360 tech-savvy participants responded very positively to
the idea of semantic gesture input for TVs.
"fun to use", "convenient", "coolness factor"
● Participants would like to use gestures to control other
devices as well (e.g. audio).

Operation
Many participants felt that voice and sound could be a good
support for gesture input.
waking up the device with a sound
Can the TV
hear me?

Gesture type preference
FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR
Semantic
Pointing
Many users would prefer switching between gesture types.
FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Σ
Semantic                15
Pointing
FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Σ
Semantic                15
Pointing          9
associated
with more
advanced
commands

Typical concerns of users
● Learning and retention of gestures
(but: would be easy if based on implicit behavior repertory)
● Sensitivity and accuracy of devices
● Interference by other gestures in the room
● Compatibility with lean-back disposition

Conclusions
1. For basic CE commands a common language for semantic
gestures already exists across cultures.
2. More complex commands could be realized by either
a. customizing these gestures for each individual market
b. customizing individually
c. proposing a set of semantic gestures that need to be
learned (the study provides some suggestions)
d. switching to pointing gestures in combination with a GUI
3. It is necessary to consider cultural differences at a country
level when it comes to designing advanced gesture control
for globally marketed devices.

Thumbs up to the audience!
Find all results on www.uxfellows.com
Drop us a line: Michael.Woermann@facit-digital.com
Kelly@gotomedia.com

UX Fellows Gesture Study 2013

Recomendados

Recomendados

Más contenido relacionado

Destacado

Destacado (7)

Último

Último (20)

UX Fellows Gesture Study 2013