In this paper, we describe a novel concept for motivating users to explore applications using natural user interfaces in the automotive domain. Based on prior findings, it can be very hard for users to detect opportunities of action in such systems. Additionally, traditional “did you know?” hints seem to be ignored by many users today. As a countermeasure, we describe an approach that shall motivate users to explore natural user interfaces by using game elements. By awarding the user with badges and experience level-ups, we hope to create a stronger motivation that is at least maintained until the user is used to the system.

1. Distributed Multimodal Information Processing Group Technische Universität München
Gamification-supported Exploration
of Natural User Interfaces
Stefan Diewald1, Andreas Möller1, Luis Roalter1, Matthias Kranz2
1Technische
Universität München, Germany
2Luleå University of Technology, Department of Computer Science,
Electrical and Space Engineering, Luleå, Sweden
October 17, 2012
2nd
Workshop on Automotive Natural User Interfaces (AutoNUI) at the 4th International Conference on
Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI), Portsmouth, NH, USA

2. Distributed Multimodal Information Processing Group Technische Universität München
Starting Situation: Complex Automotive User Interfaces
Finding a desired functionality can be very
time and attention-consuming.
Image sources: Wikimedia Commons; http://www.e31.net/pics/Bordcomputer.jpg; http://www.auto123.com/ArtImages/102556/BMW_I_drive_i2.jpg;
17.10.2012 Stefan Diewald 2

3. Distributed Multimodal Information Processing Group Technische Universität München
Countermeasure: Natural User Interfaces
Natural User Interfaces:
§ Multi-touch
§ Gestures
§ Voice dialogs
§ …
Less distraction and better user
experience?
Image sources: http://www.autoguru.at/wp-content/uploads/2012/03/audi_multitouch_11.jpg;
http://www.bmw.com/com/en/insights/technology/technology_guide/articles/_shared/img/voice_control_system.jpg
17.10.2012 Stefan Diewald 3

4. Distributed Multimodal Information Processing Group Technische Universität München
“Natural user interfaces are not natural”
“None of these systems is inherently more natural than the others.”
“Speech utterances will have to be learned and gestures carefully developed and
standardized through time.”
Donald A. Norman. 2010. Natural user interfaces are not natural. interactions 17, 3 (May 2010), 6-10.
17.10.2012 Stefan Diewald 4

5. Distributed Multimodal Information Processing Group Technische Universität München
DriveAssist – Driver Assistance and Awareness System
§ Runs on mobile devices (Android smartphones and tablet PCs)
§ Multi-touch for interacting with the map view
17.10.2012 Stefan Diewald 5

6. Distributed Multimodal Information Processing Group Technische Universität München
DriveAssist – Driver Assistance and Awareness System
17.10.2012 Stefan Diewald 6

7. Distributed Multimodal Information Processing Group Technische Universität München
Interaction problems with DriveAssist
First test:
§ difficulties in exploring touch menus
§ unaware of gestures: e.g. “pinch-to-zoom” & rotation
17.10.2012 Stefan Diewald 7

8. Distributed Multimodal Information Processing Group Technische Universität München
“Did you know?”-hints for DriveAssist
12 participants
45
minutes
only 7 and only 1
did notice the hint found the hint useful
17.10.2012 Stefan Diewald 8

9. Distributed Multimodal Information Processing Group Technische Universität München
The Challenge
Create a strong motivation for exploring natural user interfaces
in the automotive domain:
§ Uncover hidden functions
§ Make usage more comfortable
17.10.2012 Stefan Diewald 9

10. Distributed Multimodal Information Processing Group Technische Universität München
The Idea: 1 - Gamification
… the use of game design elements in
non-game contexts.
Sebastian Deterding et al. 2011. From game design elements to gamefulness: defining "gamification".
In Proceedings of the 15th International Academic MindTrek Conference. ACM, New York, NY, USA, 9-15.
17.10.2012 Stefan Diewald 10

11. Distributed Multimodal Information Processing Group Technische Universität München
Gamification Example
Image sources: http://aboutfoursquare.com/wp-content/uploads/2011/03/photo-11.png; http://cdn3.techworld.com/cmsdata/reviews/3210966/
foursquare_badges_360.jpg;
17.10.2012 Stefan Diewald 11

12. Distributed Multimodal Information Processing Group Technische Universität München
The Idea: 2 - Share and Compare
Image sources: http://www.uplaude.com/blog/; Wikimedia Commons; Nike+
17.10.2012 Stefan Diewald 12

13. Distributed Multimodal Information Processing Group Technische Universität München
Gamification in the Automotive Domain
MyFord – collect badges online. Chevy Volt – dashboard
gamification for efficient driving.
17.10.2012 Stefan Diewald 13

14. Distributed Multimodal Information Processing Group Technische Universität München
Gamification-supported Exploration of NUIs
One-time badges
Experience Levels
For more common functions.
For less known and less
accessed functions.
17.10.2012 Stefan Diewald 14

15. Distributed Multimodal Information Processing Group Technische Universität München
What can be gained?
…
x1
Open the windows Enter a navigation Change the
through voice target via handwriting chassis
control. recognition. configuration via …
voice control.
17.10.2012 Stefan Diewald 15

16. Distributed Multimodal Information Processing Group Technische Universität München
When to award a Badge or Level-up?
17.10.2012 Stefan Diewald 16

17. Distributed Multimodal Information Processing Group Technische Universität München
How to award a Badge or Level-up?
Congratulations, you have just unlocked the
“navigation target badge” by entering your
destination via voice control.
17.10.2012 Stefan Diewald 17

18. Distributed Multimodal Information Processing Group Technische Universität München
“Share and Compare”
Share new badges and experience
level-ups directly with friends in
real time.
Image sources: http://2.bp.blogspot.com/-77IL5MZo1mQ/UDIpMenIf2I/AAAAAAAAPLg/szq3N3Iyj1Y/s1600/Tank.jpg
17.10.2012 Stefan Diewald 18

19. Distributed Multimodal Information Processing Group Technische Universität München
The Goal
Create a strong motivation for exploring natural user interfaces
in the automotive domain,
… that is at least maintained until the user is used to the system.
17.10.2012 Stefan Diewald 19

20. Distributed Multimodal Information Processing Group Technische Universität München
Future Work
17.10.2012 Stefan Diewald 20

21. Distributed Multimodal Information Processing Group Technische Universität München
Thank you for your attention!
Questions?
?
?
stefan.diewald@tum.de
www.vmi.ei.tum.de/team/stefan-diewald.html
Oct 15, 2012 A. Möller, S. Diewald, L. Roalter, M. Kranz 21

22. Distributed Multimodal Information Processing Group Technische Universität München
Paper Reference
• Please find the associated paper at:
https://vmi.lmt.ei.tum.de/publications/2012/GamificationNUI_preprint.pdf
• Please cite this work as follows:
• Stefan Diewald, Andreas Möller, Luis Roalter, Matthias Kranz. 2012.
Gamification-supported Exploration of Natural User Interfaces
In: Adjunct Proceedings of the 4th International Conference on Automotive
User Interfaces and Interactive Vehicular Applications (AutomotiveUI2012),
pp. 47-48, Portsmouth NH, USA, October 2012
Oct 15, 2012 A. Möller, S. Diewald, L. Roalter, M. Kranz 22

23. Distributed Multimodal Information Processing Group Technische Universität München
If you use BibTex, please use the following entry
to cite this work:
@INPROCEEDINGS{NUIGamification2012,
author = {Stefan Diewald and Andreas M"{o}ller and Luis Roalter and Matthias Kranz},
title = {{Gamification-supported Exploration of Natural User Interfaces}},
booktitle = {{Adjunct Proceedings of the 4th International Conference on
Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI 2012)}},
year = {2012},
month = oct,
pages = {47--48},
location = {Portsmouth NH, USA},
}
Oct 15, 2012 A. Möller, S. Diewald, L. Roalter, M. Kranz 23