A list of important academic conferences for gesture based interaction, and a summary of 4 papers about gestures on different screen size.

1. Multi(Touch) Gesture Research
Lecture: Journal Club – spring 2010
Florian Weil
University of Art Linz – Master: Interface Culture

2. Questions
● Which differences exist in gesture
interaction on different screen sizes?
● How is the research community for gesture
interaction organized?
● Which conferences exist?
● Who are the key researcher and other important
researcher?

3. Different screenformats - Small
Small Screens
Smart Phones

4. Different screenformats - Medium
Netbooks
Tablet PCs

5. Different screenformats - Large
MultiTouch Displays TableTop Displays

6. Different screenformats – extra large
Touch Walls

7. Researcher & People
● Explored
● Keynote and Opening Speakers
● Reviewer Lists
● Papers
● Could not find key roles
● Good balance of academic (University) and
economic driven research (Microsoft etc.)

8. Conferences & Community
● Computer Human Interaction (CHI)
● Interactive Tapletop and Surfaces (ITS)
● Tangible, Embedded, and Embodied Interaction (TEI)
● Gesture Workshop (GW)

9. Computer Human Interaction (CHI)
● Big and general conference about Human and Computer Interaction
● Special Session about surfaces and tabletop Interaction → with
gesture interaction
● Organizer
● Georgia Institute of Technology
● Brigham Young University
● Microsoft Research / University of Washington
● Place
● Mainly USA and Canada, sometimes Europe
● Atlanta, Boston, Florence, San Jose, Montreal...

10. Tangible, Embedded, and
Embodied Interaction (TEI)
● Medium big conference on Tangible, Embedded, and Embodied
Interaction.
● Very good for gesture research for tangible devices.
● Sponsors:
● Nokia, Microsoft Research, Philips, Fraunhofer, ACM, SIGCHI
● Place:
● Europe and North America
● Portugal, USA, UK, Germany, ...

11. Interactive Tapletop and Surfaces
● Medium and pretty young conference (started 2006) with focus on
interaction design in connection with surfaces and tabletop systems,
like reactable
● Very good for research in (multiTouch) gesture interaction
● Organizer:
● Sriram Subramanian, University of Bristol, UK
● Antonio Krüger (DFKI GmbH)
● And other...
● Place:
● Very often in Europe
● Saarbrücken, Banff, Amsterdam, Newport

12. Gesture Workshop
● Small conference / workshop with focus on gesture interaction
in general
● Mostly focus on free form and auditive gestures
● Organizer
● University Bielefeld, Adetti, University of South Brittany, …
● Place
● Only in Europe
● Bielefeld, Lisbon, Ile de Berder, Genova, London, ...

13. Researched Papers
Anne Roudaut, Eric Lecolinet and Yves Guiard, “MicroRolls: expanding touch-screen input vocabulary by
distinguishing rolls vs. slides of the thumb”, Proceedings of CHI 2009, Boston, MA, USA, 2009, pp. 927-
936.
.
Tom Moscovich and John F. Hughes, “Indirect mappings of multi-touch input using one and two hands”,
Proceedings of CHI 2008, Florence, Italy, 2008, pp. 1275-1284.
Chi Tai Dang, Martin Straub, Elisabeth André, “Hand distinction for multi-touch tabletop interaction”,
Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 101-108.
Mathias Frisch, Jens Heydekorn, Raimund Dachselt, “Investigating multi-touch and pen gestures for
diagram editing on interactive surfaces”, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 149-
156
Alexander Schick, Florian van de Camp, Joris Ijsselmuiden and Rainer Stiefelhagen, “Extending touch:
towards interaction with large-scale surfaces”, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp.
117-124.

14. Small Screen Gesture with Thumb
● http://www.youtube.com/watch?v=bfH0-OqgbLw
● Context: during movement, one hand interaction
● Categories: Drag, Swipe, Rubbing, MicroRolls
● Testings (10 people, Aged 23-28)
● MicroRoll 2x faster than contex menu UI
●
MicroRoll same as fast as easy Toolbar, faster than difficult toolbar
● MicroRoll Gesture itself:
● Robust and easy to learn
● Good perfomance (influenced by the position of the gesture)
● Good combination with TapTap, TapRoll, RollMark gestures

15. Medium screen: uni or bimanual gesture
●
Context: TableTop systems and Medium Screens
●
Motivation: investigate perfomance and the right task for uni and
bimanual gestures
● Approach: Testing the commands align, positioning, rotation, scaling
of digital objects.
● Result:
● Unimanual interaction for visual rotation, transporting, rotating,
and stretching
● Bimanual interaction for control of two individual (control) points
(example tasks: window manipulation, image croping etc.)
● Perfomance differences are small, so the designer can safely
interchange between the two methods

16. TableTop Screen: Hand Distinction
●
Context: TableTop systems and Large Screens
●
Motivation: Distinguish one-hand and two-hand gestures
improves gesture systems
● more stable and accurated gesture recognition
● avoiding of conflicts in multi-user systems
● Approach: use the anatomy information of the user hand and
combine them with touch point and finger orientation data.
● Result:
● Average: 96% successfully hand recognition
● Thumb need a more detail observation
● Heuristic formular works fine, but constant values needs
improvements

17. TableTop Screen: Hand Distinction
Source: Chi Tai Dang, Martin Straub, Elisabeth André, “Hand distinction for multi-touch tabletop interaction”,
Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 101-108.

18. Large Screen Gesture via Pointing
● http://www.youtube.com/watch?v=cV60gwiM5HM
● Context: Big static screen, some objects are not reachable
● Categories: Pointing and Touch gestures
● Seamlessly direct object manipulation with pointing and touch
●
User test results:
● User think it is a very useful extension
● Very intuitiv and easy learning interaction
● Objects are easier to reach and less exhausting compared to
touch-only systems
● User did not really use these two interactions for the same task