Developing intuitive interactive applications that are easy to maintain by developers is quite challenging, due to the complexity and the many technical aspects involved in such applications. In this article, we tackle the problem in two complementary ways. First, we propose a gestural interface to improve the user experience when interacting with applications that require the manipulation of 3D graphical scenes. Second, we reduce the complexity of developing such applications by modeling their executable behaviour using statecharts. We validate our approach by creating a modular and extensible Java framework for the development of in- teractive gesture-based applications. We developed a proof- of-concept application using this framework, that allows the user to construct and manipulate 3D scenes in OpenGL by using hand gestures only. These hand gestures are captured by the Kinect sensor, and translated into events and actions that are interpreted and executed by communicating statecharts that model the main behaviour of the interactive application.
Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Gi...
Statechart modeling of interactive gesture-based applications
1. Statechart modeling of interactive gesture-based applications
Statechart modeling of interactive
gesture-based applications
Romuald Deshayes Tom Mens
Software Engineering Lab
2010-2011
Deshayes Romuald – UMONS 1 / 20
2. Statechart modeling of interactive gesture-based applications
Table des matières
1 Problem Statement
2 Proof-of-concept application
3 Modeling interactive behaviour
4 Statechart models
5 The application framework
6 Conclusion and Future Work
Deshayes Romuald – UMONS 2 / 20
3. Statechart modeling of interactive gesture-based applications
Problem Statement
Outline : Problem Statement
Problem Statement
Deshayes Romuald – UMONS 3 / 20
4. Statechart modeling of interactive gesture-based applications
Problem Statement
Problem Statement
Challenge
Develop intuitive interactive applications that are easy to maintain
Why is it a challenge ?
Complex behaviour
Nondeterministic user actions
Same events lead to different actions
Contributions
Gestural user interface for 3D objects manipulation
Modeling executable behaviour using a visual formalism
Validation with an application framework
Deshayes Romuald – UMONS 4 / 20
13. Statechart modeling of interactive gesture-based applications
Statechart models
Statechart models - Scene
Deshayes Romuald – UMONS 13 / 20
14. Statechart modeling of interactive gesture-based applications
The application framework
Outline : The application framework
The application framework
Deshayes Romuald – UMONS 14 / 20
15. Statechart modeling of interactive gesture-based applications
The application framework
The application framework
Framework for developing interactive applications
Executable behaviour specified using statecharts
Client-server architecture
Deshayes Romuald – UMONS 15 / 20
16. Statechart modeling of interactive gesture-based applications
The application framework
The application framework II
Features
Generic
Abstract classes
Observer design pattern
Communication between statecharts
Uses Java SwingStates library
Deshayes Romuald – UMONS 16 / 20
18. Statechart modeling of interactive gesture-based applications
Conclusion and Future Work
Outline : Conclusion and Future Work
Conclusion and Future Work
Deshayes Romuald – UMONS 18 / 20
19. Statechart modeling of interactive gesture-based applications
Conclusion and Future Work
Conclusion and Future Work
Statecharts
Appropriate and scalable formalism for modeling the
interactive gesture-based behaviour ?
Improvements
Externalise/decouple statechart representation from framework
Compare statecharts with Petri nets
Deshayes Romuald – UMONS 19 / 20
20. Statechart modeling of interactive gesture-based applications
Conclusion and Future Work
Future Work II
Apply our approach to other HCI applications
Other types of natural interfaces
Compare/combine with other UIML
Controlled experiments, carry out user studies, empirical
studies
Deshayes Romuald – UMONS 20 / 20