SmartCanvas: a gesture-driven intelligent drawing desk system

This paper describes SmartCanvas, an intelligent desk system that allows a user to perform freehand drawing on a desk or similar surface with gestures. Our system requires one camera and no touch sensors. The key underlying technique is a vision-based method that distinguishes drawing gestures and transitional gestures in real time, avoiding the need for “artificial” gestures to mark the beginning and end of a drawing stroke. The method achieves an average classification accuracy of 92.17%. Pie-shaped menus and a “rotateto-and-select” approach eliminate the need for a fixed menu display, resulting in an “invisible” interface. Categories and Subject Descriptors H.5.2 [Information Systems Applications]: User Interfaces—Input devices and strategies, Interaction styles; I.5.2 [Pattern Recognition]: Design Methodology—Classifier design and evaluation, Pattern analysis General Terms Algorithms, Human Factors Keywords Intelligent user interface, gesture recognition, Suppo...

• Type: Conference
• Year: 2005
• Where: IUI
• Authors: Zhenyao Mo, John P. Lewis, Ulrich Neumann
• Keywords: Gesture, IUI 2005, Key Underlying Technique, Software Engineering, Transitional Gestures