Mobile Camera-Based User Interaction

We present an approach for facilitating user interaction on mobile devices, focusing on camera-enabled mobile phones. A user interacts with an application by moving their device. An on-board camera is used to capture incoming video and the scrolling direction and magnitude are estimated using a feature-based tracking algorithm. The direction is used as the scroll direction in the application, and the magnitude is used to set the zoom level. The camera is treated as a pointing device and zoom level control in applications. Our approach generates mouse events, so any application that is mouse-driven can make use of this technique.

• Type: Conference
• Year: 2005
• Where: ICCV
• Authors: Antonio Haro, Koichi Mori, Tolga K. Çapin, Stephen Wilkinson
• Keywords: Camera-enabled Mobile Phones, Computer Vision, Feature-based Tracking Algorithm, ICCV 2005, Zoom Level