Face as Mouse Through Visual Face Tracking

13 years 10 months ago

Download users.soe.ucsc.edu

This paper introduces a novel camera mouse driven by 3D model based visual face tracking. While camera becomes standard conﬁguration for personal computer(PC) and computer speed becomes faster and faster, achieving human machine interaction through visual face tracking becomes a feasible solution to hand-free control. The human facial movement can be decomposed into rigid motions including rotation and translation, and non-rigid motions, such as the open,close and stretch of mouth. We introduce our visual face tracking system that can robustly and accurately retrieve these motion parameters from video at real-time. The retrieved head orientation parameters can be employed to navigate the mouse cursor, and the detection of mouth motions triggers mouse events. 3 mouse control modes are investigated. Their usability are compared. Experiments in Windows XP environment veriﬁes the convenience of our camera mouse driven by head and facial motion. This technique can be an alternative inp...

Jilin Tu, Thomas S. Huang, Hai Tao

Real-time Traffic