Visual Interaction With Lifelike Characters

10 years 3 months ago
Visual Interaction With Lifelike Characters
This paper explores the use of fast, simple computer vision techniques to add compelling visual capabilities to social user interfaces. Social interfaces involve the user in natural dialog with animated, "lifelike" characters. However, current systems employ spoken language as the only input modality. Used effectively, vision can greatly enhance the user's experience interacting with these characters. In addition, vision can provide key information to help manage the dialog and to aid the speech recognition process. We describe constraints imposed by the conversational environment and present a set of "interactive-time" vision routines that begin to support the user's expectations of a seeing character. A control structure is presented which chooses among the vision routines based on the current state of the character, the conversation, and the visual environment. These capabilities are beginning to be integrated into the Persona lifelike character projec...
Matthew Turk
Added 07 Aug 2010
Updated 07 Aug 2010
Type Conference
Year 1996
Where FGR
Authors Matthew Turk
Comments (0)