An Interactive Mixed Reality Framework for Virtual Humans

13 years 11 months ago
An Interactive Mixed Reality Framework for Virtual Humans
In this paper, we present a simple and robust Mixed Reality (MR) framework that allows for real-time interaction with Virtual Humans in real and virtual environments under consistent illumination. We will look at three crucial parts of this system: interaction, animation and global illumination of virtual humans for an integrated and enhanced presence. The interaction system comprises of a dialogue module, which is interfaced with a speech recognition and synthesis system. Next to speech output, the dialogue system generates face and body motions, which are in turn managed by the virtual human animation layer. Our fast animation engine can handle various types of motions, such as normal key-frame animations, or motions that are generated on-the-fly by adapting previously recorded clips. All these different motions are generated and blended on-line, resulting in a flexible and realistic animation. Our robust rendering method operates in accordance with the previous animation layer, b...
Arjan Egges, George Papagiannakis, Nadia Magnenat-
Added 10 Jun 2010
Updated 10 Jun 2010
Type Conference
Year 2006
Where CW
Authors Arjan Egges, George Papagiannakis, Nadia Magnenat-Thalmann
Comments (0)