Sciweavers

29 search results - page 1 / 6
» Semantics-based Representation for Multimodal Interpretation...
Sort
View
COLING
2002
13 years 4 months ago
Semantics-based Representation for Multimodal Interpretation in Conversational Systems
To support context-based multimodal interpretation in conversational systems, we have developed a semantics-based representation to capture salient information from user inputs an...
Joyce Y. Chai
JAIR
2006
128views more  JAIR 2006»
13 years 4 months ago
Cognitive Principles in Robust Multimodal Interpretation
Multimodal conversational interfaces provide a natural means for users to communicate with computer systems through multiple modalities such as speech and gesture. To build effect...
Joyce Yue Chai, Zahar Prasov, Shaolin Qu
IVA
2010
Springer
13 years 3 months ago
Multimodal Backchannels for Embodied Conversational Agents
One of the most desirable characteristics of an Embodied Conversational Agent (ECA) is the capability of interacting with users in a human-like manner. While listening to a user, a...
Elisabetta Bevacqua, Sathish Pammi, Sylwia Julia H...
EMNLP
2008
13 years 6 months ago
Incorporating Temporal and Semantic Information with Eye Gaze for Automatic Word Acquisition in Multimodal Conversational System
One major bottleneck in conversational systems is their incapability in interpreting unexpected user language inputs such as out-ofvocabulary words. To overcome this problem, conv...
Shaolin Qu, Joyce Yue Chai
EACL
2006
ACL Anthology
13 years 6 months ago
Edit Machines for Robust Multimodal Language Processing
Multimodal grammars provide an expressive formalism for multimodal integration and understanding. However, handcrafted multimodal grammars can be brittle with respect to unexpecte...
Srinivas Bangalore, Michael Johnston