Sciweavers

Share
ICMI
2005
Springer

Probabilistic grounding of situated speech using plan recognition and reference resolution

10 years 2 months ago
Probabilistic grounding of situated speech using plan recognition and reference resolution
Situated, spontaneous speech may be ambiguous along acoustic, lexical, grammatical and semantic dimensions. To understand such a seemingly difficult signal, we propose to model the ambiguity inherent in acoustic signals and in lexical and grammatical choices using compact, probabilistic representations of multiple hypotheses. To resolve semantic ambiguities we propose a situation model that captures aspects of the physical context of an utterance as well as the speaker’s intentions, in our case represented by recognized plans. In a single, coherent Framework for Understanding Situated Speech (FUSS) we show how these two influences, acting on an ambiguous representation of the speech signal, complement each other to disambiguate form and content of situated speech. This method produces promising results in a game playing environment and leaves room for other types of situation models. Categories and Subject Descriptors: I.2.7 [Artificial Intelligence]: Natural Language Processing G...
Peter Gorniak, Deb Roy
Added 27 Jun 2010
Updated 27 Jun 2010
Type Conference
Year 2005
Where ICMI
Authors Peter Gorniak, Deb Roy
Comments (0)
books