Sciweavers

ESSLLI
2009
Springer

A Salience-Driven Approach to Speech Recognition for Human-Robot Interaction

13 years 1 months ago
A Salience-Driven Approach to Speech Recognition for Human-Robot Interaction
We present an implemented model for speech recognition in natural environments which relies on contextual information about salient entities to prime utterance recognition. The hypothesis underlying our approach is that, in situated human-robot interaction, speech recognition performance can be significantly enhanced by exploiting knowledge about the immediate physical environment and the dialogue history. To this end, visual salience (objects perceived in the physical scene) and linguistic salience (previously referred-to objects within the current dialogue) are integrated into a single cross-modal salience model. The model is dynamically updated as the environment evolves, and is used to establish expectations about uttered words which are most likely to be heard given the context. The update is realised by continously adapting the word-class probabilities specified in the statistical language model. The present article discusses the motivations behind our approach, describes our imp...
Pierre Lison
Added 17 Feb 2011
Updated 17 Feb 2011
Type Journal
Year 2009
Where ESSLLI
Authors Pierre Lison
Comments (0)