Sciweavers

Share
IJCNLP
2005
Springer

A Connectionist Model of Anticipation in Visual Worlds

8 years 10 months ago
A Connectionist Model of Anticipation in Visual Worlds
Recent “visual worlds” studies, wherein researchers study language in context by monitoring eye-movements in a visual scene during sentence processing, have revealed much about the interaction of diverse information sources and the time course of their influence on comprehension. In this study, five experiments that trade off scene context with a variety of linguistic factors are modelled with a Simple Recurrent Network modified to integrate a scene representation with the standard incremental input of a sentence. The results show that the model captures the qualitative behavior observed during the experiments, while retaining the ability to develop the correct interpretation in the absence of visual input.
Marshall R. Mayberry, Matthew W. Crocker, Pia Knoe
Added 27 Jun 2010
Updated 27 Jun 2010
Type Conference
Year 2005
Where IJCNLP
Authors Marshall R. Mayberry, Matthew W. Crocker, Pia Knoeferle
Comments (0)
books