Modeling multimodal integration patterns and performance in seniors: toward adaptive processing of individual differences

Multimodal interfaces are designed with a focus on flexibility, although very few currently are capable of adapting to major sources of user, task, or environmental variation. The development of adaptive multimodal processing techniques will require empirical guidance from quantitative modeling on key aspects of individual differences, especially as users engage in different types of tasks in different usage contexts. In the present study, data were collected from fifteen 66- to 86-year-old healthy seniors as they interacted with a map-based flood management system using multimodal speech and pen input. A comprehensive analysis of multimodal integration patterns revealed that seniors were classifiable as either simultaneous or sequential integrators, like children and adults. Seniors also demonstrated early predictability and a high degree of consistency in their dominant integration pattern. However, greater individual differences in multimodal integration generally were evident in t...

• Type: Conference
• Year: 2003
• Where: ICMI
• Authors: Benfang Xiao, Rebecca Lunsford, Rachel Coulston, R. Matthews Wesson, Sharon L. Oviatt
• Keywords: Adaptive Multimodal Processing, ICMI 2003, Multimodal Integration, Multimodal Integration Patterns