Sciweavers

Share
HCI
2009

A Modality Replacement Framework for the Communication between Blind and Hearing Impaired People

11 years 3 months ago
A Modality Replacement Framework for the Communication between Blind and Hearing Impaired People
This paper presents a multimodal framework for the communication between blind and hearing impaired people. The algorithms that are developed are based on the concept of modality replacement, which is the use of information originating from various modalities to compensate for the missing input modality of the system or the users. Spatial information is conveyd in the blind user's terminal through the haptic modality utilizing an efficient haptic rendering scheme, while verbal information is presented in the hearing impaired user's terminal through sign language synthesis. All technologies are integrated in a virtual treasure hunting game, where a blind and a hearing impaired user have to collaborate so as to navigate in the virtual environment and solve the riddle of the game. Usability evaluation of this framework has shown significant impact of the proposed system for the disabled users.
Konstantinos Moustakas, Dimitrios Tzovaras, Laila
Added 18 Feb 2011
Updated 18 Feb 2011
Type Journal
Year 2009
Where HCI
Authors Konstantinos Moustakas, Dimitrios Tzovaras, Laila Dybkjær, Niels Ole Bernsen
Comments (0)
books