An Architecture for Transforming Graphical Interfaces

While graphical user interfaces have gained much popularity in recent years, there are situations when the need to use existing applications in a nonvisual modality is clear. Examples of such situations include the use of applications on hand-held devices with limited screen space (or even no screen space, as in the case of telephones), or users with visual impairments. We have developed an architecture capable of transforming the graphical interfaces of existing applications into powerful and intuitive nonvisual interfaces. Our system, called Mercator, provides new input and output techniques for working in the nonvisual domain. Navigation is accomplished by traversing a hierarchical tree representation of the interface structure. Output is primarily auditory, although other output modalities (such as tactile) can be used as well. The mouse, an inherently visually-oriented device, is replaced by keyboard and voice interaction. Our system is currently in its third major revision. We h...

• Type: Conference
• Year: 1994
• Where: UIST
• Authors: W. Keith Edwards, Elizabeth D. Mynatt
• Keywords: Graphical Interfaces, Intuitive Nonvisual Interfaces, Nonvisual Interfaces, Software Engineering, UIST 1994