Sciweavers

Share
CHI
2010
ACM

Prefab: implementing advanced behaviors using pixel-based reverse engineering of interface structure

10 years 11 months ago
Prefab: implementing advanced behaviors using pixel-based reverse engineering of interface structure
Current chasms between applications implemented with different user interface toolkits make it difficult to implement and explore potentially important interaction techniques in new and existing applications, limiting the progress and impact of human-computer interaction research. We examine an approach based in the single most common characteristic of all graphical user interface toolkits, that they ultimately paint pixels to a display. We present Prefab, a system for implementing advanced behaviors through the reverse engineering of the pixels in graphical interfaces. Informed by how user interface toolkits paint interfaces, Prefab features a separation of the modeling of widget layout from the recognition of widget appearance. We validate Prefab in implementations of three applications: target-aware pointing techniques, Phosphor transitions, and Side Views parameter spectrums. Working only from pixels, we demonstrate a single implementation of these enhancements in complex existing...
Morgan Dixon, James Fogarty
Added 17 May 2010
Updated 17 May 2010
Type Conference
Year 2010
Where CHI
Authors Morgan Dixon, James Fogarty
Comments (0)
books