Content and hierarchy in pixel-based methods for reverse engineering interface structure
Content and hierarchy in pixel-based methods for reverse engineering interface structure
复制标题
基于像素的逆向工程界面结构方法中的内容和层次结构
DOI:
10.1145/1978942.1979086
复制
发表时间:
2011
期刊:
影响因子:
--
通讯作者:
J. Fogarty
中科院分区:
文献类型:
--
作者:
M. Dixon;Danielle Leventhal;J. Fogarty
The rigidity and fragmentation of GUI toolkits are fundamentally limiting the progress and impact of interaction research. Pixel-based methods offer unique potential for addressing these challenges independent of the implementation of any particular interface or toolkit. This work builds upon Prefab, which enables the modification of existing interfaces. We present new methods for hierarchical models of complex widgets, real-time interpretation of interface content, and real-time interpretation of content and hierarchy throughout an entire interface. We validate our new methods through implementations of four applications: stencil-based tutorials, ephemeral adaptation, interface translation, and end-user interface customization. We demonstrate these enhancements in complex existing applications created from different user interface toolkits running on different operating systems.