Content and hierarchy in pixel-based methods for reverse engineering interface structure

Content and hierarchy in pixel-based methods for reverse engineering interface structure
复制标题

基于像素的逆向工程界面结构方法中的内容和层次结构

DOI:
10.1145/1978942.1979086
复制
发表时间:
2011
期刊:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
影响因子:
--
通讯作者:
J. Fogarty
J. Fogarty
中科院分区:
--
文献类型:
--
作者:
M. Dixon;Danielle Leventhal;J. Fogarty

文献摘要

被引文献

相似文献

GUI工具包的僵化和分裂从根本上限制了相互作用研究的进步和影响。基于像素的方法为解决这些挑战提供了独特的潜力,而与任何特定界面或工具包的实现无关。这项工作建立在预制措施基础上,这可以修改现有接口。我们为复杂小部件的分层模型,接口内容的实时解释以及整个界面的内容和层次结构的实时解释提供了新的方法。我们通过实现四个应用程序来验证我们的新方法:基于模具的教程,短暂适应,接口翻译和最终用户接口自定义。我们在不同的操作系统上运行的不同用户界面工具包创建的复杂现有应用程序中演示了这些增强功能。
The rigidity and fragmentation of GUI toolkits are fundamentally limiting the progress and impact of interaction research. Pixel-based methods offer unique potential for addressing these challenges independent of the implementation of any particular interface or toolkit. This work builds upon Prefab, which enables the modification of existing interfaces. We present new methods for hierarchical models of complex widgets, real-time interpretation of interface content, and real-time interpretation of content and hierarchy throughout an entire interface. We validate our new methods through implementations of four applications: stencil-based tutorials, ephemeral adaptation, interface translation, and end-user interface customization. We demonstrate these enhancements in complex existing applications created from different user interface toolkits running on different operating systems.