HCC-Small: End-User Retrofitting of Applications By Recognizing Text and UI Components

HCC-Small：最终用户通过识别文本和 UI 组件对应用程序进行改造

• 批准号: 0812382
• 负责人: Andries van Dam
• 金额: --
• 依托单位: Brown University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2008
• 资助国家: 美国
• 起止时间: 2008-09-01 至 2010-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0812382&HistoricalAwards=false
• 关键词: HCC; Small; End; User; Retrofitting

Despite the enormous effort that goes into application design, end users invariably encounter workflow scenarios that are poorly supported by even the most developed, commercial-quality applications. Lack of support for end-user extension increases the burden on application developers to exhaustively anticipate the needs of all end users and then to commit enough resources to address their needs, which often includes re-implementing solutions already found in other applications. This project develops the feasibility of externally retrofitting, without altering, running applications with new interfaces and functionality made possible by using a combination of application-independent pixel-level recognition techniques and more specialized techniques for inspecting data structures exposed by the window system or application. Users will be able to make annotations to those running applications, including hand-drawn ink, typed text, diagrams, interactive widgets, or even links to other application user interface components. Registration techniques will then be researched to associate the annotations with specific elements of an application or document so that such an annotation can be made to appear perhaps only in one place in a specific file, or whenever a certain application runs. This supports a variety of practices, including: integrating functionality from different applications, enriched collaboration, task or user customized interfaces, and adding new fine-grained user interface elements to applications. Broader Impact. Making applications more malleable by embracing customization as a first class and general notion could fundamentally shift application design. Instead of relying solely on inherently slow development of one-size-fits-all applications, end-users could become de facto participants in application design, somewhat analogous to the relationship between traditional print-copy publishing and blogging. Rather than waiting, possibly years, for even simple revisions to fix workflow inefficiencies, users will be empowered to make limited modifications to applications almost as easily as marking up a document, for example by freely rearranging applications? interfaces, or adding diagrammatic annotations displayed over documents which do not natively support them.

尽管在应用程序设计中投入了大量的精力，但最终用户总是会遇到即使是最先进的商业质量应用程序也支持不好的工作流场景。缺乏对最终用户扩展的支持增加了应用程序开发人员的负担，他们必须详尽地预测所有最终用户的需求，然后投入足够的资源来满足他们的需求，这通常包括重新实现其他应用程序中已经存在的解决方案。该项目开发了外部改造的可行性，而不改变，通过使用独立于应用程序的像素级识别技术和更专业的技术来检查窗口系统或应用程序暴露的数据结构，使运行具有新界面和功能的应用程序成为可能。用户将能够对那些正在运行的应用程序进行注释，包括手绘墨水、键入文本、图表、交互式小部件，甚至是指向其他应用程序用户界面组件的链接。然后将研究注册技术，以将注释与应用程序或文档的特定元素相关联，以便可以使这样的注释可能仅出现在特定文件中的一个位置，或者每当某个应用程序运行时出现。这支持各种实践，包括：集成来自不同应用程序的功能，丰富的协作，任务或用户自定义界面，以及向应用程序添加新的细粒度用户界面元素。更广泛的影响。通过将定制作为第一类和一般概念来使应用程序更具延展性，可以从根本上改变应用程序设计。最终用户可以成为应用程序设计的实际参与者，而不是仅仅依赖于一刀切的应用程序的固有缓慢开发，这有点类似于传统的打印复制出版和博客之间的关系。而不是等待，可能数年，甚至简单的修订，以解决工作流程的效率低下，用户将有权作出有限的修改应用程序几乎一样容易标记一个文件，例如通过自由重新安排应用程序？接口，或者添加在本机不支持它们的文档上显示的图表注释。