II-NEW: Collaborative Research: COMET: A Web Infrastructure for Research and Experimentation in User Interactive Event Driven Testing

II-新：协作研究：COMET：用于用户交互事件驱动测试研究和实验的 Web 基础设施

• 批准号: 1205472
• 负责人: Myra Cohen
• 金额: $ 33.21万
• 依托单位: University of Nebraska-Lincoln
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2012
• 资助国家: 美国
• 起止时间: 2012-08-01 至 2016-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1205472&HistoricalAwards=false
• 关键词: II; NEW; Collaborative; Research; COMET

User interactive event driven software is pervasive today. End users interact with applications by pointing, clicking or touching the interface, and as this happens, the programs respond. Ensuring the dependability of these systems through software testing is paramount, because insufficient testing techniques currently cost the US economy billions of dollars annually. Yet the flexibility of these systems, which make them appealing to users, also increases the difficulty of testing them. This difficulty has fueled a large body of research on user interactive event driven testing, but the newly developed techniques are often evaluated using isolated case studies and experiments. The user interactive event driven testing community lacks a common set of benchmarks and tools for evaluating their new methods, leading to experimental mismatch; the results of one study are difficult to compare with another. The lack of common benchmarks also means that we cannot easily combine results of multiple studies to build a larger body of knowledge. This project reduces the mismatch and is advancing user interactive event driven testing research by developing a shared research and experimentation web infrastructure called COMET. An initial proof of concept for COMET was developed through earlier support from NSF. Factors that contribute to the mismatch include the development of platform specific test methods, test harnesses that require customizations for each test subject application and each operating system, and models that are incompatible with one another. The research will devise new techniques to control the testing environment, contextualizing factors that may affect experimental outcome and will allow for evolution and change of the artifacts over time. It is building a shared and extensible web infrastructure of benchmarks, tools, models and test artifacts that will enable scientific discovery in the state-of-the-art of user interactive event driven testing. COMET is a public resource that will be available to a broader community. Its impact will extend not only to the user interactive event testing research community, but also to others that work with user interfaces such as those who study usability, and to industry and the software testing community at large. The project work will involve both graduate and undergraduate students. Artifacts from the COMET website will be utilized for educational purposes in the classroom.

用户互动事件驱动的软件如今无处不在。 最终用户通过指向，单击或触摸界面与应用程序进行交互，因此，程序会响应。 通过软件测试确保这些系统的可靠性至关重要，因为目前的测试技术不足每年损失数十亿美元。 然而，这些系统的灵活性使它们吸引了用户，也增加了测试它们的困难。这种困难加剧了大量研究用户互动事件驱动的测试，但是新开发的技术通常是使用孤立的案例研究和实验评估的。用户互动事件驱动的测试社区缺少一组常见的基准和用于评估其新方法的工具，从而导致实验不匹配。一项研究的结果很难与另一项研究进行比较。缺乏共同的基准也意味着我们无法轻易结合多个研究的结果来建立更大的知识体系。该项目通过开发共享的研究和实验网络基础架构（称为彗星）来减少不匹配，并正在推进用户互动事件驱动的测试研究。 通过NSF的早期支持，开发了彗星概念的初始概念。 导致不匹配的因素包括开发平台特定的测试方法，需要为每个测试主题应用程序和每个操作系统进行自定义的测试线束以及彼此不兼容的模型。 该研究将设计新技术来控制测试环境，背景化因素可能影响实验结果，并可以随着时间的流逝而演变和变化。 它正在建立一个基准，工具，模型和测试工件的共享和可扩展的Web基础架构，该基础构造将在用户交互式事件驱动的测试的最新技术中实现科学发现。 彗星是一种公共资源，将用于更广泛的社区。 它的影响不仅会扩展到用户互动事件测试研究社区，还将扩展到与用户界面（例如研究可用性的人，行业和软件测试社区）一起工作的其他人的影响。项目工作将涉及研究生和本科生。彗星网站的工件将用于教室中的教育目的。