SHF: Small:Automatically Synthesizing System and Integration Tests

SHF：小型：自动综合系统和集成测试

• 批准号: 1908094
• 负责人: Mark Grechanik
• 金额: $ 37.89万
• 依托单位: University of Illinois at Chicago
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-10-01 至 2023-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1908094&HistoricalAwards=false
• 关键词: SHF; Small; Automatically; Synthesizing; System

System and integration testing is a set of key activities in software development and maintenance to determine if applications and their constituent components behave correctly. System/integration testing is vitally important for ensuring software quality, since many serious software defects occur in interactions among different components. Unfortunately, creating effective system/integration tests requires significant time and effort, since it is not feasible to test the enormous set of all combinations of the components from a nontrivial software application. It is crucial to reduce the cost and increase the quality of software with system/integration testing that is effective in fault finding and efficient in resource consumption and execution time. In sum, there are unique factors in system/integration testing, not previously considered, that if not addressed will continue to limit the quality of software applications. In this project, a novel framework will be created for automatically creating effective system/integration tests that find bugs efficiently. A three-pronged research program will be developed for Automatic Synthesis of System and Integration Software Tests (ASSIST). New algorithms and techniques will be created and evaluated as part of the work on this project for automatically obtaining models that describe interacting components, thus reducing the number of synthesized system and integration tests and increasing their fault-finding power. Also, a novel way will be created in which static and dynamic analyses and machine learning are used to obtain test input data as well as oracles for the synthesized system and integration tests. As a result of the work on this project, system and integration tests will be automatically synthesized using ASSIST that have a comparable bug-finding power with manually created integration tests. A suite of new ASSIST tools that will be developed, evaluated, and applied to different open-source and commercial applications, and made available to the broader community.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

系统和集成测试是软件开发和维护中的一组关键活动，用于确定应用程序及其组成组件是否正常运行。系统/集成测试对于确保软件质量至关重要，因为许多严重的软件缺陷是在不同组件之间的交互中发生的。不幸的是，创建有效的系统/集成测试需要大量的时间和精力，因为从一个重要的软件应用程序中测试大量的组件的所有组合是不可行的。通过系统/集成测试来降低成本并提高软件质量至关重要，该测试可以有效地发现故障并有效地节省资源消耗和执行时间。 总之，系统/集成测试中有一些以前没有考虑到的独特因素，如果不加以解决，将继续限制软件应用程序的质量。在这个项目中，将创建一个新颖的框架，用于自动创建有效的系统/集成测试，以有效地发现错误。 将为系统和集成软件测试自动综合（ASSIST）开发一个三管齐下的研究计划。作为该项目工作的一部分，将创建和评估新的算法和技术，以自动获取描述交互组件的模型，从而减少综合系统和集成测试的数量，并提高其故障查找能力。此外，还将创建一种新颖的方法，其中使用静态和动态分析以及机器学习来获取测试输入数据以及用于合成系统和集成测试的预言机。作为该项目工作的结果，系统和集成测试将使用 ASSIST 自动合成，ASSIST 具有与手动创建的集成测试相当的错误查找能力。一套新的 ASSIST 工具将被开发、评估并应用于不同的开源和商业应用程序，并提供给更广泛的社区。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。