SHF: Small:Automatically Synthesizing System and Integration Tests

SHF：小型：自动综合系统和集成测试

• 批准号: 1908094
• 负责人: Mark Grechanik
• 金额: $ 37.89万
• 依托单位: University of Illinois at Chicago
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-10-01 至 2023-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1908094&HistoricalAwards=false
• 关键词: SHF; Small; Automatically; Synthesizing; System

System and integration testing is a set of key activities in software development and maintenance to determine if applications and their constituent components behave correctly. System/integration testing is vitally important for ensuring software quality, since many serious software defects occur in interactions among different components. Unfortunately, creating effective system/integration tests requires significant time and effort, since it is not feasible to test the enormous set of all combinations of the components from a nontrivial software application. It is crucial to reduce the cost and increase the quality of software with system/integration testing that is effective in fault finding and efficient in resource consumption and execution time. In sum, there are unique factors in system/integration testing, not previously considered, that if not addressed will continue to limit the quality of software applications. In this project, a novel framework will be created for automatically creating effective system/integration tests that find bugs efficiently. A three-pronged research program will be developed for Automatic Synthesis of System and Integration Software Tests (ASSIST). New algorithms and techniques will be created and evaluated as part of the work on this project for automatically obtaining models that describe interacting components, thus reducing the number of synthesized system and integration tests and increasing their fault-finding power. Also, a novel way will be created in which static and dynamic analyses and machine learning are used to obtain test input data as well as oracles for the synthesized system and integration tests. As a result of the work on this project, system and integration tests will be automatically synthesized using ASSIST that have a comparable bug-finding power with manually created integration tests. A suite of new ASSIST tools that will be developed, evaluated, and applied to different open-source and commercial applications, and made available to the broader community.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

系统和集成测试是软件开发和维护中的一组关键活动，用于确定应用程序及其组成组件是否正确运行。系统/集成测试对于保证软件质量至关重要，因为许多严重的软件缺陷发生在不同组件之间的交互中。不幸的是，创建有效的系统/集成测试需要大量的时间和精力，因为它是不可行的测试的所有组件的组合从一个平凡的软件应用程序的巨大集合。有效的系统/集成测试是降低软件成本和提高软件质量的关键，它可以有效地发现故障，节省资源消耗和执行时间。 总而言之，系统/集成测试中有一些以前没有考虑到的独特因素，如果不加以解决，这些因素将继续限制软件应用程序的质量。在这个项目中，将创建一个新的框架，用于自动创建有效的系统/集成测试，有效地发现错误。 一个三管齐下的研究计划将开发自动合成系统和集成软件测试（ASSIST）。作为本项目工作的一部分，将创建和评估新的算法和技术，以自动获得描述相互作用组件的模型，从而减少合成系统和集成测试的数量，并提高其故障查找能力。此外，将创建一种新的方法，其中静态和动态分析和机器学习用于获得测试输入数据以及用于合成系统和集成测试的预言机。作为该项目工作的结果，系统和集成测试将使用ASSIST自动合成，ASSIST具有与手动创建的集成测试相当的bug查找能力。一套新的ASSIST工具，将被开发，评估和应用于不同的开源和商业应用程序，并提供给更广泛的社区。该奖项反映了NSF的法定使命，并已被认为是值得通过使用基金会的智力价值和更广泛的影响审查标准进行评估的支持。