CAREER: Testing Evolving Complex Software Systems

职业：测试不断发展的复杂软件系统

• 批准号: 2152340
• 负责人: Tingting Yu
• 金额: $ 50.18万
• 依托单位: University of Cincinnati Main Campus
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-01-01 至 2023-11-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2152340&HistoricalAwards=false
• 关键词: CAREER; Testing; Evolving; Complex; Software

Modern computer systems span a wide range of domains, ranging from consumer electronics (e.g., smart-phones) to safety-critical systems (e.g., avionics). These systems evolve rapidly because the competition for market share pushes developers to come up with new features or improve capabilities over existing ones. These software changes may require hardware replacements or upgrades to capitalize on software upgrade opportunities. As such, developers must ensure that changes do not cause any unintended impact to the existing quality of the systems. Regression testing has been widely used to assess whether changes have adversely affected system behavior. While significant work has been accomplished by the software engineering community in improving effectiveness and efficiency of regression testing, most of the existing techniques focus on traditional software that is environment-independent and non-distributed. Real-world software systems, however, are far more complex: they frequently interact with the environment via hardware devices, and employ various concurrency mechanisms to coordinate interrupts, signals, threads, and processes. These characteristics affect various techniques on which existing regression testing approaches rely. Therefore, applying these approaches may lead to problems during maintenance and thus impair software quality.The overall goal of this proposal is to create a novel regression testing framework that can be applied to real-world complex software systems, focusing on the hardware dependence and concurrent control characteristics, throughout their lifetimes. Specifically, this research will develop, evaluate, and make available a family of techniques and tools that can: 1) create comprehensive models of the whole system to analyze change impact across hardware and software layers and across concurrent events, 2) retest the systems accordingly using existing test cases, and 3) generate new test cases when needed. The analytical underpinnings of this research will be applicable not only to the software engineering community, but to industry and other disciplines in which software dependability plays an important role. The associated education agenda paves the way for teaching that cross traditional boundaries among multicore computing, embedded systems and software engineering, which may ultimately, through the dissemination of new curricular materials, have impacts to the broader scientific community.

现代计算机系统跨越广泛的领域，从消费电子产品(例如，智能电话)到安全关键系统(例如，航空电子设备)。这些系统发展迅速，因为市场份额的竞争迫使开发人员提出新功能或在现有功能的基础上改进功能。这些软件更改可能需要更换硬件或升级，以利用软件升级机会。因此，开发人员必须确保更改不会对系统的现有质量造成任何意外影响。回归测试已被广泛用于评估更改是否对系统行为产生了不利影响。虽然软件工程界在提高回归测试的有效性和效率方面已经完成了大量的工作，但现有的大多数技术都集中在与环境无关的非分布式传统软件上。然而，现实世界的软件系统要复杂得多：它们经常通过硬件设备与环境交互，并使用各种并发机制来协调中断、信号、线程和进程。这些特征会影响现有回归测试方法所依赖的各种技术。因此，使用这些方法可能会导致维护过程中出现问题，从而影响软件质量。本方案的总体目标是创建一个新的回归测试框架，该框架可以应用于现实世界中的复杂软件系统，重点关注它们的硬件依赖和并发控制特性。具体地说，这项研究将开发、评估和提供一系列技术和工具，这些技术和工具可以：1)创建整个系统的全面模型，以分析跨硬件和软件层以及跨并发事件的更改影响；2)使用现有测试用例重新测试系统；以及3)在需要时生成新的测试用例。这项研究的分析基础将不仅适用于软件工程社区，而且适用于行业和其他软件可靠性发挥重要作用的学科。相关的教育议程为跨越多核计算、嵌入式系统和软件工程之间的传统界限的教学铺平了道路，这些教学最终可能通过传播新的课程材料对更广泛的科学界产生影响。

项目成果

ReCDroid+: Automated End-to-End Crash Reproduction from Bug Reports for Android Apps

• DOI: 10.1145/3488244
• 发表时间: 2022-03
• 期刊: ACM Transactions on Software Engineering and Methodology (TOSEM)
• 作者: Yu Zhao;Ting Su;Y. Liu;Wei Zheng;Xiaoxue Wu;Ramakanth Kavuluru;William G. J. Halfond;Tingting Yu