FMitF: Track II: eMOP: A Tool for Evolution-Aware Runtime Verification

FMITF：轨道 II：eMOP：进化感知运行时验证工具

• 批准号: 2019277
• 负责人: Owolabi Legunsen
• 金额: $ 10万
• 依托单位: Cornell University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-10-01 至 2023-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2019277&HistoricalAwards=false
• 关键词: FMitF; Track; II; eMOP; Tool

Most software developers perform regression testing, re-running tests after every code change, to check that new bugs are not being introduced. Unfortunately, regression testing often misses bugs. This project is developing eMOP, a runtime-verification tool for discovering more bugs during regression testing. Runtime verification checks test runs against specifications that are encoded as logical formulas. Test runs that do not satisfy the specifications result in violations.This project has three infrastructure thrusts. First, a core eMOP component is created that incrementally applies runtime verification, for example, by rechecking only specifications that can be violated in parts of code affected by the changes. Second, the core component is integrated with popular open-source regression testing infrastructure: build systems, continuous integration, and integrated development environments. Third, the core component is enhanced with features for prioritization and improved reporting that make it easier to triage, inspect, and debug violations. When complete, eMOP will offer the bug-finding benefits of runtime verification within regression testing infrastructure that developers already use.The project brings the results of decades of runtime verification research to a wider audience of software developers. eMOP enables developers to find more bugs earlier -- ideally as soon as the bugs are introduced. By using eMOP, students will also be introduced to lightweight formal methods within a software-engineering curriculum. Graduate and undergraduate students, including underrepresented minorities, will be involved, and they will gain exposure to software engineering and lightweight formal methods.The eMOP code will be released publicly on GitHub (https://github.com/SoftEngResearch/emop) under the Apache License 2.0. The code will be maintained for a minimum of three years. A supplementary web page linked from the GitHub repository will contain tutorials and experimental data.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

大多数软件开发人员执行回归测试，在每次代码更改后重新运行测试，以检查没有引入新的bug。不幸的是，回归测试经常会遗漏bug。这个项目正在开发eMOP，一个运行时验证工具，用于在回归测试期间发现更多的bug。运行时验证根据编码为逻辑公式的规范检查测试运行。不满足规范的测试运行将导致违规。首先，创建一个核心eMOP组件，该组件增量地应用运行时验证，例如，通过仅重新检查受更改影响的代码部分中可能违反的规范。其次，核心组件与流行的开源回归测试基础设施集成：构建系统，持续集成和集成开发环境。第三，核心组件得到了增强，具有优先级和改进的报告功能，使分类、检查和调试违规变得更加容易。完成后，eMOP将在开发人员已经使用的回归测试基础设施中提供运行时验证的缺陷查找优势。该项目将数十年的运行时验证研究成果带给更广泛的软件开发人员。eMOP使开发人员能够更早地发现更多的bug--理想情况下，在bug被引入时就可以发现。通过使用eMOP，学生还将在软件工程课程中学习轻量级形式化方法。研究生和本科生，包括代表性不足的少数民族，将参与其中，他们将接触软件工程和轻量级形式化方法。eMOP代码将在Apache许可证2.0下在GitHub（https：//github.com/SoftEngResearch/emop）上公开发布。该守则将维持至少三年。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Testing Configuration Changes in Context to Prevent Production Failures

• 发表时间: 2020
• 作者: Xudong Sun;Runxiang Cheng;Jianyan Chen;Elaine Ang;Owolabi Legunsen;Tianyin Xu

eMOP: A Maven Plugin for Evolution-Aware Runtime Verification

eMOP：用于 Evolution-Aware 运行时验证的 Maven 插件

• 发表时间: 2023
• 期刊: Springer
• 作者: Yorihiro, Ayaka;Jiang, Pengyue;Marques, Valeria;Carleton, Benjamin;Legunsen, Owolabi
• 通讯作者: Legunsen, Owolabi

Extracting Inline Tests from Unit Tests

从单元测试中提取内联测试

• DOI: 10.1145/3597926.3598149
• 发表时间: 2023
• 期刊: ACM
• 作者: Liu, Yu;Nie, Pengyu;Guo, Anna;Gligoric, Milos;Legunsen, Owolabi
• 通讯作者: Legunsen, Owolabi

Comparing and combining analysis-based and learning-based regression test selection

比较和结合基于分析和基于学习的回归测试选择

• DOI: 10.1145/3524481.3527230
• 发表时间: 2022
• 期刊: IEEE/ACM International Conference on Automation of Software Test
• 作者: Zhang, Jiyang;Liu, Yu;Gligoric, Milos;Legunsen, Owolabi;Shi, August
• 通讯作者: Shi, August

Inline Tests

• DOI: 10.1145/3551349.3556952
• 发表时间: 2022-09
• 期刊: Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering
• 作者: Yu Liu;Pengyu Nie;Owolabi Legunsen;Miloš Gligorić