CRII: SHF: Regression Testing for Projects with Distributed Software Histories

CRII：SHF：具有分布式软件历史记录的项目的回归测试

• 批准号: 1566363
• 负责人: Milos Gligoric
• 金额: $ 17.5万
• 依托单位: University of Texas at Austin
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-05-15 至 2019-04-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1566363&HistoricalAwards=false
• 关键词: CRII; SHF; Regression; Testing; Projects

Developers practice regression testing -- running tests against eachproject commit -- to check that project changes do not break anyfunctionality. While important, regression testing is expensive due tothe number of tests and the number of commits. Regression testselection (RTS) techniques speed up regression testing by skipping torun tests that are not affected by recent changes, and regression testprioritization (RTP) techniques reorder tests to run failing testsfaster. Existing regression techniques analyze only two adjacentcommits, effectively assuming a linear software history. However, therevolution in version-control systems changed the shape of softwarehistories. Distributed software histories are complex graphs ofbranches and merges, which do not match the simplistic view of theexisting techniques. Although existing regression techniques can berun if a distributed software history is linearized, these techniquesunderutilize the data available in the distributed software history.To speed up regression testing, the PI proposes to design techniquesthat utilize the data available in the entire distributed softwarehistory. This project proposes four tasks to improve RTS and RTP: (1)non-adjacent commit reuse - discover likely optimal commit to be usedin each analysis rather than always analyzing adjacent commits; (2)multi-commit analyses - design methods that analyze more than twocommits rather than always analyzing only two commits; (3)command-aware methods - specialize the methods for various commandsthat create each commit rather than be command-unaware; and (4)unified implementation and evaluation - share the implementation andresults among techniques, and evaluate the techniques on open-sourceand industrial projects. The broader impacts of improving RTS and RTPare to increase developers' productivity and reduce the resource usageduring testing phases.

开发人员实践回归测试--针对每个项目提交运行测试--以检查项目更改不会破坏任何功能。虽然回归测试很重要，但由于测试数量和提交数量较多，因此成本很高。回归测试选择（RTS）技术通过跳过不受最近更改影响的测试来加速回归测试，回归测试优先级（RTP）技术重新排序测试以更快地运行失败的测试。现有的回归技术只分析两个相邻的提交，有效地假设了线性的软件历史。然而，版本控制系统的革命改变了软件历史的形状。分布式软件历史是分支和合并的复杂图形，这与现有技术的简单视图不匹配。虽然现有的回归技术可以berun，如果分布式软件的历史是线性的，这些technologesunderutilize的数据在分布式software history.To加速回归测试，PI建议设计的technologesthat利用数据在整个分布式software history。本项目提出了四个改进RTS和RTP的任务：（1）非相邻提交重用--发现每次分析中可能使用的最优提交，而不是总是分析相邻提交;（2）多提交分析--设计分析两个以上提交的方法，而不是总是分析两个提交;（3）命令感知方法-专门化创建每个提交而不是命令感知的各种命令的方法;（4）统一实施和评估--共享技术间的实施和成果，并对开源和工业项目的技术进行评估。改进RTS和RTP的更广泛的影响是提高开发人员的生产力，减少测试阶段的资源使用。

项目成果

Regression test selection for TizenRT

TizenRT 的回归测试选择

• DOI: 10.1145/3236024.3275527
• 发表时间: 2018
• 期刊: Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering
• 作者: Celik, Ahmet;Lee, Young Chul;Gligoric, Milos
• 通讯作者: Gligoric, Milos

Bounded exhaustive test-input generation on GPUs

GPU 上的有限详尽测试输入生成

• DOI: 10.1145/3133918
• 发表时间: 2017
• 期刊: Proceedings of the ACM on Programming Languages
• 作者: Celik, Ahmet;Pai, Sreepathi;Khurshid, Sarfraz;Gligoric, Milos
• 通讯作者: Gligoric, Milos

piCoq: parallel regression proving for large-scale verification projects

piCoq：大规模验证项目的并行回归证明

• DOI: 10.1145/3213846.3213877
• 发表时间: 2018
• 期刊: International Symposium on Software Testing and Analysis
• 作者: Palmskog, Karl;Celik, Ahmet;Gligoric, Milos
• 通讯作者: Gligoric, Milos

Towards refactoring-aware regression test selection

走向重构意识回归测试选择

• DOI: 10.1145/3180155.3180254
• 发表时间: 2018
• 期刊: International Conference on Software Engineering
• 作者: Wang, Kaiyuan;Zhu, Chenguang;Celik, Ahmet;Kim, Jongwook;Batory, Don;Gligoric, Milos
• 通讯作者: Gligoric, Milos

Regression test selection across JVM boundaries

跨 JVM 边界的回归测试选择

• DOI: 10.1145/3106237.3106297
• 发表时间: 2017
• 期刊: Joint Meeting on Foundations of Software Engineering
• 作者: Celik, Ahmet;Vasic, Marko;Milicevic, Aleksandar;Gligoric, Milos
• 通讯作者: Gligoric, Milos