CRII: SHF: Regression Testing for Projects with Distributed Software Histories

CRII：SHF：具有分布式软件历史记录的项目的回归测试

• 批准号: 1566363
• 负责人: Milos Gligoric
• 金额: $ 17.5万
• 依托单位: University of Texas at Austin
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-05-15 至 2019-04-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1566363&HistoricalAwards=false
• 关键词: CRII; SHF; Regression; Testing; Projects

Developers practice regression testing -- running tests against eachproject commit -- to check that project changes do not break anyfunctionality. While important, regression testing is expensive due tothe number of tests and the number of commits. Regression testselection (RTS) techniques speed up regression testing by skipping torun tests that are not affected by recent changes, and regression testprioritization (RTP) techniques reorder tests to run failing testsfaster. Existing regression techniques analyze only two adjacentcommits, effectively assuming a linear software history. However, therevolution in version-control systems changed the shape of softwarehistories. Distributed software histories are complex graphs ofbranches and merges, which do not match the simplistic view of theexisting techniques. Although existing regression techniques can berun if a distributed software history is linearized, these techniquesunderutilize the data available in the distributed software history.To speed up regression testing, the PI proposes to design techniquesthat utilize the data available in the entire distributed softwarehistory. This project proposes four tasks to improve RTS and RTP: (1)non-adjacent commit reuse - discover likely optimal commit to be usedin each analysis rather than always analyzing adjacent commits; (2)multi-commit analyses - design methods that analyze more than twocommits rather than always analyzing only two commits; (3)command-aware methods - specialize the methods for various commandsthat create each commit rather than be command-unaware; and (4)unified implementation and evaluation - share the implementation andresults among techniques, and evaluate the techniques on open-sourceand industrial projects. The broader impacts of improving RTS and RTPare to increase developers' productivity and reduce the resource usageduring testing phases.

开发人员练习回归测试--针对每个项目提交运行测试--以检查项目更改是否不会破坏任何功能。虽然很重要，但由于测试次数和提交次数的原因，回归测试的成本很高。回归测试选择(RTS)技术通过跳过不受最近更改影响的Torun测试来加速回归测试，回归测试优先级(RTP)技术重新排序测试以更快地运行失败的测试。现有的回归技术只分析两个相邻的提交，有效地假设软件历史是线性的。然而，版本控制系统的发展改变了软件历史的形态。分布式软件历史是分支和合并的复杂图表，这与现有技术的简单化观点不匹配。虽然现有的回归技术可以在分布式软件历史线性化的情况下运行，但这些技术没有充分利用分布式软件历史中的可用数据。为了加快回归测试，PI建议设计利用整个分布式软件历史中可用的数据的技术。这个项目提出了四个任务来改进RTS和RTP：(1)非相邻提交重用-发现可能在每次分析中使用的最佳提交，而不是总是分析相邻提交；(2)多提交分析-设计方法，分析两个以上的提交，而不是总是只分析两个提交；(3)命令感知方法-为创建每个提交的各种命令指定方法，而不是不知道命令；以及(4)统一实现和评估-在技术之间共享实现和结果，并评估开源和工业项目中的技术。改进RTS和RTP的更广泛的影响是提高开发人员的生产力，减少测试阶段的资源使用。

项目成果

Regression test selection for TizenRT

TizenRT 的回归测试选择

• DOI: 10.1145/3236024.3275527
• 发表时间: 2018
• 期刊: Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering
• 作者: Celik, Ahmet;Lee, Young Chul;Gligoric, Milos
• 通讯作者: Gligoric, Milos

Bounded exhaustive test-input generation on GPUs

GPU 上的有限详尽测试输入生成

• DOI: 10.1145/3133918
• 发表时间: 2017
• 期刊: Proceedings of the ACM on Programming Languages
• 作者: Celik, Ahmet;Pai, Sreepathi;Khurshid, Sarfraz;Gligoric, Milos
• 通讯作者: Gligoric, Milos

piCoq: parallel regression proving for large-scale verification projects

piCoq：大规模验证项目的并行回归证明

• DOI: 10.1145/3213846.3213877
• 发表时间: 2018
• 期刊: International Symposium on Software Testing and Analysis
• 作者: Palmskog, Karl;Celik, Ahmet;Gligoric, Milos
• 通讯作者: Gligoric, Milos

Towards refactoring-aware regression test selection

走向重构意识回归测试选择

• DOI: 10.1145/3180155.3180254
• 发表时间: 2018
• 期刊: International Conference on Software Engineering
• 作者: Wang, Kaiyuan;Zhu, Chenguang;Celik, Ahmet;Kim, Jongwook;Batory, Don;Gligoric, Milos
• 通讯作者: Gligoric, Milos

Regression test selection across JVM boundaries

跨 JVM 边界的回归测试选择

• DOI: 10.1145/3106237.3106297
• 发表时间: 2017
• 期刊: Joint Meeting on Foundations of Software Engineering
• 作者: Celik, Ahmet;Vasic, Marko;Milicevic, Aleksandar;Gligoric, Milos
• 通讯作者: Gligoric, Milos