Root causing, detecting, and fixing flaky tests: State of the art and future roadmap

Root causing, detecting, and fixing flaky tests: State of the art and future roadmap
复制标题

根本原因、检测和修复片状测试:最先进的技术和未来的路线图

DOI:
--
复制
发表时间:
2020
期刊:
Software, Practice & Experience
影响因子:
--
通讯作者:
Yoseph Hailemariam
Yoseph Hailemariam
中科院分区:
--
文献类型:
--
作者:
B. Zolfaghari;R. Parizi;Gautam Srivastava;Yoseph Hailemariam

文献摘要

参考文献

被引文献

相似文献

片状测试是这样一种测试,它可能导致在测试的单个代码上不同的运行结果,而不会对测试代码进行任何更改。测试剥落是一种有害现象,它会减缓软件部署,并增加软件定义网络和物联网环境等广泛平台的支出。为了解决这个问题,工业研究所和实验室进行了大量的研究项目。尽管这一问题近年来受到了学术界的越来越多的关注,但学术界在这方面的研究仍然落后于业界。对现有的检测和根源测试方法进行系统的回顾和趋势分析,可以为这一课题的未来研究铺平道路。这可以帮助学术界跟上工业进步的步伐,甚至引领这一领域的研究。这篇文章首先全面回顾了业界和学术界在检测和缓解片状测试方面的最新成就。在下一步中,分析了这一研究领域的最新趋势,并为未来的研究制定了路线图。
A flaky test is a test that may lead to different results in different runs on a single code under test without any change in the test code. Test flakiness is a noxious phenomenon that slows down software deployment, and increases the expenditures in a broad spectrum of platforms such as software‐defined networks and Internet of Things environments. Industrial institutes and labs have conducted a whole lot of research projects aiming at tackling this problem. Although this issue has been receiving more attention from academia in recent years, the academic research community is still behind the industry in this area. A systematic review and trend analysis on the existing approaches for detecting and root causing flaky tests can pave the way for future research on this topic. This can help academia keep pace with industrial advancements and even lead the research in this field. This article first presents a comprehensive review of recent achievements of the industry as well as academia regarding the detection and mitigation of flaky tests. In the next step, recent trends in this line of research are analyzed and a roadmap is established for future research.
DOI: 10.1145/3338906.3338925
发表时间: 2019-08
期刊: Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering
影响因子: --
作者:
A. Shi;Wing Lam;Reed Oei;Tao Xie;D. Marinov
通讯作者: A. Shi;Wing Lam;Reed Oei;Tao Xie;D. Marinov
减轻片状测试对突变测试的影响
DOI: 10.1145/3293882.3330568
发表时间: 2019
期刊: ISSTA 2019 Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis
影响因子: --
作者:
Shi, August;Bell, Jonathan;Marinov, Darko
通讯作者: Marinov, Darko
DOI: 10.1109/issre.2019.00031
发表时间: 2019
期刊: 30th IEEE International Symposium on Software Reliability Engineering (ISSRE 2019
影响因子: --
作者:
Shi, August;Zhao, Peiyuan;Marinov, Darko
通讯作者: Marinov, Darko