Empirical Evaluation of Bug Linking
Empirical Evaluation of Bug Linking
复制标题
DOI：
10.1109/csmr.2013.19
复制
发表时间：
2013-03
期刊：
影响因子：
--
通讯作者：
Tegawendé F. Bissyandé;Ferdian Thung;Shaowei Wang;D. Lo;Lingxiao Jiang;Laurent Réveillère
中科院分区：
文献类型：
--
作者：
Tegawendé F. Bissyandé;Ferdian Thung;Shaowei Wang;D. Lo;Lingxiao Jiang;Laurent Réveillère
为了收集用户发现的软件bug，开发团队经常使用Bugzilla等系统设置bug跟踪器。然后，开发人员会修复一些bug，并将相应的代码更改提交到版本控制系统，如svn或git。不幸的是，许多软件项目缺少错误报告和代码更改之间的联系，因为错误跟踪和版本控制系统通常是分开维护的。然而，将bug报告与修复提交联系起来是很重要的，因为它可以揭示bug修复过程的本质，并揭示软件管理中的模式。已经提出了错误链接解决方案，例如ReLink。然而，其有效性的证明面临着许多问题，包括其地面实况数据集的可靠性问题以及其测量范围。在这项研究中，我们提出了一个基准评估错误链接的解决方案。这个基准测试包括来自10个程序的大约12，000个错误链接的数据集。在bug修复过程中，已经提供了bug报告和它们的修复之间的这些真实链接。我们设计了一些研究问题，以定量和定性地评估错误链接工具的有效性。最后，我们将此基准应用于ReLink，以报告此错误链接工具的优点和局限性。
To collect software bugs found by users, development teams often set up bug trackers using systems such as Bugzilla. Developers would then fix some of the bugs and commit corresponding code changes into version control systems such as svn or git. Unfortunately, the links between bug reports and code changes are missing for many software projects as the bug tracking and version control systems are often maintained separately. Yet, linking bug reports to fix commits is important as it could shed light into the nature of bug fixing processes and expose patterns in software management. Bug linking solutions, such as ReLink, have been proposed. The demonstration of their effectiveness however faces a number of issues, including a reliability issue with their ground truth datasets as well as the extent of their measurements. We propose in this study a benchmark for evaluating bug linking solutions. This benchmark includes a dataset of about 12,000 bug links from 10 programs. These true links between bug reports and their fixes have been provided during bug fixing processes. We designed a number of research questions, to assess both quantitatively and qualitatively the effectiveness of a bug linking tool. Finally, we apply this benchmark on ReLink to report the strengths and limitations of this bug linking tool.