Understanding and improving artifact sharing in software engineering research
Understanding and improving artifact sharing in software engineering research
复制标题
理解和改进软件工程研究中的工件共享
DOI：
--
复制
发表时间：
2020
影响因子：
4.1
通讯作者：
Michael C Hilton
中科院分区：
文献类型：
--
作者：
C. Timperley;Lauren Herckis;Claire Le Goues;Michael C Hilton
近年来，许多软件工程研究人员已经开始在他们的研究论文中包含工件。理想情况下，工件，包括工具，基准和数据，支持思想的传播，为研究索赔提供证据，并作为未来研究的起点。然而，在实践中，工件遭受各种各样的问题，阻止实现其全部潜力。为了帮助软件工程社区实现工件的全部潜力，我们寻求理解在工件的创建、共享和使用中所涉及的挑战。为此，我们进行了混合方法的研究，包括调查的工件在软件工程出版物，和153个软件工程研究人员的在线调查。通过分析工件创建者，用户和评审员的观点，我们确定了几个高层次的挑战，影响工件的质量，包括这些群体之间的不匹配的期望，以及缺乏足够的奖励的创建者和评审员。使用创新的扩散（DoI）作为一个分析框架，我们研究这些挑战如何相互关联，并建立一个影响共享和成功的工件的因素的理解。最后，我们根据我们的结果和现有的最佳实践提出了改进工件质量的建议。
In recent years, many software engineering researchers have begun to include artifacts alongside their research papers. Ideally, artifacts, including tools, benchmarks, and data, support the dissemination of ideas, provide evidence for research claims, and serve as a starting point for future research. However, in practice, artifacts suffer from a variety of issues that prevent the realization of their full potential. To help the software engineering community realize the full potential of artifacts, we seek to understand the challenges involved in the creation, sharing, and use of artifacts. To that end, we perform a mixed-methods study including a survey of artifacts in software engineering publications, and an online survey of 153 software engineering researchers. By analyzing the perspectives of artifact creators, users, and reviewers, we identify several high-level challenges that affect the quality of artifacts including mismatched expectations between these groups, and a lack of sufficient reward for both creators and reviewers. Using Diffusion of Innovations (DoI) as an analytical framework, we examine how these challenges relate to one another, and build an understanding of the factors that affect the sharing and success of artifacts. Finally, we make recommendations to improve the quality of artifacts based on our results and existing best practices.
影响因子：
12.7
作者：
Glasgow, RE;Vogt, TM;Boles, SM
通讯作者：
Boles, SM
使用 Umbrella 进行可重复的研究：跟踪、创建和保留执行环境
DOI：
10.1109/escience.2016.7870889
发表时间：
2016
期刊：
IEEE Conference on e-Science
影响因子：
--
作者：
Meng, Haiyan;Thain, Douglas;Vyushkov, Alexander;Wolf, Matthias;Woodard, Anna
通讯作者：
Woodard, Anna
影响因子：
3.8
作者：
Smith, Arfon M.;Katz, Daniel S.;Niemeyer, Kyle E.
通讯作者：
Niemeyer, Kyle E.