CI-EN: Collaborative Research: TraceLab Community Infrastructure for Replication, Collaboration, and Innovation

这是TraceLab项目的第二阶段，该项目最初由美国国家科学基金会主要研究仪器拨款资助。这个项目的目标是提供一种工具，它可以促进软件工程实验的再现性，促进比较评估，并提供一个环境，在这个环境中，组件可以很容易地在研究小组之间共享。实验可重复性的挑战几乎延伸到每一个科学和工程学科。最近，生物技术公司“安进”进行的一项被广泛报道的研究显示，在此前发表的53篇具有里程碑意义的论文中，只有6篇是可重复的。最近的研究已经在不同的软件工程领域中发现了类似的问题，包括但不限于软件可追溯性、特性定位和编译器优化。由于缺乏公开可用的数据集、过时和不可用的工具、实验细节不足以及关于各种指标计算方式的无文件决定，可重复性往往受到损害。TraceLab提供了一个即插即用的实验环境，以及可共享组件和开创性实验的库。因此，它的设计就是为了解决这些问题。TraceLab引入了一种完全不同的方法来接近经验软件工程研究，并为更大的社区协作、更严格的结果评估以及新研究人员更容易的入门方式铺平了道路。它有望为经验软件工程领域的未来发展奠定基础，加速和塑造未来的研究方向，支持工业试点研究，并显著降低通常阻碍新研究人员进入该领域的成本和努力。此外，该项目将为不同的本科生和研究生群体提供机会，并将用于各种软件工程课程的教育目的。

This is the second phase of the TraceLab project, which was initially funded under an NSF Major Research Instrumentation grant. The goal of this project is to deliver an instrument that facilitates reproducibility of Software Engineering experiments, fosters comparative evaluation, and provides an environment in which components can be easily shared across research groups. The challenge of experimental reproducibility extends across almost every science and engineering discipline. Recently, a widely reported study conducted by the biotech firm "Amgen" revealed that of 53 previously published landmark papers, only six were reproducible. Recent studies have unearthed similar problems across a diverse set of Software Engineering domains, including, but not limited to, software traceability, feature location, and compiler optimization. Reproducibility is often undermined by lack of publicly available datasets, obsolete and unavailable tools, insufficient details about the experiment, and undocumented decisions about the way various metrics are computed. TraceLab provides a plug-and-play experimental environment, as well as libraries of shareable components and seminal experiments. As such, it is designed to address these problems.TraceLab introduces a radically different way of approaching empirical software engineering research and paves the way for greater community collaboration, more rigorous evaluation of results, and an easier entry-way for new researchers. It is expected to lay the foundation for future advances in the field of empirical software engineering, accelerate and shape future research directions, support industrial pilot studies, and significantly reduce the cost and effort that oftentimes discourages new researchers from entering the field. In addition, the project will provide opportunities to a diverse group of undergraduate and graduate students, and will be used for educational purposes across various software engineering courses.