CI-EN: Collaborative Research: TraceLab Community Infrastructure for Replication, Collaboration, and Innovation

这是TraceLab项目的第二阶段，最初由NSF主要研究仪器拨款资助。 该项目的目标是提供一种工具，促进软件工程实验的再现性，促进比较评估，并提供一个环境，在该环境中，组件可以很容易地在研究小组之间共享。 实验可重复性的挑战几乎涉及每一个科学和工程学科。最近，生物技术公司“安进”进行的一项广泛报道的研究显示，在以前发表的53篇里程碑式的论文中，只有6篇是可重复的。最近的研究发现了不同软件工程领域的类似问题，包括但不限于软件可追溯性，功能定位和编译器优化。 由于缺乏公开可用的数据集，过时和不可用的工具，实验细节不足，以及关于各种指标计算方式的未记录决定，重复性往往受到破坏。 TraceLab提供了一个即插即用的实验环境，以及可共享的组件库和开创性的实验。 TraceLab引入了一种完全不同的方法来进行经验性软件工程研究，并为更大的社区合作、更严格的结果评估和更容易的新研究人员入门铺平了道路。 它有望为经验软件工程领域的未来发展奠定基础，加速和塑造未来的研究方向，支持工业试点研究，并显着降低成本和努力，往往阻碍新的研究人员进入该领域。 此外，该项目将为不同的本科生和研究生群体提供机会，并将用于各种软件工程课程的教育目的。

This is the second phase of the TraceLab project, which was initially funded under an NSF Major Research Instrumentation grant. The goal of this project is to deliver an instrument that facilitates reproducibility of Software Engineering experiments, fosters comparative evaluation, and provides an environment in which components can be easily shared across research groups. The challenge of experimental reproducibility extends across almost every science and engineering discipline. Recently, a widely reported study conducted by the biotech firm "Amgen" revealed that of 53 previously published landmark papers, only six were reproducible. Recent studies have unearthed similar problems across a diverse set of Software Engineering domains, including, but not limited to, software traceability, feature location, and compiler optimization. Reproducibility is often undermined by lack of publicly available datasets, obsolete and unavailable tools, insufficient details about the experiment, and undocumented decisions about the way various metrics are computed. TraceLab provides a plug-and-play experimental environment, as well as libraries of shareable components and seminal experiments. As such, it is designed to address these problems.TraceLab introduces a radically different way of approaching empirical software engineering research and paves the way for greater community collaboration, more rigorous evaluation of results, and an easier entry-way for new researchers. It is expected to lay the foundation for future advances in the field of empirical software engineering, accelerate and shape future research directions, support industrial pilot studies, and significantly reduce the cost and effort that oftentimes discourages new researchers from entering the field. In addition, the project will provide opportunities to a diverse group of undergraduate and graduate students, and will be used for educational purposes across various software engineering courses.