CI-EN: Collaborative Research: TraceLab Community Infrastructure for Replication, Collaboration, and Innovation

CI-EN：协作研究：用于复制、协作和创新的 TraceLab 社区基础设施

• 批准号: 1510239
• 负责人: Denys Poshyvanyk
• 金额: $ 25万
• 依托单位: College of William and Mary
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-06-01 至 2018-05-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1510239&HistoricalAwards=false
• 关键词: CI; EN; Collaborative; Research; TraceLab

This is the second phase of the TraceLab project, which was initially funded under an NSF Major Research Instrumentation grant. The goal of this project is to deliver an instrument that facilitates reproducibility of Software Engineering experiments, fosters comparative evaluation, and provides an environment in which components can be easily shared across research groups. The challenge of experimental reproducibility extends across almost every science and engineering discipline. Recently, a widely reported study conducted by the biotech firm "Amgen" revealed that of 53 previously published landmark papers, only six were reproducible. Recent studies have unearthed similar problems across a diverse set of Software Engineering domains, including, but not limited to, software traceability, feature location, and compiler optimization. Reproducibility is often undermined by lack of publicly available datasets, obsolete and unavailable tools, insufficient details about the experiment, and undocumented decisions about the way various metrics are computed. TraceLab provides a plug-and-play experimental environment, as well as libraries of shareable components and seminal experiments. As such, it is designed to address these problems.TraceLab introduces a radically different way of approaching empirical software engineering research and paves the way for greater community collaboration, more rigorous evaluation of results, and an easier entry-way for new researchers. It is expected to lay the foundation for future advances in the field of empirical software engineering, accelerate and shape future research directions, support industrial pilot studies, and significantly reduce the cost and effort that oftentimes discourages new researchers from entering the field. In addition, the project will provide opportunities to a diverse group of undergraduate and graduate students, and will be used for educational purposes across various software engineering courses.

这是Tracelab项目的第二阶段，该项目最初是根据NSF主要研究工具赠款资助的。 该项目的目的是提供一种仪器，以促进软件工程实验的可重复性，促进比较评估，并提供一个可以在研究小组之间轻松共享组件的环境。 实验性可重复性的挑战几乎跨越了每个科学和工程学科。最近，一项由生物技术公司“ Amgen”进行的一项广泛报道的研究表明，在先前发表的具有里程碑意义的论文中，只有6篇是可重现的。最近的研究发现了各种软件工程领域的类似问题，包括但不限于软件可追溯性，功能位置和编译器优化。 缺乏公开可用的数据集，过时和不可用的工具，有关实验的详细信息以及对各种指标的计算方式的无证件决定，通常会破坏可重复性。 Tracelab提供了插件的实验环境，以及可共享组件和开创性实验的库。 因此，它旨在解决这些问题。Tracelab引入了一种与经验软件工程研究的截然不同的方式，并为更大的社区协作铺平了道路，对结果的更严格的评估以及对新研究人员来说更容易的入门方式。 预计将为未来的经验软件工程领域的进步奠定基础，加速和塑造未来的研究方向，支持工业试点研究，并大大降低了经常阻止新研究人员进入该领域的成本和努力。 此外，该项目将为各种本科生和研究生提供机会，并将用于各种软件工程课程的教育目的。