CI-New: BugSwarm: A Large-Scale Repository of Replicable Defects, Tests, and Patches to Support the Software Engineering Research Community

CI-New：BugSwarm：支持软件工程研究社区的可复制缺陷、测试和补丁的大型存储库

• 批准号: 1629976
• 负责人: Cindy Rubio Gonzalez
• 金额: $ 103.37万
• 依托单位: University of California-Davis
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-09-01 至 2020-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1629976&HistoricalAwards=false
• 关键词: CI; New; BugSwarm; Large; Scale

Improving software quality is a central priority of our time.Approaches to understand, diagnose, localize, and fix software defectsare usually empirically grounded in datasets of past defects/repairs.A few such datasets are available; however, these datasets aredifficult to create, and are typically not of the size, scale, anddiversity that is representative of the software in use. The goal ofthis project is to create BugSwarm, a large-scale repository ofreplicable defects, tests, and patches. We propose to draw from therecorded history of defects in open-source projects, to create thisdataset of unprecedented size and diversity, while retainingsufficient fidelity of detail to allow careful study and replicationof these historical defects. BugSwarm will amplify the size ofavailable defect datasets by several orders of magnitude.Continuous integration (CI) development practices, where build andtest processes are carried out in the cloud, with archived results,offer a novel opportunity to construct defect datasets. We propose toexploit CI coding practices to create BugSwarm. Continuous, onlineintegration practices inherently create archived records of build andtest attempts, including those that result in build and/or testfailures, and subsequent repairs. These practices emerged from theimperatives to: a) rigorously and automatically build, integrate, andfully test numerous code submissions from volunteer developers; and b)the need to test these submissions at large volumes, in virtualized,configurable, cloud-based settings. The virtualized, cloud-basedtesting makes these defects much more available and replicable. Wewill exploit these archived records to create DRPs (Defect ReplicationPackages) and DFRPs (Defect & Fix Replication Packages), comprisingbuggy versions of the code, failing regression tests, and bug fixes.DRPs and DFRPs will include complete virtual machines to reproducereal test failures. BugSwarm will facilitate experimentation, andavoid the duplication of a tremendous amount of work among researchersin programming languages, and software engineering.

提高软件质量是我们这个时代的中心优先事项。理解、诊断、定位和修复软件缺陷的方法通常基于过去缺陷/修复的数据集。一些这样的数据集是可用的；然而，这些数据集很难创建，并且通常不具有所使用的软件所代表的大小、规模和多样性。这个项目的目标是创建BugSwarm，一个可复制缺陷、测试和补丁的大规模存储库。我们建议从开源项目中记录的缺陷历史中提取，创建这个前所未有的规模和多样性的数据集，同时保留足够的细节保真度，以便仔细研究和复制这些历史缺陷。BugSwarm将把可用缺陷数据集的大小放大几个数量级。持续集成（CI）开发实践，其中构建和测试过程在云中执行，并带有存档的结果，提供了构建缺陷数据集的新机会。我们建议利用CI编码实践来创建BugSwarm。持续的在线集成实践固有地创建了构建和测试尝试的存档记录，包括那些导致构建和/或测试失败的记录，以及随后的修复。这些实践源于以下要求：a)严格且自动地构建、集成和全面测试志愿开发人员提交的大量代码；b)需要在虚拟的、可配置的、基于云的设置中大量测试这些提交。虚拟化的、基于云的测试使这些缺陷更加可用和可复制。我们将利用这些存档记录来创建DRPs（缺陷复制包）和DFRPs（缺陷修复复制包），包括代码的错误版本、失败的回归测试和错误修复。drp和dfrp将包括完整的虚拟机来再现测试失败。BugSwarm将促进实验，并避免研究人员在编程语言和软件工程方面的大量重复工作。