SHF: Medium: Collaborative Research: Enhancing Continuous Integration Testing for the Open-Source Ecosystem

SHF:媒介:协作研究:加强开源生态系统的持续集成测试

基本信息

  • 批准号:
    2100037
  • 负责人:
  • 金额:
    $ 32.84万
  • 依托单位:
  • 依托单位国家:
    美国
  • 项目类别:
    Continuing Grant
  • 财政年份:
    2020
  • 资助国家:
    美国
  • 起止时间:
    2020-09-01 至 2023-09-30
  • 项目状态:
    已结题

项目摘要

Continuous integration (CI) is an important software development activity that aims to improve software development by automating software compilation and regression testing. Recent studies report that CI helps developers deploy faster and reduce development cost. Given these success stories, CI has attracted rapidly increasing interest and adoption, e.g., Travis CI, the currently most popular CI service, is used by over 300,000 GitHub projects. Despite the success of CI, developers report they would like to see improvements in CI. First, they want to faster obtain regression test results. Second, they want better handling of so-called flaky tests, which are regression tests that can non-deterministically pass or fail, and whose failures negatively affect developer's productivity. Third, developers report that CI builds do not provide sufficient debugging assistance for reasoning about failed regression tests. While regression testing has been studied for over three decades, it has not been studied in the context of CI until recently.To substantially improve regression testing in CI, the PIs propose to develop novel techniques and tools that address three important challenges: (1) test selection to speed up regression testing and the development cycle, (2) test reliability to mitigate the problems that flaky tests introduce, and (3) debugging assistance to ease the effort of diagnosing and fixing the true and flaky regression test failures. The PIs plan to develop techniques and tools based on a mix of static and dynamic program analyses, leveraging not only information from two project revisions (as traditional in regression testing) but also from all historical build and testing information available in CI testing. The PIs plan to embody their techniques in a tool-set and evaluate them extensively on open-source projects and in industrial collaborations. The broader impacts of enhancing continuous integration testing are to allow software developers to faster build higher quality software, which can benefit our modern society that greatly depends on software.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
持续集成(CI)是一种重要的软件开发活动,旨在通过自动化软件编译和回归测试来改进软件开发。 最近的研究表明,CI可以帮助开发人员更快地部署并降低开发成本。鉴于这些成功的故事,CI已经吸引了迅速增长的兴趣和采用,例如,Travis CI是目前最受欢迎的CI服务,被超过30万个GitHub项目使用。 尽管CI取得了成功,但开发人员报告说,他们希望看到CI的改进。首先,他们希望更快地获得回归测试结果。 其次,他们希望更好地处理所谓的回归测试,回归测试可以不确定地通过或失败,其失败会对开发人员的生产力产生负面影响。 第三,开发人员报告说,CI构建没有为失败的回归测试提供足够的调试帮助。 虽然回归测试已经研究了三十多年,但直到最近才在CI背景下进行研究。为了大幅改进CI中的回归测试,PI建议开发新的技术和工具来解决三个重要挑战:(1)测试选择,以加快回归测试和开发周期,(2)测试可靠性,以减轻重复测试引入的问题,以及(3)调试帮助,以减轻诊断和修复真实和非真实回归测试失败的工作。PI计划开发基于静态和动态程序分析的技术和工具,不仅利用来自两个项目修订版的信息(如回归测试中的传统信息),还利用CI测试中可用的所有历史构建和测试信息。PI计划将他们的技术体现在一个工具集中,并在开源项目和工业合作中对其进行广泛评估。增强持续集成测试的更广泛影响是允许软件开发人员更快地构建更高质量的软件,这可以使我们极大地依赖软件的现代社会受益。该奖项反映了NSF的法定使命,并通过使用基金会的知识价值和更广泛的影响审查标准进行评估,被认为值得支持。

项目成果

期刊论文数量(14)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
A retrospective study of one decade of artifact evaluations
十年工件评估的回顾性研究
A Tool for Mutation Analysis in Racket
Racket 中的突变分析工具
  • DOI:
    10.1109/icstw58534.2023.00061
  • 发表时间:
    2023
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Zhuang, Bambi;Perretta, James;Guha, Arjun;Bell, Jonathan
  • 通讯作者:
    Bell, Jonathan
Flaky Test Dataset to Accompany "FlakeFlagger: Predicting Flakiness Without Rerunning Tests"
伴随“FlakeFlagger:无需重新运行测试即可预测不稳定”的不稳定测试数据集
  • DOI:
    10.5281/zenodo.4450722
  • 发表时间:
    2021
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Alshammari, Abdulrahman;Morris, Christopher;Hilton, Michael;Bell, Jonathan
  • 通讯作者:
    Bell, Jonathan
CONFETTI: Amplifying Concolic Guidance for Fuzzers
The Effects of Computational Resources on Flaky Tests (Artifact)
计算资源对 Flaky 测试的影响(工件)
  • DOI:
    10.5281/zenodo.10015434
  • 发表时间:
    2023
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Silva, Denini;Gruber, Martin;Gokhale, Satyajit;Arteca, Ellen;Turcotte, Alexi;D'Amorim, Marcelo;Lam, Wing;Winter, Stefan;Bell, Jonathan
  • 通讯作者:
    Bell, Jonathan
{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Jonathan Bell其他文献

VMVM: unit test virtualization for Java
VMVM:Java 单元测试虚拟化
  • DOI:
  • 发表时间:
    2014
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Jonathan Bell;G. Kaiser
  • 通讯作者:
    G. Kaiser
A Gameful Approach to Teaching Software Design and Software Testing - Assignments and Quests
软件设计和软件测试教学的游戏方法 - 作业和任务
  • DOI:
  • 发表时间:
    2013
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Swapneel Sheth;Jonathan Bell;G. Kaiser
  • 通讯作者:
    G. Kaiser
Deep-Learning–Based Screening and Ancillary Testing for Thyroid Cytopathology
基于深度学习的甲状腺细胞病理学筛查和辅助检测
  • DOI:
    10.1016/j.ajpath.2023.05.011
  • 发表时间:
    2023-09-01
  • 期刊:
  • 影响因子:
    3.600
  • 作者:
    David Dov;Danielle Elliott Range;Jonathan Cohen;Jonathan Bell;Daniel J. Rocke;Russel R. Kahmke;Ahuva Weiss-Meilik;Walter T. Lee;Ricardo Henao;Lawrence Carin;Shahar Z. Kovalsky
  • 通讯作者:
    Shahar Z. Kovalsky
Describing System Functions that Depend on Intermittent and Sequential Behavior
描述依赖于间歇和顺序行为的系统功能
  • DOI:
  • 发表时间:
    2004
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Jonathan Bell;N. Snooke
  • 通讯作者:
    N. Snooke
Edinburgh Research Explorer Citizens for Eisenhower and the Republican Party, 1951-1965
艾森豪威尔和共和党爱丁堡研究探索者公民,1951-1965 年
  • DOI:
  • 发表时间:
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Jonathan Bell;Iwan Morgan;Byron Shafer;E. Shermer
  • 通讯作者:
    E. Shermer

Jonathan Bell的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Jonathan Bell', 18)}}的其他基金

Travel: NSF Student Travel Grant for 2024 ACM/IEEE International Conference on Software Engineering
旅行:2024 年 ACM/IEEE 软件工程国际会议 NSF 学生旅行补助金
  • 批准号:
    2413092
  • 财政年份:
    2024
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Standard Grant
CAREER: Amplifying Developer-Written Tests for Code Injection Vulnerability Detection
职业:扩大开发人员编写的代码注入漏洞检测测试
  • 批准号:
    2100015
  • 财政年份:
    2020
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Continuing Grant
Collaborative Research: RAPID: Virtual Conference Platform
协作研究:RAPID:虚拟会议平台
  • 批准号:
    2035003
  • 财政年份:
    2020
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Standard Grant
Collaborative Research: RAPID: Virtual Conference Platform
协作研究:RAPID:虚拟会议平台
  • 批准号:
    2055193
  • 财政年份:
    2020
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Standard Grant
NSF Student Travel Grant for 2019 ACM SIGPLAN Conference on Systems, Programming, Languages and Applications: Software for Humanity (SPLASH)
NSF 学生旅费补助金用于 2019 年 ACM SIGPLAN 系统、编程、语言和应用程序会议:人类软件 (SPLASH)
  • 批准号:
    1940760
  • 财政年份:
    2019
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Standard Grant
CAREER: Amplifying Developer-Written Tests for Code Injection Vulnerability Detection
职业:扩大开发人员编写的代码注入漏洞检测测试
  • 批准号:
    1844880
  • 财政年份:
    2019
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Continuing Grant
SHF: Medium: Collaborative Research: Enhancing Continuous Integration Testing for the Open-Source Ecosystem
SHF:媒介:协作研究:加强开源生态系统的持续集成测试
  • 批准号:
    1763822
  • 财政年份:
    2018
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Continuing Grant
NSF Student Travel Grant for 2018 ACM SIGPLAN Conference on Systems, Programming, Languages and Applications: Software for Humanity (SPLASH)
NSF 学生旅费补助金用于 2018 年 ACM SIGPLAN 系统、编程、语言和应用会议:人类软件 (SPLASH)
  • 批准号:
    1838986
  • 财政年份:
    2018
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Standard Grant
Radical Democrats: Ideology and Political Change in California in the Post-World War Two Era
激进民主党:第二次世界大战后加州的意识形态和政治变革
  • 批准号:
    AH/G002681/1
  • 财政年份:
    2009
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Research Grant
REU Summer Program in Computational Biology
REU 计算生物学暑期课程
  • 批准号:
    0354034
  • 财政年份:
    2004
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Continuing Grant

相似海外基金

Collaborative Research: SHF: Medium: Differentiable Hardware Synthesis
合作研究:SHF:媒介:可微分硬件合成
  • 批准号:
    2403134
  • 财政年份:
    2024
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Standard Grant
Collaborative Research: SHF: Medium: Enabling Graphics Processing Unit Performance Simulation for Large-Scale Workloads with Lightweight Simulation Methods
合作研究:SHF:中:通过轻量级仿真方法实现大规模工作负载的图形处理单元性能仿真
  • 批准号:
    2402804
  • 财政年份:
    2024
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Standard Grant
Collaborative Research: SHF: Medium: Tiny Chiplets for Big AI: A Reconfigurable-On-Package System
合作研究:SHF:中:用于大人工智能的微型芯片:可重新配置的封装系统
  • 批准号:
    2403408
  • 财政年份:
    2024
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Standard Grant
Collaborative Research: SHF: Medium: Toward Understandability and Interpretability for Neural Language Models of Source Code
合作研究:SHF:媒介:实现源代码神经语言模型的可理解性和可解释性
  • 批准号:
    2423813
  • 财政年份:
    2024
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Standard Grant
Collaborative Research: SHF: Medium: Enabling GPU Performance Simulation for Large-Scale Workloads with Lightweight Simulation Methods
合作研究:SHF:中:通过轻量级仿真方法实现大规模工作负载的 GPU 性能仿真
  • 批准号:
    2402806
  • 财政年份:
    2024
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Standard Grant
Collaborative Research: SHF: Medium: Differentiable Hardware Synthesis
合作研究:SHF:媒介:可微分硬件合成
  • 批准号:
    2403135
  • 财政年份:
    2024
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Standard Grant
Collaborative Research: SHF: Medium: Tiny Chiplets for Big AI: A Reconfigurable-On-Package System
合作研究:SHF:中:用于大人工智能的微型芯片:可重新配置的封装系统
  • 批准号:
    2403409
  • 财政年份:
    2024
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Standard Grant
Collaborative Research: SHF: Medium: Enabling GPU Performance Simulation for Large-Scale Workloads with Lightweight Simulation Methods
合作研究:SHF:中:通过轻量级仿真方法实现大规模工作负载的 GPU 性能仿真
  • 批准号:
    2402805
  • 财政年份:
    2024
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Standard Grant
Collaborative Research: SHF: Medium: High-Performance, Verified Accelerator Programming
合作研究:SHF:中:高性能、经过验证的加速器编程
  • 批准号:
    2313024
  • 财政年份:
    2023
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Standard Grant
Collaborative Research: SHF: Medium: Verifying Deep Neural Networks with Spintronic Probabilistic Computers
合作研究:SHF:中:使用自旋电子概率计算机验证深度神经网络
  • 批准号:
    2311295
  • 财政年份:
    2023
  • 资助金额:
    $ 32.84万
  • 项目类别:
    Continuing Grant
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了