SHF: Small:Testing in the Presence of Continuous Change

SHF：小：在持续变化的情况下进行测试

• 批准号: 1526652
• 负责人: Sebastian Elbaum
• 金额: $ 42.5万
• 依托单位: University of Nebraska-Lincoln
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-08-01 至 2018-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1526652&HistoricalAwards=false
• 关键词: SHF; Small; Testing; Presence; Continuous

Many organizations that develop software are utilizing continuous integrationprocesses, in which engineers merge code frequently with the mainline codebase,and continuously regression test it. The pace at which evolution occurs insuch environments, and the numbers of tests that must be run, can be staggering.To ensure the quality of software in these situations, testing processes needto adapt quickly to changes in available resources, testing request frequency,and product release cycles. Tests must be chosen and scheduled appropriately,tests must be analyzed for robustness, and testing processes must beappropriately monitored. The proposed work addresses these needs, and byfocusing on software dependability, the work promises to benefit bothproducers (i.e., software developers) and consumers (i.e., the public at large)of software.This work will create new techniques for scheduling test cases duringcontinuous testing based on their historical effectiveness, the relationshipsbetween tests and changes, and their potential for execution; these techniqueswill also be able to adapt to release practices and environmental changes, andwill be supported by analysis techniques that are efficient enough for use inCI testing situations. The work will involve studying the effect of problemsrelated to test design, and developing lightweight static and dynamictechniques for analyzing test cases and test suites to determine whether theymay be problematic. The work will lead to the creation of new approaches fortest monitoring, and the definition of new metrics that capture test and testsuite attributes and states for the assessment of testing results in continuoustesting processes. Finally, the work will result in the creation ofinfrastructure to support rigorous empirical assessments of the techniquesdeveloped.

许多开发软件的组织都在使用连续的集成程序，其中工程师经常将代码与主线代码库合并，并不断回归对其进行测试。 进化发生的速度以及必须运行的测试数量可能会令人震惊。为了确保在这些情况下软件的质量，测试过程需要快速适应可用资源的变化，测试请求频率和产品释放周期。 必须选择测试并适当地安排测试，必须分析测试以鲁棒性，并且必须对测试过程进行调整。 拟议的工作满足了这些需求，并在软件可靠性上征用，这项工作有望使生产者（即软件开发人员）和消费者（即，在整个软件的公众）中受益。这项工作将创建新技术，以根据其历史效果和潜在的关系和执行的潜在的关系，以在临时测试期间安排测试案例的新技术；这些技术还将能够适应释放实践和环境变化，并将通过足够有效使用INCI测试情况的​​分析技术来支持。 这项工作将涉及研究与测试设计相关的问题，并开发轻量级静态和动态技术，以分析测试案例和测试套件以确定它们是否有问题。这项工作将导致创建最新方法的新方法，并定义新的指​​标，以捕获测试和测试属性属性和状态以评估测试结果。 最后，这项工作将导致建立基础设施，以支持对技术的严格经验评估。