Fault-based Testing of Evolving Real-time Systems

不断发展的实时系统的基于故障的测试

• 批准号: RGPIN-2020-07248
• 负责人: NGUENATIMO, Omer
• 金额: $ 1.75万
• 依托单位: Québec en Outaouais
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=764486
• 关键词: Fault; based; Testing; Evolving; Real

Failures of evolving real-time systems are not seldom. These systems include but are not limited to control and security systems, communication protocols in domains such as the aerospace, the automotive, finance and the popular web and mobile applications. A real-time system maintains a current state that it uses to react to the stimuli from the environment and it is organized in communicating components. Components can evolve following the end-user needs or change in the environment. Failures of the systems can be caused by logical and timing faults, or vulnerabilities introduced at the different phases of the system design. Failures result in damages yielding to the loss of confidence in the systems and their rejection by the end-users. The long-term objective of this research program is to propose and develop a fault-based testing theory that can be applied to detect logical, timing and security faults in evolving real-time systems. We will consider faults introduced at the unit and integration phases of the system development. I plan to use formal representations (specifications) of logical, timing and security properties of systems such as state transition machines. This work will provide testing tool developers with efficient methods for the fault detection in evolving real-time systems. The Novelty of the proposed research includes proposing an approach to build specifications of evolving real-time systems and a fault model to represent specific faults to be detected, and methods of test analysis, test generation and test selection for the detection of the specific unit and integration faults. A fault model is defined as a tuple of a specification, a fault domain and a conformance relation. The fault domain represents a set of faulty implementations obtained by seeding faults in the specification. Specific faults can be made available in databases or by an expert; a limited number of tests allows detecting them with reduced testing efforts, which is in line with the objectives and practices of the industry. We also generate optimal tests having reduced execution times. We will use deterministic or nondeterministic models with timing and probabilistic constraints to capture logical, timing and evolution properties of the systems. The methods will benefit from the recent advances in fields such as constraint solving, symbolic execution, abstract interpretation and model learning. We will implement the proposed methods in proof-of-concept tools. The expected results will have a significant impact on the scientific knowledge and industrial practices in testing. Numerous industrial projects executed by CRIM create a proper opportunity to increase awareness of industrial partners about systematic approaches in testing. Ten HQPs (2 PhD, 3 MSc, 5 BSc) will participate in this research. The skills gained by the HQPs in formal modeling and fault-based testing will be beneficial to all of them and to the development evolving real-time systems.

不断发展的实时系统的故障并不少见。这些系统包括但不限于控制和安全系统，航空航天、汽车、金融以及流行的网络和移动应用程序等领域的通信协议。实时系统保持当前状态，用于对来自环境的刺激做出反应，并组织在通信组件中。组件可以随着最终用户的需求或环境的变化而发展。系统的故障可能是由逻辑和时序错误或在系统设计的不同阶段引入的漏洞引起的。失败导致损害，导致对系统失去信心，并被最终用户拒绝。本研究计划的长期目标是提出并发展一种基于故障的测试理论，该理论可用于检测不断发展的实时系统中的逻辑、时序和安全故障。我们将考虑在系统开发的单元和集成阶段引入的故障。我计划使用系统（如状态转换机）的逻辑、定时和安全属性的正式表示（规范）。这项工作将为测试工具开发人员在不断发展的实时系统中提供有效的故障检测方法。本研究的新颖之处在于提出了一种构建演化实时系统规范的方法和一种表示待检测特定故障的故障模型，以及用于检测特定单元和集成故障的测试分析、测试生成和测试选择方法。故障模型被定义为规范、故障域和一致性关系的元组。故障域表示通过在规范中播种故障而获得的一组故障实现。具体的故障可以在数据库中或由专家提供；有限数量的测试可以减少测试工作量来检测它们，这符合行业的目标和实践。我们还生成了执行时间较短的最佳测试。我们将使用具有时序和概率约束的确定性或非确定性模型来捕获系统的逻辑、时序和进化属性。这些方法将受益于约束求解、符号执行、抽象解释和模型学习等领域的最新进展。我们将在概念验证工具中实现所提出的方法。预期的结果将对测试的科学知识和工业实践产生重大影响。由CRIM执行的许多工业项目为提高工业合作伙伴对系统测试方法的认识创造了适当的机会。10名HQPs（2名PhD， 3名MSc， 5名BSc）将参与本研究。hqp在形式化建模和基于故障的测试中获得的技能将对他们所有人以及不断发展的实时系统的开发都有益。