Fault-based Testing of Evolving Real-time Systems

不断发展的实时系统的基于故障的测试

• 批准号: RGPIN-2020-07248
• 负责人: NguenaTimo, Omer
• 金额: $ 1.75万
• 依托单位: Centre de recherche informatique de Montréal
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2020
• 资助国家: 加拿大
• 起止时间: 2020-01-01 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=718610
• 关键词: Fault; based; Testing; Evolving; Real

Failures of evolving real-time systems are not seldom. These systems include but are not limited to control and security systems, communication protocols in domains such as the aerospace, the automotive, finance and the popular web and mobile applications. A real-time system maintains a current state that it uses to react to the stimuli from the environment and it is organized in communicating components. Components can evolve following the end-user needs or change in the environment. Failures of the systems can be caused by logical and timing faults, or vulnerabilities introduced at the different phases of the system design. Failures result in damages yielding to the loss of confidence in the systems and their rejection by the end-users. The long-term objective of this research program is to propose and develop a fault-based testing theory that can be applied to detect logical, timing and security faults in evolving real-time systems. We will consider faults introduced at the unit and integration phases of the system development. I plan to use formal representations (specifications) of logical, timing and security properties of systems such as state transition machines. This work will provide testing tool developers with efficient methods for the fault detection in evolving real-time systems. The Novelty of the proposed research includes proposing an approach to build specifications of evolving real-time systems and a fault model to represent specific faults to be detected, and methods of test analysis, test generation and test selection for the detection of the specific unit and integration faults. A fault model is defined as a tuple of a specification, a fault domain and a conformance relation. The fault domain represents a set of faulty implementations obtained by seeding faults in the specification. Specific faults can be made available in databases or by an expert; a limited number of tests allows detecting them with reduced testing efforts, which is in line with the objectives and practices of the industry. We also generate optimal tests having reduced execution times. We will use deterministic or nondeterministic models with timing and probabilistic constraints to capture logical, timing and evolution properties of the systems. The methods will benefit from the recent advances in fields such as constraint solving, symbolic execution, abstract interpretation and model learning. We will implement the proposed methods in proof-of-concept tools. The expected results will have a significant impact on the scientific knowledge and industrial practices in testing. Numerous industrial projects executed by CRIM create a proper opportunity to increase awareness of industrial partners about systematic approaches in testing. Ten HQPs (2 PhD, 3 MSc, 5 BSc) will participate in this research. The skills gained by the HQPs in formal modeling and fault-based testing will be beneficial to all of them and to the development evolving real-time systems.

演化实时系统的失败并不少见。这些系统包括但不限于控制和安全系统、诸如航空航天、汽车、金融和流行的web和移动的应用等领域中的通信协议。实时系统保持当前状态，用于对来自环境的刺激做出反应，并组织在通信组件中。组件可以根据最终用户的需求或环境的变化而发展。系统故障可能是由逻辑和时序故障或系统设计不同阶段引入的漏洞造成的。故障造成损害，导致对系统失去信心，并被最终用户拒绝。 本研究计划的长期目标是提出并开发一种基于故障的测试理论，可用于检测不断发展的实时系统中的逻辑，时序和安全故障。我们将考虑在系统开发的单元和集成阶段引入的故障。我计划使用系统（如状态转换机）的逻辑、时序和安全属性的形式化表示（规范）。这项工作将为测试工具开发人员提供有效的方法，在不断发展的实时系统的故障检测。 该研究的新奇之处在于提出了一种建立实时系统规范的方法和一种故障模型来表示待检测的特定故障，以及用于检测特定单元和集成故障的测试分析、测试生成和测试选择方法。故障模型被定义为一个元组的规格说明，故障域和一致性关系。故障域表示通过在规范中播种故障而获得的一组故障实现。特定故障可以在数据库中或由专家提供;有限数量的测试允许以减少的测试工作来检测它们，这符合行业的目标和实践。我们还生成具有减少的执行时间的最佳测试。我们将使用确定性或非确定性模型与时间和概率约束，以捕捉系统的逻辑，时间和演化特性。这些方法将受益于约束求解、符号执行、抽象解释和模型学习等领域的最新进展。我们将在概念验证工具中实现所提出的方法。 预期结果将对测试中的科学知识和工业实践产生重大影响。CRIM执行的许多工业项目为提高工业合作伙伴对系统测试方法的认识创造了适当的机会。 10名HQP（2名博士，3名硕士，5名学士）将参与这项研究。HQP在形式化建模和基于故障的测试中所获得的技能将对他们所有人以及对不断发展的实时系统的开发都是有益的。