Fault-based Testing of Evolving Real-time Systems

不断发展的实时系统的故障并不少见。这些系统包括但不限于控制和安全系统、航空航天、汽车、金融以及流行的网络和移动应用等领域的通信协议。实时系统维护它用来对来自环境的刺激做出反应的当前状态，并且它由通信组件组成。组件可以随着最终用户的需求或环境中的变化而发展。系统故障可能是由逻辑和时序错误或在系统设计的不同阶段引入的漏洞引起的。故障导致损害，导致对系统失去信心，并被最终用户拒绝。 这一研究计划的长期目标是提出并发展一种基于故障的测试理论，该理论可用于检测不断发展的实时系统中的逻辑、时序和安全故障。我们将考虑在系统开发的单元和集成阶段引入的故障。我计划使用系统的逻辑、定时和安全属性的形式表示(规范)，例如状态转换机。这项工作将为测试工具开发者提供有效的方法来检测演化实时系统中的故障。 该研究的创新之处包括提出了一种构建演化实时系统规格说明的方法和表示特定待检测故障的故障模型，以及用于检测特定单元和集成故障的测试分析、测试生成和测试选择方法。故障模型被定义为规范、故障域和一致性关系的元组。故障域表示通过在规范中播种错误而获得的一组错误实现。特定故障可以在数据库中或由专家提供；有限数量的测试允许以更少的测试工作量来检测它们，这符合行业的目标和实践。我们还生成了减少了执行时间的优化测试。我们将使用带有时间和概率约束的确定性或非确定性模型来捕获系统的逻辑、时间和演化属性。这些方法将受益于约束求解、符号执行、抽象解释和模型学习等领域的最新进展。我们将在概念验证工具中实现建议的方法。 预期的结果将对检测中的科学知识和行业实践产生重大影响。CRIM执行的许多工业项目创造了一个适当的机会，以提高工业合作伙伴对测试系统方法的认识。 10名HQP(2名博士、3名硕士、5名学士)将参与本次研究。HQP在形式化建模和基于故障的测试中获得的技能将对他们所有人以及开发不断发展的实时系统都是有益的。

Failures of evolving real-time systems are not seldom. These systems include but are not limited to control and security systems, communication protocols in domains such as the aerospace, the automotive, finance and the popular web and mobile applications. A real-time system maintains a current state that it uses to react to the stimuli from the environment and it is organized in communicating components. Components can evolve following the end-user needs or change in the environment. Failures of the systems can be caused by logical and timing faults, or vulnerabilities introduced at the different phases of the system design. Failures result in damages yielding to the loss of confidence in the systems and their rejection by the end-users. The long-term objective of this research program is to propose and develop a fault-based testing theory that can be applied to detect logical, timing and security faults in evolving real-time systems. We will consider faults introduced at the unit and integration phases of the system development. I plan to use formal representations (specifications) of logical, timing and security properties of systems such as state transition machines. This work will provide testing tool developers with efficient methods for the fault detection in evolving real-time systems. The Novelty of the proposed research includes proposing an approach to build specifications of evolving real-time systems and a fault model to represent specific faults to be detected, and methods of test analysis, test generation and test selection for the detection of the specific unit and integration faults. A fault model is defined as a tuple of a specification, a fault domain and a conformance relation. The fault domain represents a set of faulty implementations obtained by seeding faults in the specification. Specific faults can be made available in databases or by an expert; a limited number of tests allows detecting them with reduced testing efforts, which is in line with the objectives and practices of the industry. We also generate optimal tests having reduced execution times. We will use deterministic or nondeterministic models with timing and probabilistic constraints to capture logical, timing and evolution properties of the systems. The methods will benefit from the recent advances in fields such as constraint solving, symbolic execution, abstract interpretation and model learning. We will implement the proposed methods in proof-of-concept tools. The expected results will have a significant impact on the scientific knowledge and industrial practices in testing. Numerous industrial projects executed by CRIM create a proper opportunity to increase awareness of industrial partners about systematic approaches in testing. Ten HQPs (2 PhD, 3 MSc, 5 BSc) will participate in this research. The skills gained by the HQPs in formal modeling and fault-based testing will be beneficial to all of them and to the development evolving real-time systems.