Test case generation for agent-based models: A systematic literature review
Test case generation for agent-based models: A systematic literature review
复制标题
DOI：
10.1016/j.infsof.2021.106567
复制
发表时间：
2021-03
期刊：
影响因子：
--
通讯作者：
Andrew Clark;Neil Walkinshaw;R. Hierons
中科院分区：
文献类型：
--
作者：
Andrew Clark;Neil Walkinshaw;R. Hierons
基于ContextAgent的模型在模拟复杂的突发现象和支持关键决策方面发挥着重要作用。在这种情况下，软件故障可能导致信息不充分的决策，从而导致灾难性的后果。因此，严格测试这些模型的能力是必不可少的。我们的目标是总结国家的最先进的技术，在基于代理的模型中的测试用例生成，并确定未来的研究方向。MethodWe进行了系统的文献综述，我们提出了五个研究问题相关的关键方面，在基于代理的模型中的测试用例生成：什么是用于生成测试的信息工件？这些测试是如何生成的？如何将判定分配给生成的测试？如何衡量生成的测试套件的充分性？生成的测试针对基于代理的模型的什么抽象级别？结果在464个初始检索结果中，我们确定了24个主要出版物。基于这些主要出版物，我们形成了一个分类法，总结了最先进的技术，在基于代理的模型中的测试用例生成。我们的研究结果表明，虽然大多数技术是有效的测试功能需求的代理和集成抽象层次，有相对较少的技术能够测试社会层面的行为。此外，大多数的技术不能测试非功能性的要求或“软目标”。ConclusionsThis本文报告洞察的关键发展和开放的挑战，有关测试用例生成的基于代理的模型，可能是感兴趣的研究人员和从业人员。特别是，我们确定需要测试用例生成技术，专注于社会和非功能行为，并使用现实的案例研究，具有挑战性的属性与典型的基于代理的模型进行更彻底的评估。
ContextAgent-based models play an important role in simulating complex emergent phenomena and supporting critical decisions. In this context, a software fault may result in poorly informed decisions that lead to disastrous consequences. The ability to rigorously test these models is therefore essential.ObjectiveOur objective is to summarise the state-of-the-art techniques for test case generation in agent-based models and identify future research directions.MethodWe have conducted a systematic literature review in which we pose five research questions related to the key aspects of test case generation in agent-based models: What are the information artifacts used to generate tests? How are these tests generated? How is a verdict assigned to a generated test? How is the adequacy of a generated test suite measured? What level of abstraction of an agent-based model is targeted by a generated test?ResultsOut of the 464 initial search results, we identified 24 primary publications. Based on these primary publications, we formed a taxonomy to summarise the state-of-the-art techniques for test case generation in agent-based models. Our results show that whilst the majority of techniques are effective for testing functional requirements at the agent and integration levels of abstraction, there are comparatively few techniques capable of testing society-level behaviour. Furthermore, the majority of techniques cannot test non-functional requirements or “soft goals”.ConclusionsThis paper reports insights into the key developments and open challenges concerning test case generation in agent-based models that may be of interest to both researchers and practitioners. In particular, we identify the need for test case generation techniques that focus on societal and non-functional behaviour, and a more thorough evaluation using realistic case studies that feature challenging properties associated with a typical agent-based model.