Evaluation and Comparison of Inferred Regular Grammars

Evaluation and Comparison of Inferred Regular Grammars
复制标题

推断正则语法的评估和比较

DOI:
--
复制
发表时间:
2008
期刊:
International Conference on Graphics and Interaction
影响因子:
--
通讯作者:
Kent Johnson
Kent Johnson
中科院分区:
--
文献类型:
--
作者:
Neil Walkinshaw;K. Bogdanov;Kent Johnson

文献摘要

被引文献

相似文献

通常,通过测量从目标语法产生的序列的随机样本中正确分类的序列百分比来计算推断语法的准确性。这种方法是有问题的,因为(a)序列的随机样本不可能充分地测试语法,并且(b)使用单个概率值几乎没有洞悉语法(不正确)准确的程度。本文通过提出从软件工程领域到系统生成测试集的使用基于模型的测试技术的使用,以及使用精度和从信息检索领域的召回度量来解决精度表示准确性的精度,以解决这两个问题。推断的机器。
The accuracy of an inferred grammar is commonly computed by measuring the percentage of sequences that are correctly classified from a random sample of sequences produced by the target grammar. This approach is problematic because (a) it is unlikely that a random sample of sequences will adequately test the grammar and (b) the use of a single probability value provides little insight into the extent to which a grammar is (in-)accurate. This paper addresses these two problems by proposing the use of established model-based testing techniques from the field of software engineering to systematically generate test sets, along with the use of the Precision and Recall measure from the field of information retrieval to concisely represent the accuracy of the inferred machine.