Formal specification description of multi-modal interface and its verification

我们在前一年的基础上进一步推进了研究，对本财政年度的多通道界面进行了形式化描述，并开发了多通道界面的评估技术。具体地说，提出了以下研究课题。用户模型：我们研究了如何描述用户的行为，从而实现了一个用户模型。特别是，我们确认，正确地描述用户的行为，这在用户界面的原则中变得重要，可以更精确地验证系统的规范。在收集和分析前人关于用户界面原理的研究成果的基础上，针对基于用户知识的行为描述，利用电话等进行了主题实验，并对实验结果进行了评价。知识模型：考察了表示用户与系统之间知识状态的知识模型。由于可以描述各种任务领域知识模型是…更多的询问，收集了到目前为止开发的系统的任务域对话。对话模型：利用名古屋大学综合声学信息研究中心目前收集的车载口语对话数据库和同声传译数据库等大型语料库对对话模型进行分析。形式化规范描述：通过用户模型、知识模型和对话模型的相互配合和互补，对多通道界面进行形式化描述。总结了前一年获得的规范描述技术，准备了验证工作；详细分析了上述三种模型，定义了更形式化的描述，为评估方法奠定了基础。通过用通用规范描述形式化各种接口，确认了系统和评估的比较以及重用为进步的可能性。较少

We advanced the research from the preceding year further, performed the formal description for the multi-modal interface in the current fiscal year, and developed the technique of its evaluation. Specifically, the following research topics were promoted.User model : we examined how to describe the user's behavior, toward the realization of a user model. Especially, we confirmed that describing correctly the behavior of a user, which becomes important in the principle of a user interface, allows more precise verification of the specification of a system. While collecting and analyzing the previous research result about the principle of a user interface, aiming at describing as behavior based on a user's knowledge, the subject experiment using the telephone etc. was conducted and these results were evaluated.Knowledge model : the knowledge model for expressing the knowledge state between a user and a system was examined. Since a knowledge model which can describe various task domains was … More asked, the task domain dialogues of the system developed so far were collected. The cooperation possibility with other models was confiremed by analyzing this model.Dialogue model : the dialogue model was analyzed using large-scale corpora, such as an in-car spoken dialogue database and a simultaneous interpretation database which are currently collected at the Center for Integrated Acoustic Information Research, Nagoya University. Statistical characteristic features were drawn and the formalization of the dialogue model in various situations was considered.Formal specification description : the multi-modal interface was described formally by making cooperate and complement of a user model, a knowledge model, and a dialogue model mutually. The technique of specification description obtained by the preceding year was summarized, and the verification work was prepared.Three kinds of above-mentioned models were analyzed in detail, a still more formal description was defined, and the foundation of the evaluation method was established. The possibility of the comparison of a system and the evaluation, and the reuse to an advancement was confirmed by formalizing various interfaces by universal specification description. Less