Formal specification description of multi-modal interface and its verification

多模态接口形式化规范描述及其验证

• 批准号: 12308015
• 负责人: INAGAKI Yasuyoshi
• 金额: $ 20.25万
• 依托单位: Nagoya University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (A)
• 财政年份: 2000
• 资助国家: 日本
• 起止时间: 2000 至 2002
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-12308015/
• 关键词: user model; knowledge model; dialogue model; user interface; in-car spoken dialogue; task domain; evaluation experiment; database; 被験者実験; データペース; マルチモーダルインタフェース; 音声対話コーパス; 形式的仕様記述; 音声言語処理; 漸進的解釈; 同時通訳; 意図理解; マルチエージェント

We advanced the research from the preceding year further, performed the formal description for the multi-modal interface in the current fiscal year, and developed the technique of its evaluation. Specifically, the following research topics were promoted.User model : we examined how to describe the user's behavior, toward the realization of a user model. Especially, we confirmed that describing correctly the behavior of a user, which becomes important in the principle of a user interface, allows more precise verification of the specification of a system. While collecting and analyzing the previous research result about the principle of a user interface, aiming at describing as behavior based on a user's knowledge, the subject experiment using the telephone etc. was conducted and these results were evaluated.Knowledge model : the knowledge model for expressing the knowledge state between a user and a system was examined. Since a knowledge model which can describe various task domains was … More asked, the task domain dialogues of the system developed so far were collected. The cooperation possibility with other models was confiremed by analyzing this model.Dialogue model : the dialogue model was analyzed using large-scale corpora, such as an in-car spoken dialogue database and a simultaneous interpretation database which are currently collected at the Center for Integrated Acoustic Information Research, Nagoya University. Statistical characteristic features were drawn and the formalization of the dialogue model in various situations was considered.Formal specification description : the multi-modal interface was described formally by making cooperate and complement of a user model, a knowledge model, and a dialogue model mutually. The technique of specification description obtained by the preceding year was summarized, and the verification work was prepared.Three kinds of above-mentioned models were analyzed in detail, a still more formal description was defined, and the foundation of the evaluation method was established. The possibility of the comparison of a system and the evaluation, and the reuse to an advancement was confirmed by formalizing various interfaces by universal specification description. Less

我们进一步推进了前一年的研究，对本财年的多模态接口进行了形式化描述，并开发了其评估技术。具体而言，提出了以下研究课题：用户模型：研究如何描述用户的行为，实现用户模型。特别是，我们确认，正确地描述用户的行为，这在用户界面的原理中变得很重要，可以更精确地验证系统的规格。在收集和分析以前关于用户界面原理的研究结果的同时，以描述为基于用户知识的行为为目标，进行了使用电话等的主题实验，并对这些结果进行了评估。知识模型：研究了用于表示用户和系统之间的知识状态的知识模型。由于一个能够描述各种任务域的知识模型， ...更多信息 收集了迄今为止开发的系统的任务域对话。对话模型：使用名古屋大学综合音响信息研究中心目前收集的车内对话数据库和同声传译数据库等大规模语料库，对对话模型进行了分析。形式化规范描述：通过用户模型、知识模型和对话模型的相互配合和补充，对多模态界面进行形式化描述。总结了前一年取得的规格说明描述技术，准备了验证工作，对上述三种模型进行了详细分析，定义了更形式化的描述，为评价方法奠定了基础。通过统一的规范描述形式化各种接口，证实了系统的比较和评估以及重用的可能性。少

项目成果

Yoshihide Kato, Shigeki Matsubara, Katsuhiko Toyama and Inagaki Yasuyo-shi: "Incremental Dependency Parsing Based on Headed Context Free Grammar"Transactions of the Institute of Electronic Information and Communication Engineers. J86-D-II-1. 84-97 (2003)

Yoshihide Kato、Shigeki Matsubara、Katsuhiko Toyama 和 Inagaki Yasuyo-shi：“基于头状上下文无关语法的增量依存分析”电子信息与通信工程师学会汇刊。

松原 茂樹: "Stochastic Dependency Parsing of Spontaneous Japanese Spoken Language"Proceedings of 17^<th> International Conference on Computational Linguistics. 1. 640-645 (2002)

Shigeki Matsubara：“自发日语口语的随机依存分析”第 17 届国际计算语言学会议论文集 1. 640-645 (2002)。

加藤 芳秀: "主辞情報付き文脈自由文法に基づく漸進的な依存構造解析"電子情報通信学会論文誌. J86-D-II・1. 84-97 (2003)

加藤义秀：“基于带有头部信息的上下文无关语法的渐进依存结构分析”电子信息通信工程师学会学报J86-D-II·1（2003）。

Nobuo Kawaguchi: "Multimedia Data Collection of In-Car Speech Communication"Proc. of the 7th Eurpean Conference on Speech Communication and Technology(EUROSPEECH2001). 2027-2030 (2001)

Nobuo Kawaguchi：“车载语音通信的多媒体数据采集”Proc。

河口 信夫: "実走行車内音声対話データベース"電子情報通信学会技術研究報告. SP-2001-107. 31-36 (2001)

Nobuo Kawaguchi：“实际车载语音对话数据库”IEICE SP-2001-107 (2001)。