Study of Multi-Modal Interface based on Simultaneous Understanding of Spoken Language

基于口语同步理解的多模态界面研究

• 批准号: 10480070
• 负责人: INAGAKI Yasuyoshi
• 金额: $ 4.67万
• 依托单位: Nagoya University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (B)
• 财政年份: 1998
• 资助国家: 日本
• 起止时间: 1998 至 1999
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-10480070/
• 关键词: Multi-Modal Interface; Spoken Language Processing; Natural Language Processing; Incremental Interpretation of Natural Language; Simultaneous Understanding; Spontaneous Reply; Spoken Language Understanding; Spoken Dialogue; マルチモーダルインタフェース; 図形エディタ

The spoken dialog systems has been studied to help persons who cannot use hands or pointing devices and who do not familiar with keyboard nor computers. In this research project, we develop the system named Sync/Mail, which is a multi-modal drawing tool which incrementally understands speech and quickly responds for inputs. To implement the system, we investigate following topics.(1) Incremental Interpretation of Spoken LanguageConventional natural language processing systems manage natural language input by sentence-by-sentence basis process. Our incremental system processes the input by word-by-word basis. This method enables the spontaneous reply of input.(2) Incremental Continuous Speech Recognition(3) Method of Integration for Multi-Domain SystemsTo build the unified system for multi-domain task, it is required the method to integrate the several single-domain dialogue system into the one unified system. We proposed an extensible and scalable architecture for the multi-domain, multi-modal conversational systems.

已经研究了口语对话系统，以帮助那些不能使用手或指向设备以及不熟悉键盘和计算机的人。在这个研究项目中，我们开发了一个名为Sync/Mail的系统，这是一个多模态的绘图工具，它可以增量地理解语音并快速响应输入。为了实现该系统，我们研究了以下主题。(1)传统的自然语言处理系统通过逐句处理来管理自然语言输入。我们的增量系统处理的输入由一个字一个字的基础。这种方法使输入的自发回复成为可能。(2)增量式连续语音识别（3）多领域系统的集成方法为了建立多领域任务的统一系统，需要将多个单领域的对话系统集成到一个统一的系统中。针对多领域、多模态会话系统，提出了一种可扩展、可升级的体系结构。

项目成果

Nobuo Kawaguchi: "An Architecture for Multi-Domain Spoken Dialog Systems"Proceedings of the NLPRS '99. 463-466 (1999)

Nobuo Kawaguchi：“多域语音对话系统的架构”NLPRS 99 论文集。

Nobuo Kawaguchi, Shigeki Matsubara, Katsuhiko Toyama and Yasuyoshi Inagaki: "An Architechture for Multi-Domain Spoken Dialog Systems"Proceedings of the 5th Natural Language Processing Pacific Rim Symposium (NL-PRS'99). 463-466 (1999)

Nobuo Kawaguchi、Shigeki Matsubara、Katsuhiko Toyama 和 Yasuyoshi Inagaki：“多域口语对话系统的架构”第五届环太平洋自然语言处理研讨会 (NL-PRS99) 论文集。

Shigeki Matsubara: "Sync/Trans: Simultaneous Machine Interpretation between English and Japanese"Lecture Note in Artificial Intelligence. 1747. 134-143 (1999)

Shigeki Matsubara：“Sync/Trans：英语和日语之间的同步机器翻译”人工智能讲义。

加藤芳秀: "確率文脈自由文法を用いた漸進的構文解析における出力タイミング決定手法"情報処理学会第59回全国大会講演論文集. 4. 120-121 (1999)

Yoshihide Kato：“使用概率上下文无关语法的渐进解析中的输出时序确定方法”第 59 届日本信息处理学会全国会议论文集。4. 120-121 (1999)。

Muhtar Mahsut: "A Method of Word Selection in Japanese-Uighur Machine Translation using Latent Semantic Analysis"Proceedings of the NLPRS '99. 459-462 (1999)

Muhtar Mahsut：“使用潜在语义分析的日文-维吾尔文机器翻译中的词选择方法”NLPRS 99 论文集。