MATCH: An Architecture for Multimodal Dialogue Systems

MATCH: An Architecture for Multimodal Dialogue Systems
复制标题

MATCH:多模态对话系统的架构

DOI:
--
复制
发表时间:
2002
期刊:
Annual Meeting of the Association for Computational Linguistics
影响因子:
--
通讯作者:
Preetam Maloor
Preetam Maloor
中科院分区:
--
文献类型:
--
作者:
Michael Johnston;S. Bangalore;Gunaranjan Vasireddy;Amanda Stent;Patrick Ehlen;M. Walker;S. Whittaker;Preetam Maloor

文献摘要

被引文献

相似文献

移动的接口需要允许用户和系统根据用户偏好、手头的任务以及物理和社会环境来调整他们对通信模式的选择。我们描述了一个多模态应用程序架构,它结合了有限状态多模态语言处理,基于语音行为的多模态对话管理器,动态多模态输出生成,和用户量身定制的文本规划,使灵活的输入和自适应输出的多模态界面的快速原型。我们的测试平台应用程序MATCH(Multimodal Access To City Help)为纽约市的餐厅和地铁信息提供了一个移动的多模式语音笔界面。
Mobile interfaces need to allow the user and system to adapt their choice of communication modes according to user preferences, the task at hand, and the physical and social environment. We describe a multimodal application architecture which combines finite-state multimodal language processing, a speech-act based multimodal dialogue manager, dynamic multimodal output generation, and user-tailored text planning to enable rapid prototyping of multimodal interfaces with flexible input and adaptive output. Our testbed application MATCH (Multimodal Access To City Help) provides a mobile multimodal speech-pen interface to restaurant and sub-way information for New York City.