Situated multi-modal dialog system in vehicles
Situated multi-modal dialog system in vehicles
复制标题
车载多模态对话系统
DOI：
--
复制
发表时间：
2013
期刊：
影响因子：
--
通讯作者：
Rakesh Gupta
中科院分区：
文献类型：
--
作者：
Teruhisa Misu;Antoine Raux;Ian Lane;Joan Devassy;Rakesh Gupta
在本文中，我们讨论 Townsurfer，一种车辆中的情境多模式对话系统。该系统集成了语音、地理位置、凝视（面部方向）和对话历史记录的多模态输入，以回答驾驶员关于周围环境的询问。为了选择用于回答查询的适当数据源，我们在上述模式中应用信念跟踪。我们进行了初步数据收集和评估，重点关注凝视（头部方向）和地理位置估计的效果。我们报告结果和数据分析。
In this paper, we address Townsurfer, a situated multi-modal dialog system in vehicles. The system integrates multi-modal inputs of speech, geo-location, gaze (face direction) and dialog history to answer drivers' queries about their surroundings. To select appropriate data source used to answer queries, we apply belief tracking across the above modalities. We conducted a preliminary data collection and an evaluation focusing on the effect of gaze (head irection) and geo-location estimations. We report the result and analysis on the data.