Multimedia data collection of in-car speech communication
Multimedia data collection of in-car speech communication
复制标题
车内语音通信多媒体数据采集
DOI：
10.21437/eurospeech.2001-478
复制
发表时间：
2001
期刊：
影响因子：
--
通讯作者：
F. Itakura
中科院分区：
文献类型：
--
作者：
Nobuo Kawaguchi;S. Matsubara;K. Takeda;F. Itakura
在本文中，我们报告的多媒体数据，如音频，视频和车辆的辅助信息，在一个口语对话在移动的汽车收集的细节。该系统专门内置于数据采集车（DCV）中，支持同步记录来自16个麦克风的多通道音频数据，这些麦克风可以放置在灵活的位置，来自3个摄像头的多通道视频数据以及车辆相关数据。多媒体数据已经收集了三个会话的口语对话，在约60分钟的车程由200名受试者。收集了两种对话模式的数据：（1）驾驶员和随行操作员之间的提示对话和（2）驾驶员和电话操作员之间的自然对话，用于在驾驶汽车时通过蜂窝电话访问信息。该语料库可用于分析移动汽车环境中的多媒体数据，也可用于模拟驾驶汽车时信息访问等场景中的口语对话。
In this paper, we report the details of the collection of the multimedia data such as audio, video and auxiliary information of the vehicle during a spoken dialogue in a moving car. The system specially built in a Data Collection Vehicle (DCV) supports synchronous recording of multi-channel audio data from 16 microphones that can be placed in flexible positions, multi-channel video data from 3 cameras and the vehicle related data. Multimedia data has been collected for three sessions of spoken dialogue in about a 60-minute drive by each of 200 subjects. Data has been collected for two dialogue modes: (1) prompted dialogue between the driver and an accompanying operator and (2) natural dialogue between the driver and a telephone operator for information access over a cellular phone while driving a car. The corpus can be used for analysis of multimedia data in a moving car environment and also for modeling spoken dialogue in scenarios such as information access while driving a car.