Pair Me Up: A Web Framework for Crowd-Sourced Spoken Dialogue Collection
Pair Me Up: A Web Framework for Crowd-Sourced Spoken Dialogue Collection
复制标题
Pair Me Up:众包口语对话集合的 Web 框架
DOI:
--
复制
发表时间:
2015
期刊:
影响因子:
--
通讯作者:
David DeVault
中科院分区:
文献类型:
--
作者:
R. Manuvinakurike;David DeVault
We describe and analyze a new web-based spoken dialogue data collection framework. The framework enables the capture of conversational speech from two remote users who converse with each other and play a dialogue game entirely through their web browsers. We report on the substantial improvements in the speed and cost of data capture we have observed with this crowd-sourced paradigm. We also analyze a range of data quality factors by comparing a crowd-sourced data set involving 196 remote users to a smaller but more quality controlled lab-based data set. We focus our comparison on aspects that are especially important in our spoken dialogue research, including audio quality, the effect of communication latency on the interaction, our ability to synchronize the collected data, our ability to collect examples of excellent game play, and the naturalness of the resulting interactions. This analysis illustrates some of the current trade-offs between lab-based and crowd-sourced spoken dialogue data.