Acoustic and Visual Cues of Turn-Taking Dynamics in Dyadic Interactions
Acoustic and Visual Cues of Turn-Taking Dynamics in Dyadic Interactions
复制标题
二元交互中轮流动力学的声音和视觉线索
DOI：
10.21437/interspeech.2011-635
复制
发表时间：
2011
期刊：
影响因子：
--
通讯作者：
Shrikanth S. Narayanan
中科院分区：
文献类型：
--
作者：
Bo Xiao;Viktor Rozgic;Athanasios Katsamanis;Brian R. Baucom;P. Georgiou;Shrikanth S. Narayanan
In this paper we introduce an empirical study of multimodal cues of turn-taking dynamics in a social interaction context. We first identify pauses, gaps and overlapped speech segments in the dyadic conversation dataset. Second, we define two types of measurements, Mean Equalized Energy (MEE) and Animation Level (AL) on the audio and video channels, respectively. Then, we verify the hypothesis that the speaker with higher MEE or AL is more likely to take the floor after silence or overlapped speech. The results suggest that both the vocal and visual movement energy offer useful cues towards inferring the intention of the interlocutor to grab the floor. Index Terms: turn-taking, cues, equalized energy, motion vector
影响因子：
3.6
作者：
Sudha Bhingardive;Ramkrishna Bairi
通讯作者：
Sudha Bhingardive;Ramkrishna Bairi