The Bursts and Lulls of Multimodal Interaction: Temporal Distributions of Behavior Reveal Differences Between Verbal and Non-Verbal Communication
The Bursts and Lulls of Multimodal Interaction: Temporal Distributions of Behavior Reveal Differences Between Verbal and Non-Verbal Communication
复制标题
DOI：
10.1111/cogs.12612
复制
发表时间：
2018-05-01
影响因子：
2.5
通讯作者：
Kello, Christopher T.
中科院分区：
文献类型：
--
作者：
Abney, Drew H.;Dale, Rick;Kello, Christopher T.
最近对自然主义面对面交际的研究表明，语言和非语言行为的时间匹配等协调模式为语言和非语言交际控制来自一个系统的观点提供了证据。在本研究中，我们认为观察到的语言和非语言行为之间的关系取决于分析的水平。在对自然主义多模态交际语料库的重新分析中（Louwerse, Dale, Bard, & Jeuniaux,），我们侧重于测量特定交际行为在其突发性方面的时间模式。我们研究了不同角色的说话者和不同的交际方式对突发性的估计。我们观察到言语通道与非言语通道以及信息丰富的语言子通道与信息较少的语言子通道之间存在更多的爆发。利用这一新方法分析交际行为的时间模式，我们发现语言和非语言通道之间存在着复杂的关系。我们提出一个时间异质性假说来解释语言系统如何适应对话的要求。
Recent studies of naturalistic face-to-face communication have demonstrated coordination patterns such as the temporal matching of verbal and non-verbal behavior, which provides evidence for the proposal that verbal and non-verbal communicative control derives from one system. In this study, we argue that the observed relationship between verbal and non-verbal behaviors depends on the level of analysis. In a reanalysis of a corpus of naturalistic multimodal communication (Louwerse, Dale, Bard, & Jeuniaux, ), we focus on measuring the temporal patterns of specific communicative behaviors in terms of their burstiness. We examined burstiness estimates across different roles of the speaker and different communicative modalities. We observed more burstiness for verbal versus non-verbal channels, and for more versus less informative language subchannels. Using this new method for analyzing temporal patterns in communicative behaviors, we show that there is a complex relationship between verbal and non-verbal channels. We propose a temporal heterogeneity hypothesis to explainhow the language system adapts to the demands of dialog.