Gesture-speech physics: The biomechanical basis for the emergence of gesture-speech synchrony.
Gesture-speech physics: The biomechanical basis for the emergence of gesture-speech synchrony.
复制标题
手势-语音物理学：手势-语音同步出现的生物力学基础。
DOI：
10.31234/osf.io/tgua4
复制
发表时间：
2018
期刊：
影响因子：
--
通讯作者：
J. Dixon
中科院分区：
文献类型：
--
作者：
W. Pouw;Steven J. Harrison;J. Dixon
手势-语音同步现象涉及手势运动(例如，峰值速度)和语音(例如，基频峰值；F0)的韵律对比的紧密耦合。手势-语言同步被理解为完全由复杂的神经认知机制控制。然而，手势-语言的同步可能有其最初的基础，即通过身体传播的共振力。在目前预先登记的研究中，与在自然环境中观察到的手势-言语同步一致，身体影响较大的动作影响发声。手臂有节奏的跳动带来了发声声学(F0和幅度包络)。这种影响在低推动力运动(手腕运动)和没有运动的情况下是不存在的。此外，当参与者站着而不是坐着时，运动-发音同步更加明显，这表明在姿势稳定性方面起到了中介作用。我们的结论是，手势-言语同步具有生物力学基础，这将对我们对多通道语言的认知、个体发生和系统发育的理解产生影响。(JuncINFO数据库记录(C)2019 APA，版权所有)。
The phenomenon of gesture-speech synchrony involves tight coupling of prosodic contrasts in gesture movement (e.g., peak velocity) and speech (e.g., peaks in fundamental frequency; F0). Gesture-speech synchrony has been understood as completely governed by sophisticated neural-cognitive mechanisms. However, gesture-speech synchrony may have its original basis in the resonating forces that travel through the body. In the current preregistered study, movements with high physical impact affected phonation in line with gesture-speech synchrony as observed in natural contexts. Rhythmic beating of the arms entrained phonation acoustics (F0 and the amplitude envelope). Such effects were absent for a condition with low-impetus movements (wrist movements) and a condition without movement. Further, movement-phonation synchrony was more pronounced when participants were standing as opposed to sitting, indicating a mediating role for postural stability. We conclude that gesture-speech synchrony has a biomechanical basis, which will have implications for our cognitive, ontogenetic, and phylogenetic understanding of multimodal language. (PsycINFO Database Record (c) 2019 APA, all rights reserved).