Prosodic temporal alignment of co-speech gestures to speech facilitates referent resolution.
Prosodic temporal alignment of co-speech gestures to speech facilitates referent resolution.
复制标题
共同语音手势与语音的韵律时间对齐有助于解决所指对象。
DOI：
10.1037/a0027921
复制
发表时间：
2012
期刊：
影响因子：
--
通讯作者：
Elizabeth K. Johnson
中科院分区：
文献类型：
--
作者：
Alexandra Jesse;Elizabeth K. Johnson
使用指称检测范式，我们研究了听者是否可以通过说话者对物体施加的动作与其标记话语之间的时间对齐来确定说话者所指的物体。刺激是通过录下说话者给一种新生物贴上标签来产生的。在没有明确指示的情况下，说话者在给动物贴上标签的过程中移动了动物。这些运动的轨迹被用来制作这种生物的动画照片。在随后的感知研究中，参与者一边听到这些标签话语，一边观看两个相同生物的并列动画，其中只有目标生物按照说话者最初的意图移动。利用言语和所指运动之间的跨模态时间关系，参与者识别出说话者正在标记的生物，即使标记的话语经过低通过滤以去除其语义内容或被音调类似物取代。然而，当通过反转语音信号消除韵律结构时，参与者不再轻易地检测到指涉物。这些结果为韵律跨模态对齐假说提供了强有力的支持。说话者施加给指称者的动作和他们讲话的韵律结构之间产生了一种可感知的联系，听者很容易利用这种韵律跨模态关系来解决单词学习中的指称歧义。
Using a referent detection paradigm, we examined whether listeners can determine the object speakers are referring to by using the temporal alignment between the motion speakers impose on objects and their labeling utterances. Stimuli were created by videotaping speakers labeling a novel creature. Without being explicitly instructed to do so, speakers moved the creature during labeling. Trajectories of these motions were used to animate photographs of the creature. Participants in subsequent perception studies heard these labeling utterances while seeing side-by-side animations of two identical creatures in which only the target creature moved as originally intended by the speaker. Using the cross-modal temporal relationship between speech and referent motion, participants identified which creature the speaker was labeling, even when the labeling utterances were low-pass filtered to remove their semantic content or replaced by tone analogues. However, when the prosodic structure was eliminated by reversing the speech signal, participants no longer detected the referent as readily. These results provide strong support for a prosodic cross-modal alignment hypothesis. Speakers produce a perceptible link between the motion they impose upon a referent and the prosodic structure of their speech, and listeners readily use this prosodic cross-modal relationship to resolve referential ambiguity in word-learning situations.
影响因子：
4.6
作者：
Pruden, SM;Hirsh-Pasek, K;Hennon, EA
通讯作者：
Hennon, EA
DOI：
10.1037/0096-1523.34.4.1017
发表时间：
2008-08-01
影响因子：
2.1
作者：
Nygaard, Lynne C.;Queen, Jennifer S.
通讯作者：
Queen, Jennifer S.
影响因子：
3.7
作者：
Brooks, R;Meltzoff, AN
通讯作者：
Meltzoff, AN