Coreference Processing in Gesture and Speech

描述(申请人提供)：语言理解和产生的一个必要操作是共指，这涉及到在记忆中跟踪概念，更新它们，并在头脑中形成不同的共指形式之间的正确联系，通常是在很长的距离上。篇章理解中的共指过程已经得到了很好的研究，而与言语和手势相关的语篇和韵律线索的作用却受到了较少的关注。这项建议寻求资金来研究言语-手势理解和产生中的共指过程，以便更完整地模拟成人、终端状态、语言系统的组织和机制。四个假设将被检验。(1)韵律重音通达和利用与语篇理解相同的记忆机制(S)和组织原则。(2)手势可以用来标记先行词，并且这种共指手势与言语是共表达的。(3)共指手势也使用了与韵律重读和语篇理解相同的基本记忆机制(S)和组织原则。(4)手势以运动学形式对先行表征进行编码。

DESCRIPTION (provided by applicant): A necessary operation for language comprehension and production is coreference, which involves keeping track of concepts in memory, updating them, and forming correct links in the mind between different coreferring forms, often over long distances. The process of coreference in text comprehension has been well studied, while the contribution of discourse and prosodic cues relevant for the speech and gesture modalities has received considerably less attention. This proposal seeks funding to investigate the process of coreference in speech-gesture comprehension and production in order to model the organization and mechanisms of the adult, end-state, language system more completely. Four hypotheses will be tested. (1) Prosodic stress accesses and makes use of the same underlying memory mechanism(s) and organizing principles as found for text comprehension. (2) Gesture can be used to mark antecedents and this coreferent gesture is co-expressive with speech. (3) Coreferring gestures also make use of the same underlying memory mechanism(s) and organizing principles as prosodic stress and text comprehension. (4) Gesture codes antecedent representations in a motor-kinetic format.