Coreference Processing in Gesture and Speech

描述（由申请人提供）：语言理解和产生的一个必要操作是共指，它涉及在记忆中跟踪概念，更新它们，并在头脑中形成不同共指形式之间的正确联系，通常是长距离的。语篇理解中的共指过程已经得到了很好的研究，而话语和韵律线索对言语和手势模态的贡献却很少受到关注。该提案寻求资金，以调查的过程中的语音手势的理解和生产，以模拟组织和机制的成年人，最终状态，语言系统更完整的共指。将检验四个假设。(1)韵律重音访问并利用与文本理解相同的潜在记忆机制和组织原则。(2)手势可以用来标记先行语，并且这种共指手势与言语是共表达的。(3)共指手势也利用了与韵律重音和文本理解相同的潜在记忆机制和组织原则。(4)手势以运动-动力格式编码先行表示。

DESCRIPTION (provided by applicant): A necessary operation for language comprehension and production is coreference, which involves keeping track of concepts in memory, updating them, and forming correct links in the mind between different coreferring forms, often over long distances. The process of coreference in text comprehension has been well studied, while the contribution of discourse and prosodic cues relevant for the speech and gesture modalities has received considerably less attention. This proposal seeks funding to investigate the process of coreference in speech-gesture comprehension and production in order to model the organization and mechanisms of the adult, end-state, language system more completely. Four hypotheses will be tested. (1) Prosodic stress accesses and makes use of the same underlying memory mechanism(s) and organizing principles as found for text comprehension. (2) Gesture can be used to mark antecedents and this coreferent gesture is co-expressive with speech. (3) Coreferring gestures also make use of the same underlying memory mechanism(s) and organizing principles as prosodic stress and text comprehension. (4) Gesture codes antecedent representations in a motor-kinetic format.