Coreference Processing in Gesture and Speech

手势和语音中的共指处理

• 批准号: 7049353
• 负责人: STEPHANI M FORAKER
• 金额: $ 5.36万
• 依托单位: UNIVERSITY OF CHICAGO
• 依托单位国家: 美国
• 财政年份: 2005
• 资助国家: 美国
• 起止时间: 2005-01-01 至 2007-12-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/7049353
• 关键词: behavioral /social science research tag; clinical research; cognition; comprehension; face expression; human subject; language development; learning; memory; neural information processing; paralinguistic behavior; postdoctoral investigator; psycholinguistics; speech; verbal learning

DESCRIPTION (provided by applicant): A necessary operation for language comprehension and production is coreference, which involves keeping track of concepts in memory, updating them, and forming correct links in the mind between different coreferring forms, often over long distances. The process of coreference in text comprehension has been well studied, while the contribution of discourse and prosodic cues relevant for the speech and gesture modalities has received considerably less attention. This proposal seeks funding to investigate the process of coreference in speech-gesture comprehension and production in order to model the organization and mechanisms of the adult, end-state, language system more completely. Four hypotheses will be tested. (1) Prosodic stress accesses and makes use of the same underlying memory mechanism(s) and organizing principles as found for text comprehension. (2) Gesture can be used to mark antecedents and this coreferent gesture is co-expressive with speech. (3) Coreferring gestures also make use of the same underlying memory mechanism(s) and organizing principles as prosodic stress and text comprehension. (4) Gesture codes antecedent representations in a motor-kinetic format.

描述（由申请人提供）：语言理解和产生的必要操作是共指，这涉及跟踪记忆中的概念，更新它们，并在不同的共指形式之间（通常是长距离）在头脑中形成正确的链接。文本理解中的共指过程已经得到了很好的研究，而与言语和手势模式相关的话语和韵律线索的贡献却受到了相当少的关注。该提案寻求资金来研究语音手势理解和产生中的共指过程，以便更完整地模拟成人最终状态语言系统的组织和机制。将测试四个假设。 (1) 韵律重音访问并利用与文本理解相同的底层记忆机制和组织原则。 (2)手势可以用来标记前因，并且这种共指手势与言语共同表达。 (3) 指代手势还利用与韵律重音和文本理解相同的底层记忆机制和组织原则。 (4) 手势以运动动力学格式对先行表征进行编码。