Phonological and Visual Processing of Sign Language

手语的语音和视觉处理

• 批准号: 7253227
• 负责人: DAVID P CORINA
• 金额: $ 25.7万
• 依托单位: UNIVERSITY OF CALIFORNIA AT DAVIS
• 依托单位国家: 美国
• 财政年份: 1997
• 资助国家: 美国
• 起止时间: 1997-08-01 至 2009-06-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/7253227
• 关键词: Area; Basic Science; Behavior; Behavioral; Biological; Brain imaging; Cells; Clinical; Code; Cognition; Cognitive; Communication; Competence; Comprehension; Depth; Development; Disruption; Functional Magnetic Resonance Imaging; Gestures; Grant; Hand; Hearing; Hearing Impaired Persons; Homologous Gene; Human; Human Characteristics; Image; Individual; Judgment; Knowledge; Language; Left; Linguistics; Link; Location; Macaca; Manuals; Maps; Mediating; Modeling; Monitor; Monkeys; Motion; Motor; Motor Cortex; Movement; Neighborhoods; Neurocognitive; Neurons; Patients; Perception; Performance; Personal Communication; Process; Production; Property; Psycholinguistics; Psychologist; Range; Reaction Time; Reading; Research; Role; Scientist; Sensory; Sensory Deprivation; Services; Shadowing (Histology); Sign Language; Signal Transduction; Societies; Specific qualifier value; Speech; Speed; Stimulus; Surface; System; Testing; Time; To specify; Ursidae Family; Visual; Visual Perception; Visual attention; Writing; auditory deprivation; base; cognitive system; experience; grasp; improved; interest; language processing; lexical; neurodevelopment; neuromechanism; neurophysiology; phonology; programs; relating to nervous system; research study; therapy development; visual object processing; visual process; visual processing; visual search

DESCRIPTION (provided by applicant): The ability to comprehend and produce language stands as a defining characteristic of human cognition. It is this ability that enables the transfer of knowledge and culture within human society. A proper characterization of the human capacity for language is required for the development of interventions which may be used to remediate those individuals who have failed to achieve, or who have lost competence in, a full range of language behaviors (e.g., effective interpersonal communication, reading, writing, etc.). Cognitive psychologists have made great strides in understanding the functional and neural mechanisms underlying the use of spoken language. These findings have led to a wide range of effective educational and clinical programs for improving language behaviors. However, equivalent knowledge in the domain of signed languages is lacking. The long-term objective of this research is to develop a comprehensive neurocognitive model of sign language processing derived from behavioral and functional brain-imaging studies. Such a model would have practical educational value; it would guide the development of effective strategies and programs targeted toward improving specific language behaviors in deaf individuals who come from a variety of language backgrounds. It would also benefit basic science, providing specification as to how a non-speech based human communication system interfaces with sensory, motor and perceptual cognitive systems, and additionally explaining how sensory deprivation and early language experience impacts the development of neural systems. Finally, this model would benefit cognitive scientists interested in models of the functional neural specialization underlying human language by providing explicit understanding of how language may arise from the codification of manual-gesture based human actions. The development of a neurocognitive model of sign language processing will require knowledge from several fronts, as sign language processing lies at the intersection of linguistic, motor and visual processing domains. We seek to identify the representations and processes that underlie sign language recognition and perception, and understand how these are similar to or differ from representation and processes that are used in the service of spoken language, human action/motor processing and visual object/action processing. The current application builds upon findings from our previous grant and continues to ask basic questions concerning the influence of form-based "phonological" properties on the lexical recognition and production of American Sign Language. In addition, our previous findings force us to further consider the neural and functional relationships between sign processing and human action processing and the neural relationships between language and manual-gestural abilities. Finally, we examine how visual perceptual and attentional factors may mediate sign language recognition. We propose tests that are amenable to testing with native and non-native deaf signers and signing and sign-naive hearing subjects, allowing us to determine the degree to which the specific effects observed reflect linguistic experiences, auditory deprivation, or reflect more general, language independent, perceptual processes.

描述（由申请人提供）：理解和产生语言的能力是人类认知的定义特征。正是这种能力使知识和文化在人类社会中得以传播。对人类语言能力的适当表征是开发干预措施所必需的，这些干预措施可用于补救那些未能实现或失去全方位语言行为能力的个体（例如，有效的人际沟通、阅读、写作等）。认知心理学家在理解口语使用背后的功能和神经机制方面取得了很大的进步。这些发现导致了广泛的有效的教育和临床计划，以改善语言行为。然而，在签名语言领域的同等知识是缺乏的。本研究的长期目标是开发一个全面的神经认知模型的手语处理来自行为和功能脑成像研究。这种模式将具有实际的教育价值，它将指导有效的策略和计划的发展，旨在改善来自各种语言背景的聋人的特定语言行为。它也将有利于基础科学，提供规范，以非语音为基础的人类沟通系统如何与感官，运动和感知认知系统的接口，并解释如何感觉剥夺和早期语言经验影响神经系统的发展。最后，这个模型将有利于认知科学家感兴趣的模型的功能神经专业化的基础上人类语言提供明确的理解语言如何可能产生的编码的手动手势为基础的人类行为。 手语处理的神经认知模型的发展将需要来自几个方面的知识，因为手语处理位于语言，运动和视觉处理领域的交叉点。我们试图识别的表征和过程的基础手语识别和感知，并了解这些是如何相似或不同的代表和过程中使用的口头语言，人类动作/运动处理和视觉对象/动作处理的服务。 目前的应用程序建立在我们以前的研究结果的基础上，并继续询问有关基于形式的“语音”属性对美国手语的词汇识别和生产的影响的基本问题。此外，我们以前的研究结果迫使我们进一步考虑符号处理和人类动作处理之间的神经和功能关系，以及语言和手势能力之间的神经关系。最后，我们研究了视觉感知和注意力的因素可能介导的手语识别。 我们提出的测试，适合测试与本地和非本地聋人签名和签名和标志幼稚听力科目，使我们能够确定在何种程度上观察到的具体影响反映语言的经验，听觉剥夺，或反映更普遍的，语言独立的，知觉过程。