Intersensory Perceptual Narrowing in Human Infants

描述（由申请人提供）：灵长类动物的两个主要交流渠道是面部和声音。通常，面部表情和伴随的发声提供高度冗余的信息，因为它们总是在空间上位于同一位置，在时间上同步，并且由动态听觉和可见信息的重叠模式指定。成年人从发声面孔提供的多感官冗余中受益，因为他们利用冗余将单独的听觉和视觉信息流整合成连贯的感知体验，并且因为冗余使得更容易检测、学习和记住发声面孔。尽管现有证据表明，利用多感觉冗余的能力在婴儿期早期就出现了，但其出现背后的过程仍然知之甚少。因此，当前的项目研究了人类婴儿面部声音整合的发展，并探索了知觉狭窄在感觉间整合发展中发挥关键作用的新观点。这个新颖的想法是基于 PI 及其同事最近的一项发现，即与年龄较大的婴儿相比，较小的婴儿可以整合更广泛的面孔和声音。我们发现，年幼的婴儿可以整合非本地面孔和发声（猴脸及其发声或外国可见和可听的语音），但年龄较大的婴儿则不能。我们的发现令人震惊，因为它们是反直觉的，并且与现有的感觉间发展理论的预测相反。然而，它们与越来越多的关于语音、面部和音乐处理领域的缩小效应的文献是一致的，并表明缩小是一个泛感官的、通用领域的过程。因此，当前项目将研究感觉间知觉狭窄（IPN）。它将以 5 个具体目标为指导，其目的是阐明：(1) IPN 中时间间感觉同步、配置处理、手势特征和语言一般过程的作用，(2) 通过在不同类型的整合任务中测试 IPN 的一般性质，(3) 经验在 IPN 中的作用，(4) 单感觉知觉过程对 IPN 的单独贡献，以及 (5) IPN 的敏感期是否受到以下因素的影响：多感官冗余。我们将使用感觉间匹配技术来检查面部-声音整合，使用习惯/测试方法来研究面部和声音的学习和辨别，并测量婴儿视觉注意力对指数反应的影响。通过揭示婴儿期面部声音整合发展背后的感知和经验依赖机制，该项目将提供对关键沟通技能的出现的见解，该技能对于感知、认知和社会层面的适应性功能至关重要。反过来，这将提供对各种发育障碍（例如自闭症）病因学的深入了解，并将促进开发更好的此类疾病诊断工具，并有助于开发更好的干预方法来改善这些疾病。 公共健康相关性：自闭症的特点是患有这种发育障碍的儿童无法对作为社交交流来源的人的面孔和声音做出反应，自闭症每年以 10-17% 的惊人速度增长。由于自闭症和相关的沟通和学习障碍本质上是发展性的，因此越早诊断，就能更有效地改善和/或预防。当前的项目将调查一些关键感知技能的发展，这些技能使婴儿能够对人的面孔和声音做出反应，作为社会相关交流信息的来源。因此，该项目不仅将深入了解这些疾病功能受损的可能原因，而且还将为设计诊断工具提供科学依据，从而比目前更早地发现这些疾病并最终预防它们。

DESCRIPTION (provided by applicant): The two primary channels of communication in primate species are the face and the voice. Normally, facial gestures and accompanying vocalizations provide highly redundant information because they are always spatially co-located, temporally synchronous, and specified by overlapping patterns of dynamic audible and visible information. Adults profit from the multisensory redundancy that vocalizing faces offer because they use the redundancy to integrate the separate auditory and visual streams of information into coherent perceptual experiences and because the redundancy makes it easier to detect, learn, and remember vocalizing faces. Although extant evidence indicates that the ability to take advantage of multisensory redundancy emerges early in infancy, the processes underlying its emergence are still poorly understood. Consequently, the current project investigates the development of face-voice integration in human infants and explores the novel idea that perceptual narrowing plays a critical role in the development of intersensory integration. This novel idea is based on a recent discovery by the PI & his colleagues that younger infants can integrate a broader range of faces and voices than do older infants. We have found that young infants can integrate nonnative faces and vocalizations (either monkey faces and their vocalizations or foreign visible and audible speech sounds) but that older infants do not. Our findings are striking because they are counterintuitive and contrary to predictions arising from extant theories of intersensory development. They are, however, consistent with a growing literature on narrowing effects in the speech, face, and music processing domains and suggest that narrowing is a pan-sensory, domain-general process. Consequently, the current project will investigate intersensory perceptual narrowing (IPN). It will be guided by 5 specific aims whose purpose will be to shed light on: (1) the role of temporal intersensory synchrony, configural processing, gestural features, and language-general processes in IPN, (2) the general nature of IPN by testing for it across different types of integration tasks, (3) the role of experience in IPN, (4) the separate contribution of unisensory perceptual processes to IPN, and (5) whether the sensitive period for IPN is affected by multisensory redundancy. We will use the intersensory matching technique to examine face-voice integration, the habituation/test method to investigate learning and discrimination of faces and voices, and measure infant visual attention to index responsiveness. By shedding light on the perceptual and experience-dependent mechanisms that underlie the development of face-voice integration in infancy, this project will provide insights into the emergence of a critical communicative skill that is essential to adaptive functioning at the perceptual, cognitive, and social levels. This, in turn, will provide insights into the etiology of various developmental disorders (e.g., autism) and will facilitate the development of better diagnostic tools for such disorders and help develop better intervention methods to ameliorate these disorders. PUBLIC HEALTH RELEVANCE: Autism, whose hallmark is the inability of children with this developmental disability to respond to the faces and voices of people as sources of social communication, has been growing at an alarming rate of 10-17 percent per year. Because autism and related communication and learning disorders are developmental in nature, the earlier they are diagnosed the more effectively they can be ameliorated and/or prevented. The current project will investigate the development of some critical perceptual skills that enable infants to respond to people<s faces and voices as sources of socially relevant communicative information. As a result, not only will this project provide insights into the possible reasons for impaired functioning in these disorders but also a scientific basis for the design of diagnostic tools that will permit the detection of these disorders much earlier than is currently possible and ultimately their prevention.