The interaction of auditory and visual detection, discrimination, and recognition in infants’ real-world listening environments

婴儿现实世界聆听环境中听觉和视觉检测、辨别和识别的相互作用

• 批准号: 9392321
• 负责人: Kaylah L Lalonde
• 金额: $ 0.06万
• 依托单位: UNIVERSITY OF WASHINGTON
• 依托单位国家: 美国
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-12-02 至 2017-06-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/9392321
• 关键词: Acoustics; Adult; Auditory; Auditory Perception; Categories; Cereals; Child; Child Language; Clinical; Complex; Cueing for speech; Cues; Detection; Development; Discrimination; Environment; Hearing; Hearing Impaired Persons; Human; Infant; Knowledge; Language; Language Development; Lead; Learning; Literature; Longevity; Measures; Methods; Noise; Parents; Participant; Perception; Performance; Positioning Attribute; Procedures; Production; Property; Psychoacoustics; Psychometrics; Research; Research Personnel; Sensory; Signal Transduction; Specific qualifier value; Speech; Speech Perception; Speech Sound; Stimulus; Television; Testing; Uncertainty; Vision; Visual; Work; age group; audiovisual speech; auditory stimulus; base; behavior test; evidence base; evidence based guidelines; experience; hearing impairment; improved; infancy; insight; multimodality; research and development; skills; sound; visual information; visual speech

ABSTRACT Infants are more susceptible to noise than adults, and learn speech and language in noisy environments. Visual speech could be one of the most important cues available to infants to compensate for noisy listening environments, but a coherent picture of audiovisual (AV) speech perception development has yet to emerge. Multiple mechanisms underlie AV benefit to speech perception in adults: common AV onsets and offsets provide information about when to listen, correlations between the amplitude envelopes of auditory and visual signals help to distinguish between different consonants, and experienced listeners can use visual/multimodal phonetic representations. Differences in the mechanisms underlying AV speech perception benefit across tasks and age groups have lead to inconsistencies in the developmental literature. In order to form a unified account of AV speech perception development, this research focuses on the development of the mechanisms underlying AV speech benefits. The proposed research will use a hierarchical framework to investigate AV speech perception. Specifically, the proposed research will compare performance across a hierarchy of perceptual tasks and use stimulus manipulations to limit the AV benefit mechanisms available to participants. The aims are to determine whether typically developing, 7-month-old infants use visual speech cues to improve detection, discrimination, and identification of auditory speech in noise and to investigate the mechanisms by which infants and adults benefit from visual speech. To that end adults and infants will complete auditory-only, visual-only, and AV speech detection, discrimination, and identification tasks, matched on procedural details, but varying in the level of perceptual processing required to perform them. An additional condition uses a visual speech signal that only provides information about the onset/offset of the auditory stimulus. The research uses an established, developmentally appropriate, and psychometrically rigorous behavioral testing method, the observer-based psychoacoustics procedure (Werner, 1995). We expect that (1) infants will detect, discriminate, and identify auditory speech in noise better when they can also see the talker compared to when they can only hear the talker, (2) infants' benefit will primarily result from the visual signal providing information about when to listen, and (3) infants will benefit less than adults on higher-level tasks because adults will use the crossmodal correlations and visual phonetic information to gain additional benefits on higher-level tasks. The proposed research will improve our understanding of how speech sound detection, discrimination, and identification interact with vision in infants and adults, and lead to a better understanding of the development of auditory perception in real-world listening environments. It will provide researchers with a context in which to study development in older children with normal hearing and infants and children with hearing loss. It will also provide the evidence-base for recommendations that parents promote and make use of AV skills in support of a hearing-impaired infant's or child's language acquisition.

摘要 婴儿比成年人更容易受到噪音的影响，并在嘈杂的环境中学习言语和语言。 视觉语言可能是婴儿补偿嘈杂听力的最重要线索之一 环境中，但一个连贯的图片视听（AV）语音感知发展尚未出现。 成人中AV对言语感知有益的多种机制：常见的AV起始和偏移 提供关于何时听的信息，听觉和视觉的振幅包络之间的相关性， 信号有助于区分不同的辅音，有经验的听众可以使用视觉/多模态 语音表征AV语音感知机制的差异有利于跨 任务和年龄组导致了发展文献中的不一致。为了形成统一的 考虑到音视频语音感知的发展，本研究着重于音视频语音感知发展的机制 潜在的AV语音优势。拟议的研究将使用一个层次框架来调查AV 言语知觉具体来说，拟议的研究将比较不同层次的绩效， 知觉任务，并使用刺激操纵，以限制AV受益机制提供给参与者。 其目的是确定正常发育的7个月大的婴儿是否使用视觉语言线索来提高 检测，歧视，并在噪声中的听觉语音识别和调查的机制， 婴儿和成人从视觉语言中受益。为此，成年人和婴儿将只完成志愿者， 仅视觉和AV语音检测、辨别和识别任务，在程序细节上匹配， 但是在执行它们所需的感知处理水平上变化。另一个条件是使用视觉 仅提供关于听觉刺激的起始/偏移的信息的语音信号。研究采用 一种成熟的、适合发展的、心理测量上严格的行为测试方法， 基于神经元的心理声学程序（Werner，1995）。我们希望（1）婴儿会发现， 当他们也能看到说话者时， 他们只能听到说话者，（2）婴儿的益处主要来自提供信息的视觉信号 关于什么时候听，（3）婴儿在更高层次的任务中受益比成年人少，因为成年人会使用 跨模态相关性和视觉语音信息，以获得更高级别任务的额外好处。 这项研究将提高我们对语音检测、辨别和识别的理解。 识别与婴儿和成人的视觉相互作用，并导致更好地了解儿童的发展。 在真实世界的听觉环境中的听觉感知。它将为研究人员提供一个背景， 听力正常的大龄儿童和听力损失的婴儿和儿童的研究进展。它还将 为父母促进和利用AV技能以支持 听力受损的婴儿或儿童的语言习得。