Perception and Production of Audiovisual Speech in Children with Hearing Loss

在嘈杂的情况下，说话者会调整他们的说话方式，使之更容易听懂。同样，监听者 通过增加他们对说话者面部视觉信息的依赖来调整他们的处理策略 补偿退化的听觉信息。这项研究计划的目标是了解 母亲与学龄前儿童言语产生和认知的相互适应过程 孩子们。在目标1中，我们将研究母亲如何适应她们说话的视觉和听觉特性 在背景条件下与听力损失儿童和听力正常儿童交谈时 噪音。通过同时跟踪母亲在分析她们的言语时与言语相关的头部运动 在声学方面，我们可以评估母亲可能夸大自己的言语以使其更多的方式 他们的孩子都能听懂。在目标2中，我们将直接测试针对听力障碍儿童的言语 丢失，或在高水平的背景噪音存在的情况下产生的，对儿童来说更容易理解 语音识别任务。这些测量将在仅听觉模式下进行，而不是视觉模式 信息。在目标3中，我们将使用眼球跟踪来检查儿童对其视频的视觉处理 母亲的言语来测试视觉信息增强语音识别的程度，如何 背景噪声影响儿童对说话者面部区域的注意力，以及对 母亲的嘴巴提高了语言的清晰度。实施成功干预的一个重要途径 对于听力损失的儿童，包括指导父母提供语言输入，以促进语言和 语言发展。通过理解在生产和生产中发生的相互适应 对母子言语的感知，以及他们如何受到听力损失的影响，这个项目将提供 确定和实施视听临床干预措施的经验依据 儿童言语感知问题，并改善听力障碍儿童的发展结果 损失。

In noisy situations, talkers adapt the way they speak to be more intelligible. Similarly, listeners adapt their processing strategies by increasing their reliance on visual information on the talker's face to compensate for the degraded auditory information. The goal of this research program is to understand the process of reciprocal adaptation in speech production and perception between mothers and their preschool children. In Aim 1, we will examine how mothers adapt the visual and acoustical properties of their speech when talking to children with hearing loss and children with normal hearing under conditions of background noise. By simultaneously tracking mothers' speech related head movements while analyzing their speech acoustics, we can assess the ways in which mothers might exaggerate their speech to make it more intelligible to their children. In Aim 2, we will directly test whether speech directed to children with hearing loss, or produced in the presence of high levels of background noise, is more intelligible to children in a speech-recognition task. These measurements will be made in an auditory-only mode, without visual information. In Aim 3, we will use eye tracking to examine children's visual processing of videos of their mothers' speech to test the degree to which visual information enhances speech recognition, how background noise affects children's attention to talker facial regions, and whether visual fixation on the mother's mouth increases speech intelligibility. One important way of implementing successful interventions for children with hearing loss involves coaching parents to provide language input that facilitates speech and language development. By understanding the reciprocal adaptations that occur in the production and perception of mother-child speech, and how they are impacted by hearing loss, this project will provide an empirical basis for the identification and implementation of clinical intervention practices for audiovisual speech perception problems in children, and improve the developmental outcomes for children with hearing loss.