Perception and Production of Audiovisual Speech in Children with Hearing Loss

在嘈杂的环境中，说话者会调整自己的说话方式，使自己更容易被人理解。同样，听众 通过增加对说话者面部视觉信息的依赖来调整他们的处理策略， 补偿退化的听觉信息。这项研究计划的目标是了解 母亲与学龄前儿童言语产生和知觉的相互适应过程 孩子在目标1中，我们将研究母亲如何适应他们讲话的视觉和听觉特性 当在背景条件下与听力损失儿童和听力正常儿童交谈时， 噪声通过同时跟踪母亲的语音相关的头部运动，同时分析他们的语音 声学，我们可以评估母亲可能会夸大他们的讲话，使其更 对他们的孩子来说是可理解的。在目标2中，我们将直接测试针对听力正常儿童的讲话是否 损失，或在高水平的背景噪音存在下产生的，是更容易理解的儿童在一个 语音识别任务。这些测量将在仅测量模式下进行，没有视觉 信息.在目标3中，我们将使用眼动追踪来检查儿童对视频的视觉处理， 母亲的语音测试的程度，视觉信息增强语音识别，如何 背景噪声影响儿童对说话者面部区域的注意， 母亲的嘴提高了语言的清晰度。成功实施干预措施的一个重要途径 对于听力损失儿童，需要指导父母提供语言输入， 语言发展通过了解生产过程中发生的相互适应， 母亲和孩子的言语感知，以及他们如何受到听力损失的影响，这个项目将提供一个 确定和实施视听保健临床干预实践的经验基础 儿童的言语感知问题，并改善儿童听力的发展结果 损失

In noisy situations, talkers adapt the way they speak to be more intelligible. Similarly, listeners adapt their processing strategies by increasing their reliance on visual information on the talker's face to compensate for the degraded auditory information. The goal of this research program is to understand the process of reciprocal adaptation in speech production and perception between mothers and their preschool children. In Aim 1, we will examine how mothers adapt the visual and acoustical properties of their speech when talking to children with hearing loss and children with normal hearing under conditions of background noise. By simultaneously tracking mothers' speech related head movements while analyzing their speech acoustics, we can assess the ways in which mothers might exaggerate their speech to make it more intelligible to their children. In Aim 2, we will directly test whether speech directed to children with hearing loss, or produced in the presence of high levels of background noise, is more intelligible to children in a speech-recognition task. These measurements will be made in an auditory-only mode, without visual information. In Aim 3, we will use eye tracking to examine children's visual processing of videos of their mothers' speech to test the degree to which visual information enhances speech recognition, how background noise affects children's attention to talker facial regions, and whether visual fixation on the mother's mouth increases speech intelligibility. One important way of implementing successful interventions for children with hearing loss involves coaching parents to provide language input that facilitates speech and language development. By understanding the reciprocal adaptations that occur in the production and perception of mother-child speech, and how they are impacted by hearing loss, this project will provide an empirical basis for the identification and implementation of clinical intervention practices for audiovisual speech perception problems in children, and improve the developmental outcomes for children with hearing loss.