AUDIOVISUAL INTEGRATION, AGE, AND HEARING LOSS

视听整合、年龄和听力损失

• 批准号: 10431990
• 负责人: Nancy Ann Tye-Murray
• 金额: $ 56.07万
• 依托单位: WASHINGTON UNIVERSITY
• 依托单位国家: 美国
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-07-01 至 2024-06-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10431990
• 关键词: Address; Age; Area; Auditory; Auditory area; Behavior; Code; Cognitive; Cognitive Science; Contrast Sensitivity; Counseling; Coupling; Detection; Elderly; Foundations; Functional Magnetic Resonance Imaging; Gestures; Goals; Grant; Hearing; Individual; Individual Differences; Lipreading; Measures; Methods; Modeling; Modification; Motor; Neighborhoods; Neurocognitive; Noise; Participant; Pattern; Perception; Performance; Peripheral; Persons; Play; Process; Production; Research; Research Personnel; Role; Seminal; Signal Transduction; Speech; Speech Perception; Stimulus; Structure of superior temporal sulcus; Techniques; Temporal Lobe; Testing; Time; Training; Vision; Visual; Visual Cortex; Visual Perception; Visuospatial; age related; audiovisual speech; auditory stimulus; aural rehabilitation; base; behavior measurement; cognitive ability; cognitive skill; density; evidence base; experience; gaze; hearing impairment; interest; lexical; lexical processing; multisensory; neural correlate; processing speed; programs; relating to nervous system; skills; sound; speech processing; theories; visual speech; visual stimulus; young adult

ABSTRACT People with hearing loss might benefit greatly if they could use the visual signal to recognize speech. Sadly, as people age, they often experience a decline in both their hearing ability and their lipreading ability, so that at the very time their audiovisual speech perception could maximally benefit from visual speech information, they are least able to utilize it. Understanding the linkage between these phenomena has been a longstanding challenge for both cognitive science and aural rehabilitation, yet we believe this linkage provides a major clue to understanding both individual and age-related differences in everyday speech perception. Most researchers assume that there is a distinct integration stage and that integrative ability diminishes with age. Our most recent findings, however, suggest that differences in unimodal performance, and not differences in integrative abilities, underlie both individual and age-related differences in audiovisual speech perception. Accordingly, the proposed research takes the unique approach of focusing on both the causes of individual differences in lipreading skill and on lipreading as a cause of differences in audiovisual speech perception. For Specific Aim 1, we will use our new feature analysis methods to predict audiovisual speech perception based on participants' unimodal (i.e., auditory-only and vision-only) performance. We will evaluate the relative contributions of cognitive, perceptual, and speech production abilities as well as gaze behavior to both individual and age-related differences in vision-only and audiovisual speech perception. For Specific Aim 2, we will use a modification of our speech detection and lipread- yourself tasks, along with fMRI, to assess differences in the correspondence between the phonetic representations that support speech production and perception. Finally, for Aim 3, we will identify neural correlates of vision-only and audiovisual speech perception using fMRI. The results from Aims 1 and 2 will help us identify the regions of interest. We will focus on premotor areas because we hypothesize that the linkage between speech production and visual speech perception is critical for understanding how people recognize visual speech signals, and we will directly compare the activation in premotor cortex during both speech production and perception using representational similarity analysis, an elegant multi-variate analytic technique. By the end of the grant cycle, our goal is to have developed a unified neurocognitive framework for understanding both individual and age-related differences in lipreading and audiovisual speech perception. This framework and our experimental results will also provide evidence-based guidance for both speech perception training and aural rehabilitation counselling.

抽象的 如果听力损失的人可以使用视觉信号来识别，则可能会大大受益 演讲。可悲的是，随着人们的年龄，他们的听力能力和 他们的口头阅读能力，以便在他们的视听语音感知可以 最大程度地从视觉语音信息中受益，他们最不能够利用它。理解 这些现象之间的联系一直是认知的长期挑战 科学和听觉康复，但我们认为这种联系为 了解日常语音感知中的个人和年龄相关的差异。最多 研究人员认为存在一个独特的整合阶段和整合能力 随着年龄的增长而减少。然而，我们最近的发现表明，单峰的差异 绩效，而不是集成能力的差异，是个人和与年龄有关的基础 视听语音感知的差异。因此，拟议的研究将 专注于唇线阅读技能中个体差异的原因的独特方法和 关于语言是视听语音感知差异的原因。对于特定目标1，我们 将使用我们的新功能分析方法来预测基于 参与者的单峰（即仅听觉和视力）的表现。我们将评估 认知，感知和语音生产能力以及目光的相对贡献 单个视力和视听语音的个人和与年龄有关的差异的行为 洞察力。对于特定的目标2，我们将使用语音检测和唇线的修改 - 您自己的任务以及fMRI，以评估 支持语音产生和感知的语音表示。最后，对于目标3，我们 将使用fMRI确定仅视力和视听语音感知的神经相关性。这 目标1和2的结果将帮助我们确定感兴趣的区域。我们将专注于前主动员 区域是因为我们假设语音生产与视觉语音之间的联系 感知对于了解人们如何识别视觉语音信号至关重要，我们将 直接比较语音产生和感知期间前皮层的激活 使用代表性相似性分析，一种优雅的多变量分析技术。到最后 在赠款周期中，我们的目标是为了开发一个统一的神经认知框架 了解口头和视听语音的个人和与年龄有关的差异 洞察力。这个框架和我们的实验结果也将提供基于证据的 语音感知培训和听觉康复咨询的指导。

项目成果

Age Differences in the Effects of Speaking Rate on Auditory, Visual, and Auditory-Visual Speech Perception.

语速对听觉、视觉和听觉视觉言语感知影响的年龄差异。

• DOI: 10.1097/aud.0000000000000776
• 发表时间: 2020
• 期刊: Ear and hearing
• 影响因子: 3.7
• 作者: Sommers,MitchellS;Spehar,Brent;Tye-Murray,Nancy;Myerson,Joel;Hale,Sandra
• 通讯作者: Hale,Sandra

Predicting Audiovisual Word Recognition in Noisy Situations: Toward Precision Audiology.

• DOI: 10.1097/aud.0000000000001072
• 发表时间: 2021-11-01
• 期刊: Ear and hearing
• 影响因子: 3.7
• 作者: Myerson J;Tye-Murray N;Spehar B;Hale S;Sommers M
• 通讯作者: Sommers M

Increased Connectivity among Sensory and Motor Regions during Visual and Audiovisual Speech Perception.

在视觉和视听言语感知过程中感觉和运动区域之间的连接性增强。

• DOI: 10.1523/jneurosci.0114-21.2021
• 发表时间: 2022
• 期刊: The Journal of neuroscience : the official journal of the Society for Neuroscience
• 作者: Peelle,JonathanE;Spehar,Brent;Jones,MichaelS;McConkey,Sarah;Myerson,Joel;Hale,Sandra;Sommers,MitchellS;Tye-Murray,Nancy
• 通讯作者: Tye-Murray,Nancy