The effects of delayed auditory feedback on speech sequencing: acoustics, physiology, and computational modeling

健康的人在说话时会不断地监测他们的声音输出，使他们能够快速地感知和纠正错误。当这个听觉反馈信号的内容或时间被实验性地改变时，大多数说话者迅速地修改他们的语音。这个项目将主要解决听觉反馈的时机如何影响言语产生系统，并将评估听觉反馈使用的个体差异。结果将指导语音规划和生产的计算模型的发展，有可能加快新的治疗方法的发展和获得性言语障碍的设计。将开发一系列教学模块，探索听觉反馈在正常和紊乱言语中的作用，这将给社会带来额外的好处。该项目团队还将开发教育材料，连接神经科学和传播科学，并为本科生和K-12学生提供形成经验，包括来自弱势背景和残疾人的学生，以吸引他们将来在这一领域学习。所有的项目资料将作为一个公共数据库提供。研究人员将使用实验和计算研究相结合的方法。第一个研究目标是使用多模态实验技术来确定延迟听觉反馈（delayed auditory feedback，EAF）对语音排序的作用。声学数据将被收集和分析，以确定非单词音节序列和句子的生产上的影响。这些数据将被用来评估的错误引起的类型和这些影响之间的关系，并在反馈信号的频率内容，而不是时间的快速变化的反应。通过众包平台获得的收集的数据和感知评估将能够研究单个扬声器的可变性。数据也将作为一个大型的公共数据库，在改变反馈条件下提供。第二个研究目标是开发一个计算模型，通知也从一个子集的参与者，可以捕获的听觉反馈与语音序列生产的相互作用的语音的运动学措施。该模型将模拟一系列关于言语感知、计划和产生组件之间相互作用的假设，并评估它们解释实验数据中观察到的错误模式的能力。该模型还将评估实验观察到的对辐射影响的敏感性的个体差异的来源。

Healthy individuals continuously monitor their sound output while speaking, allowing them to perceive and correct errors quickly. When the content or timing of this auditory feedback signal is experimentally altered, most speakers rapidly modify their speech. This project will primarily address how the timing of auditory feedback impacts the speech production system and will assess individual differences in the use of auditory feedback. Results will guide development of a computational model of speech planning and production that has the potential to accelerate the design of new therapeutic approaches to developmental and acquired disorders of speech. Additional benefits to society will accrue from a series of teaching modules that will be developed that explore the role of auditory feedback in normal and disordered speech. The project team will also develop educational materials that bridge neuroscience and communication sciences and that provide formative experiences for undergraduate and K-12 students, including those from disadvantaged backgrounds and with disabilities, to attract them to future study in this area. All project materials will be made available as a public database.The investigators will use a combination of experimental and computational studies. The first research goal is to determine the role of delayed auditory feedback (DAF) on speech sequencing using multimodal experimental techniques. Acoustic data will be collected and analyzed to determine the impact of DAF on the production of non-word syllable sequences and sentences. These data will be used to assess the types of errors elicited by DAF and the relationship between these effects and responses to rapid shifts in the frequency content, rather than timing, of the feedback signal. The collected data and perceptual evaluations, obtained via a crowdsourcing platform, will enable the study of individual speaker variability. Data will also be made available as a large public database of speech under altered feedback conditions. The second research goal is to develop a computational model, informed also by kinematic measures of speech from a subset of participants, that can capture the interaction of auditory feedback with speech sequence production. The model will simulate a series of hypotheses about the interactions among speech perception and planning and production components and assess their ability to account for the patterns of errors observed in the experimental data. The model will also assess the sources of individual variation in susceptibility to the effects of DAF, as observed experimentally.