Multimodal feedback perturbation in speech: a developmental approach

我的研究计划的首要长期目标是调查儿童言语产生/感知关系的发展。在过去的50年里，人们一直声称，多种来源的感觉反馈用于监测语音发音，其中最重要的是听觉和体感反馈。从发展的角度来看，感觉反馈对于获得元音和辅音的适当发音位置至关重要。虽然已经进行了许多研究的反馈在语音生产中的作用，没有解决这个问题的儿童，发音运动，声学参数和感知措施的原始数据。在接下来的五年里，我的研究计划的总体目标是研究听觉和体感反馈在学龄前和学龄儿童言语产生中的作用。为此，本提案的三个短期目标（STO）是：（a）调查语音的听觉和体感感知的发展;（B）使用实时扰动范例研究语音产生过程中听觉和体感反馈的作用;以及（c）确定（B）中产生的语音的感知结果（可懂度）。为了实现这些目标，我们建议，使运动学和声学记录的语音序列产生的典型发展中国家的儿童和成人。还将进行感知测试，并将结果与生产数据进行比较。这项研究计划的创新性主要在于解决的问题：虽然感官知觉对语音发展的影响一直是许多研究的主题，没有一个集中在一个综合的发音和声学分析的策略，以补偿改变多模态的感觉反馈。此外，我们提出的方法，它结合了红外运动捕捉和超声成像，是独一无二的。我们的研究计划将导致在言语感觉运动发展领域的突破性进展，并将有助于创新技术工具的开发。事实上，通过提供关于儿童声音类别和言语感知相互作用的原始数据，我们的计划将使我们能够巩固和扩大与声乐技术公司（如Quartz 3D）的合作，以开发旨在改善第二语言学习的虚拟生长说话头。我们拟议的研究计划还将创造一个有利于培养口语处理领域高素质人才（本科生、研究生和博士后研究员）的研究环境。

The overarching long-term objective of my research program is to investigate the development of speech production/perception relationships in children. In the last five decades, it has been claimed that multiple sources of sensory feedback are used to monitor the speech articulators, the most important of which are auditory and somatosensory feedback. From a developmental perspective, sensory feedback is crucial to acquire the appropriate articulatory positions for vowels and consonants. Although many studies have been conducted on the role of feedback in speech production, none has addressed this issue in children, using original data on articulatory movements, acoustic parameters, and perceptual measures. For the next five years, the overall objective of my research program is to study the role of auditory and somatosensory feedback in speech production in preschool- and school-aged children. To this end, the three short-term objectives (STOs) of this proposal are (a) to investigate the development of auditory and somatosensory perception of speech sounds; (b) to study the role of auditory and somatosensory feedback during speech production using the real-time perturbation paradigm; and (c) to determine the perceptual consequences (intelligibility) of the speech produced in (b). To achieve these objectives, we propose to make kinematic and acoustic recordings of speech sequences produced by typically developing children and by adults. Perceptual tests will also be conducted and the results will be compared to the production data. The innovative nature of this research program resides primarily in the problem addressed: while the impact of sensory perception on speech development has been the subject of numerous studies, none has focused on an integrated articulatory and acoustic analysis of strategies to compensate for altered multimodal sensory feedback. Furthermore, our proposed method, which combines infrared motion capture and ultrasound imaging, is unique. Our research program will lead to ground-breaking advances in the area of sensorimotor development in speech, and will contribute to the development of innovative technological tools. Indeed, by providing original data on the interaction of sound categories and speech perception in children, our program will allow us to consolidate and expand our collaborations with vocal technology companies (such as Quartz 3D) to develop virtual growing talking heads designed to improve second language learning. Our proposed research program will also create a research environment conducive to the training of highly qualified personnel (undergraduate and graduate students and postdoctoral fellows) in the area of oral language processing.