Multimodal feedback perturbation in speech: a developmental approach

我的研究计划的主要长期目标是调查儿童言语产生/感知关系的发展。在过去的五十年里，人们声称使用多种感觉反馈来监测语音发音，其中最重要的是听觉和躯体感觉反馈。从发展的角度来看，感觉反馈对于获得适当的元音和辅音发音位置至关重要。虽然已经有很多关于反馈在言语产生中的作用的研究，但还没有人使用关于发音运动、声学参数和知觉测量的原始数据来解决儿童的这个问题。在接下来的五年里，我的研究计划的总体目标是研究听觉和体感反馈在学龄前和学龄儿童言语产生中的作用。为此，这项建议的三个短期目标(STO)是：(A)研究语音的听觉和体感知觉的发展；(B)使用实时扰动范式研究听觉和体感反馈在言语产生中的作用；以及(C)确定(B)中产生的言语的感知后果(可理解性)。为了实现这些目标，我们建议对典型发育中的儿童和成年人产生的语音序列进行运动学和声学记录。还将进行感知测试，并将结果与生产数据进行比较。这一研究项目的创新本质主要在于所解决的问题：虽然感觉知觉对言语发展的影响一直是众多研究的主题，但还没有人专注于对策略的发音和声学综合分析，以补偿改变的多模式感觉反馈。此外，我们提出的结合红外运动捕捉和超声成像的方法是独一无二的。我们的研究计划将在语音感觉运动开发领域取得突破性进展，并将为创新技术工具的开发做出贡献。事实上，通过提供有关儿童声音类别和言语感知相互作用的原始数据，我们的项目将使我们能够巩固和扩大我们与声乐技术公司(如Quartz 3D)的合作，开发旨在改善第二语言学习的虚拟成长对话头。我们建议的研究计划还将创造一个有利于培养口语处理领域高素质人才(本科生、研究生和博士后研究员)的研究环境。

The overarching long-term objective of my research program is to investigate the development of speech production/perception relationships in children. In the last five decades, it has been claimed that multiple sources of sensory feedback are used to monitor the speech articulators, the most important of which are auditory and somatosensory feedback. From a developmental perspective, sensory feedback is crucial to acquire the appropriate articulatory positions for vowels and consonants. Although many studies have been conducted on the role of feedback in speech production, none has addressed this issue in children, using original data on articulatory movements, acoustic parameters, and perceptual measures. For the next five years, the overall objective of my research program is to study the role of auditory and somatosensory feedback in speech production in preschool- and school-aged children. To this end, the three short-term objectives (STOs) of this proposal are (a) to investigate the development of auditory and somatosensory perception of speech sounds; (b) to study the role of auditory and somatosensory feedback during speech production using the real-time perturbation paradigm; and (c) to determine the perceptual consequences (intelligibility) of the speech produced in (b). To achieve these objectives, we propose to make kinematic and acoustic recordings of speech sequences produced by typically developing children and by adults. Perceptual tests will also be conducted and the results will be compared to the production data. The innovative nature of this research program resides primarily in the problem addressed: while the impact of sensory perception on speech development has been the subject of numerous studies, none has focused on an integrated articulatory and acoustic analysis of strategies to compensate for altered multimodal sensory feedback. Furthermore, our proposed method, which combines infrared motion capture and ultrasound imaging, is unique. Our research program will lead to ground-breaking advances in the area of sensorimotor development in speech, and will contribute to the development of innovative technological tools. Indeed, by providing original data on the interaction of sound categories and speech perception in children, our program will allow us to consolidate and expand our collaborations with vocal technology companies (such as Quartz 3D) to develop virtual growing talking heads designed to improve second language learning. Our proposed research program will also create a research environment conducive to the training of highly qualified personnel (undergraduate and graduate students and postdoctoral fellows) in the area of oral language processing.