RI: Small: Speaker-Specific Articulatory Strategies

RI：小：特定于说话者的发音策略

• 批准号: 1908865
• 负责人: Shrikanth Narayanan
• 金额: $ 47.4万
• 依托单位: University of Southern California
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-08-01 至 2023-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1908865&HistoricalAwards=false
• 关键词: RI; Small; Speaker; Specific; Articulatory

Speech is a uniquely human act that involves the conversion of discrete cognitive, linguistic representations to continuous, complex movements of speech articulators. By helping to understand better the variability and constraints of this conversion mechanism in healthy speech production, this project contributes to assessing speech disorders associated with neurological disease, such as apraxia. Moreover, it paves the way for novel science-driven paradigms to automatic synthesis of speech from text; a technology of increasing importance for social inclusion. It also provides a unique interdisciplinary training opportunity for students, integrating exposure to various facets of speech science research. Novel dynamic imaging data of speech production, analysis results, and derived models are shared with the broader research community.The focus of this project is on the coordinative patterns governing the movement of speech articulators toward the achievement of speech production goals (articulatory strategies). The aim to develop a toolset for characterizing this variability, that will also enable mapping phonological representations to speaker-specific dynamics of the vocal tract. The project builds upon the frameworks of Articulatory Phonology and Task Dynamics that provide a model for generating vocal-tract dynamics from linguistic structures, in which the formation of linguistically relevant constrictions in the vocal tract is governed by the temporal deployment of dynamical systems: critically damped oscillators that are characterized temporally by parameters including targets (end goals of articulatory movements) and natural frequencies (time-course of the movement trajectories). This model is updated using vocal-tract real-time magnetic resonance imaging data from 32 speakers, in order to characterize their speech production behavior at three levels: (i) the vocal-tract deformations put forth in the act of speaking; (ii) the relative contributions of those deformations towards the achievement of phonological goals; and (iii) the temporal coordination of articulatory gestures for the production of well-formed utterances. Such characterizations of individual, speaker-specific articulatory strategies, as directly observed using state-of-the-art vocal-tract imaging technology, significantly contributes to our understanding of what underlies phonological constancy and what drives individual variability via phonetic context, speaker anatomy, and speaking style.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

言语是一种独特的人类行为，它涉及到将离散的认知语言表征转换为言语发音器官的连续复杂运动。通过帮助更好地了解这种转换机制在健康语音产生中的变化和限制，该项目有助于评估与神经系统疾病（如失用症）相关的语音障碍。此外，它为新的科学驱动的范例铺平了道路，以自动合成语音文本;一种对社会包容日益重要的技术。它还为学生提供了一个独特的跨学科培训机会，整合了语言科学研究的各个方面。新的动态成像数据的语音生产，分析结果，并导出模型与更广泛的研究community.The项目的重点是对协调模式的运动控制的语音发音朝着实现语音生产的目标（发音策略）共享。的目的是开发一个工具集，用于表征这种变化，这也将使映射语音表示特定于扬声器的动态声道。该项目建立在发音语音学和任务动力学的框架之上，这些框架提供了一个从语言结构生成声道动力学的模型，其中声道中语言相关收缩的形成受动力系统的时间部署的支配：临界阻尼振荡器，其在时间上由包括目标的参数表征（发音运动的最终目标）和自然频率（运动轨迹的时间过程）。该模型使用32名说话人的声道实时磁共振成像数据进行了更新，以便从三个层面表征他们的言语产生行为：（i）说话行为中提出的声道变形;（ii）这些变形对实现语音目标的相对贡献;以及（iii）发音姿势的时间协调，以产生良好的发音。使用最先进的声道成像技术直接观察到的个体、说话者特定的发音策略的这种特征，极大地有助于我们理解语音恒定性的基础是什么，以及是什么通过语音背景、说话者解剖、该奖项反映了NSF的法定使命，并被认为是值得通过评估使用基金会的知识优点和更广泛的影响审查标准。

项目成果

Effect of vocal tract morphology on tongue shaping for American English /ɹ/

声道形态对美式英语 /É1/ 舌形的影响

• DOI: 10.1121/10.0008076
• 发表时间: 2021
• 期刊: The Journal of the Acoustical Society of America
• 作者: Lu, Yijing;Hsu, Haley;Goldstein, Louis;Toutios, Asterios
• 通讯作者: Toutios, Asterios

How an aglossic speaker produces an alveolar-like percept without a functional tongue tip.

无舌说话者如何在没有功能性舌尖的情况下产生类似齿槽的感知。

• DOI: 10.1121/10.0001329
• 发表时间: 2020
• 期刊: The Journal of the Acoustical Society of America
• 作者: Toutios,Asterios;Xu,Melissa;Byrd,Dani;Goldstein,Louis;Narayanan,Shrikanth
• 通讯作者: Narayanan,Shrikanth

Characteristics of articulatory gestures in stuttered speech: A case study using real-time magnetic resonance imaging

口吃言语中的发音姿势特征：基于实时磁共振成像的案例研究

• DOI: 10.1016/j.jcomdis.2022.106213
• 发表时间: 2022
• 期刊: Journal of Communication Disorders
• 影响因子: 1.7
• 作者: Lu, Yijing;Wiltshire, Charlotte E.E.;Watkins, Kate E.;Chiew, Mark;Goldstein, Louis
• 通讯作者: Goldstein, Louis

Effect of individual vocal tract geometry on the tongue shaping for American English /ɹ/.

个体声道几何形状对美式英语 /É1/ 舌头形状的影响。

• 发表时间: 0223
• 期刊: Proceedings of the 20th International Congress of Phonetic Sciences (ICPhS
• 作者: Lu, Y.

Modeling speaker-specific vocal tract kinematics from gestural scores

根据手势分数对特定说话者的声道运动学进行建模

• DOI: 10.1121/10.0008077
• 发表时间: 2021
• 期刊: The Journal of the Acoustical Society of America
• 作者: Lu, Yijing;Ly, Justin;Narayanan, Shrikanth;Goldstein, Louis;Toutios, Asterios
• 通讯作者: Toutios, Asterios