RI: Small: A New Voice Source Model: From Glottal Areas to Better Speech Synthesis

RI：Small：一种新的语音源模型：从声门区域到更好的语音合成

• 批准号: 1018863
• 负责人: Abeer Alwan
• 金额: $ 45万
• 依托单位: University of California-Los Angeles
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2010
• 资助国家: 美国
• 起止时间: 2010-09-01 至 2015-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1018863&HistoricalAwards=false
• 关键词: RI; Small; New; Voice; Source

The goal of the proposed research is to develop and evaluate a new voicesource model based on physiological observations of the vocal folds of 30 adult speakers. Shortcomings of existing source models can be in part attributed to the way in which they were developed: based on limited data from a few speakers, without direct physiological observations, and without perceptual validation. A larger dataset would help in not only developing a source model that could account for a range of voice qualities within and across speakers, but also result in an understanding of how and which model parameter(s) are speaker and/or gender specific. Model development will consider the perceptual effects of the model's parameters from the earliest stages.A better source model might also improve the performance of speech processing algorithms such as text-to-speech synthesis (TTS). Typically in the development of such algorithms, the emphasis has been on acoustic features related to the speech spectral envelope. The acoustics of the voice source, on the other hand, have received less attention. The proposed work involves: 1) recording high-speed images of vocal foldvibrations with simultaneous audio recordings from 15 male and 15 female speakers, 2) extracting glottal area functions from the images to parameterize a new voice source model, 3) performing perception experiments to uncover which model parameters are perceptually salient, and 4) using the new voice source model in TTS. The project's interdisciplinary team (with expertise in modeling, synthesis, recognition, phonetics, and psycholinguistics) is uniquely qualified to conduct this transformative research.

该研究的目的是开发和评估一种新的基于30名成人扬声器的声带生理观察的声带模型。现有源模型的缺点部分归因于它们的开发方式：基于来自少数说话者的有限数据，没有直接的生理观察，也没有感知验证。一个更大的数据集不仅有助于开发一个可以解释说话者内部和跨说话者的一系列语音质量的源模型，而且还有助于理解模型参数如何以及哪些是说话者和/或性别特定的。模型开发将从最早的阶段考虑模型参数的感知效果。更好的源模型也可能提高语音处理算法的性能，例如文本到语音合成（TTS）。通常在这种算法的开发中，重点是与语音频谱包络相关的声学特征。另一方面，声源的声学特性受到的关注较少。拟议的工作包括：1）记录15名男性和15名女性说话者的声带振动的高速图像和同时的音频记录，2）从图像中提取声门面积函数以参数化新的声源模型，3）进行感知实验以揭示哪些模型参数在感知上是显著的，以及4）将新的声源模型用于TTS。该项目的跨学科团队（具有建模，合成，识别，语音学和心理语言学方面的专业知识）是唯一有资格进行这项变革性研究的团队。