Temporal dynamics of phonetic perceptual organization

语音感知组织的时间动态

• 批准号: 1827361
• 负责人: Robert Remez
• 金额: $ 53.62万
• 依托单位: Barnard College
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-09-01 至 2023-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1827361&HistoricalAwards=false
• 关键词: Temporal; dynamics; phonetic; perceptual; organization

Scientists and engineers have studied speech to understand why this form of communication is so effective. They have also sought to create speaking and listening devices that approach the accuracy and ease of everyday communication, with modest success. The research problem has been easy to define: English is composed of more than 100,000 words created from over 16,000 different syllables and syllables are composed from a small inventory of several dozen consonants and vowels. Automatic speech recognition would be remarkably easy if these linguistic properties - words, syllables, consonants, vowels -produced uniformity in the sounds that talkers actually make. In fact, each utterance is also physically unique, whether in its sound pattern or in the visible movements of the speaker's face. Different vocal anatomy in men, women and children causes complex variation in sound production even when the linguistic message is the same. Moreover, aspects of a talker's productions may express the dialect and speaking style of their family and linguistic community. Human listeners readily attend to the acoustic hints of these individual and social markers while also listening for the message. This project will examine how these different sources of perceptual information for speech are organized, how they are integrated over time, and how they allow perceptual tuning to the speech of individual talkers. Ultimately, a more complete account of the perception of speech can lead to improvement in recognition technology and to the creation of assistive devices.Three experimental projects will be performed: 1) to estimate the temporal dynamics of auditory sensory integration; 2) to determine the dimensions of exposure-based perceptual tuning to the characteristics of individual talkers; and, 3) to describe and model the intrinsic differences in auditory and visual temporal sensitivity and persistence that affect audiovisual speech perception. In each instance, the perceptual sensitivity to linguistic properties, talker characteristics, and language general features of spoken language will be assayed using discriminating and robust measures of auditory and audiovisual resolution. The studies explore the versatility of perceptual faculties applied to speech and provide an opportunity to identify the principles underlying the remarkably robust perceptual abilities that support and sustain communication. The overall goal is a formal and functional characterization of the cognitive resources that insure the perceptual stability of spoken communication in natural environments, whether the source of speech is visible or not, whether the talker is familiar or not, and whether the quality of the sensory samples of speech is natural or not.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

科学家和工程师研究了语音，以了解为什么这种交流形式如此有效。他们还试图创造出接近日常交流的准确性和便捷性的口语和听力设备，并取得了一定的成功。研究问题很容易定义：英语由超过 100,000 个单词组成，这些单词由 16,000 多个不同的音节组成，而音节则由几十个辅音和元音组成。如果这些语言特性——单词、音节、辅音、元音——能够使说话者实际发出的声音保持一致，那么自动语音识别就会变得非常容易。事实上，每个话语在物理上也是独一无二的，无论是声音模式还是说话者面部的可见动作。 即使语言信息相同，男性、女性和儿童的不同声音解剖结构也会导致声音产生的复杂变化。此外，说话者的作品的各个方面可能表达了他们的家庭和语言社区的方言和说话风格。人类听众很容易注意到这些个人和社会标记的声音暗示，同时也聆听消息。该项目将研究这些不同的语音感知信息来源是如何组织的，它们如何随着时间的推移进行整合，以及它们如何允许对单个说话者的语音进行感知调整。最终，对语音感知的更完整的解释可以促进识别技术的改进和辅助设备的创建。将进行三个实验项目：1）估计听觉感觉统合的时间动态； 2）确定基于暴露的感知调整对个体说话者特征的维度； 3）描述和建模影响视听语音感知的听觉和视觉时间敏感性和持久性的内在差异。在每种情况下，将使用听觉和视听分辨率的辨别性和鲁棒性测量来分析对语言特性、说话者特征和口语的语言一般特征的感知敏感性。这些研究探索了应用于言语的感知能力的多功能性，并提供了一个机会来确定支持和维持沟通的非常强大的感知能力背后的原理。总体目标是对认知资源进行形式和功能表征，确保自然环境中口语交流的感知稳定性，无论语音来源是否可见，无论说话者是否熟悉，以及语音感官样本的质量是否自然。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。