Collaborative Research: Enhancing Speech Science Training through Collaboration: Investigating Perception of a Variable Speech Signal

协作研究:通过协作增强语音科学训练:研究可变语音信号的感知

基本信息

  • 批准号:
    2126888
  • 负责人:
  • 金额:
    $ 26.99万
  • 依托单位:
  • 依托单位国家:
    美国
  • 项目类别:
    Standard Grant
  • 财政年份:
    2021
  • 资助国家:
    美国
  • 起止时间:
    2021-10-01 至 2024-09-30
  • 项目状态:
    已结题

项目摘要

This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2). In recent years, automated speech recognition systems have become much more accurate and widely used. However, these systems still cannot handle speech variability as well as human listeners can. Furthermore, speech technology tends to work less effectively for underrepresented groups. This project will address these problems by investigating how human listeners understand variable speech, and by increasing the capacity and involvement of underrepresented groups in the field of speech science. The research will make prominent contributions to scientific knowledge of how human speech perception works. These contributions will be directly relevant to improving automatic speech recognition systems, which are becoming ubiquitous in technology, healthcare, and education. The project will also significantly strengthen research capacity in speech science at North Carolina A&T State University, which is the Nation’s largest Historically Black University, and will support increased training and involvement of students from underrepresented groups at both NC A&T and at Penn State University, the collaborating institution. The research and training outcomes of the project will help to make speech science and technology both more effective and more equitable.A critical yet unsolved question in speech science is how human listeners achieve robust speech perception despite a highly variable speech signal. Theories of speech perception disagree on basic assumptions: for example, some theories suggest that speech perception depends mainly on recognizing acoustic patterns, while other theories suggest that listeners perceive the vocal tract movements that cause the speech sounds. This project will test and improve these competing theories by investigating the phenomenon of compensation for coarticulation (CfC), which is the finding that listeners’ perception of speech segments is affected by the properties of surrounding speech. Several experiments will be used to examine how CfC works in conditions of speech variability (e.g., talker variability, rate variability, and competing speech), and how CfC is affected by learning. In addition, the project will build capacity at NC A&T along three dimensions by (a) providing research training for students in speech science, (b) fostering collaborations between researchers at A&T and Penn State, and (c) enhancing opportunities for faculty development.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
该奖项的全部或部分资金根据《2021 年美国救援计划法案》(公法 117-2)提供。近年来,自动语音识别系统变得更加准确并得到广泛应用。然而,这些系统仍然无法像人类听众那样处理语音变化。此外,语音技术对于代表性不足的群体来说往往效果较差。该项目将通过研究人类听众如何理解可变语音以及提高语音科学领域代表性不足群体的能力和参与来解决这些问题。这项研究将为人类语音感知如何运作的科学知识做出重大贡献。这些贡献将与改进自动语音识别系统直接相关,该系统在技术、医疗保健和教育领域正变得无处不在。该项目还将显着加强美国最大的历史上黑人大学北卡罗来纳 A&T 州立大学的言语科学研究能力,并将支持 NC A&T 和合作机构宾夕法尼亚州立大学增加来自代表性不足群体的学生的培训和参与。该项目的研究和培训成果将有助于使语音科学和技术更加有效和更加公平。 语音科学中一个关键但尚未解决的问题是,人类听众如何在高度可变的语音信号下实现稳健的语音感知。语音感知理论在基本假设上存在分歧:例如,一些理论认为语音感知主要取决于识别声学模式,而其他理论则认为听众感知引起语音的声道运动。该项目将通过研究协同发音补偿(CfC)现象来测试和改进这些相互竞争的理论,该现象发现听众对语音片段的感知受到周围语音特性的影响。将使用几个实验来检查 CfC 在语音变异性(例如,说话者变异性、语速变异性和竞争性语音)条件下如何工作,以及 CfC 如何受到学习的影响。此外,该项目还将通过以下三个方面建设 NC A&T 的能力:(a) 为言语科学的学生提供研究培训,(b) 促进 A&T 和宾夕法尼亚州立大学研究人员之间的合作,以及 (c) 增加教师发展的机会。该奖项反映了 NSF 的法定使命,并通过使用基金会的智力价值和更广泛的影响审查标准进行评估,被认为值得支持。

项目成果

期刊论文数量(1)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Perceptual learning alters effects of foreign language backgrounds in speech-in-speech recognition
感知学习改变外语背景在语音识别中的影响
  • DOI:
    10.1121/10.0013422
  • 发表时间:
    2022
  • 期刊:
  • 影响因子:
    1
  • 作者:
    Olmstead, Annie J.;Viswanathan, Navin;Albor, Jacqueline;Billetdeaux, Olivia
  • 通讯作者:
    Billetdeaux, Olivia
{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Navin Viswanathan其他文献

Are the objects of speech perception articulatory gestures or auditory qualities ? 10 April 2009 Perceptual compensation for coarticulation : Implications for theories of speech perception
言语感知的对象是发音姿势还是听觉品质?
  • DOI:
  • 发表时间:
    2009
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Navin Viswanathan
  • 通讯作者:
    Navin Viswanathan
The Impact of Facial Personal Protective Equipment on Speech Intensity
面部个人防护装备对言语强度的影响
  • DOI:
  • 发表时间:
    2022
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Tara Krishnan;Paul Rudy;Navin Viswanathan;Margaret Brommelsiek;Austin Bachar;G. Sutkin
  • 通讯作者:
    G. Sutkin
The Role of the Speaker, the Listener, and Their Joint Contributions During Communicative Interactions: A Tripartite View of Intelligibility in Individuals With Dysarthria.
说话者、听者的角色以及他们在交际互动中的共同贡献:构音障碍患者的清晰度的三方观点。
The Use of Vowel Length in Making Voicing Judgments by Native Listeners of English and Spanish: Implications for Rate Normalization
英语和西班牙语母语听众在进行声态判断时使用元音长度:对速率标准化的影响
  • DOI:
    10.1177/0023830919851529
  • 发表时间:
    2020
  • 期刊:
  • 影响因子:
    1.8
  • 作者:
    Navin Viswanathan;Annie J. Olmstead;M. Aivar
  • 通讯作者:
    M. Aivar
Studying Conversational Adjustments in Interaction: Beyond Acoustic Phonetic Changes.
研究交互中的会话调整:超越声学语音变化。

Navin Viswanathan的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Navin Viswanathan', 18)}}的其他基金

Making words disappear or appear: A neurocognitive and behavioral investigation of effects of speech rate on spoken word recognition
让单词消失或出现:语速对口语单词识别影响的神经认知和行为研究
  • 批准号:
    1559719
  • 财政年份:
    2015
  • 资助金额:
    $ 26.99万
  • 项目类别:
    Standard Grant
Making words disappear or appear: A neurocognitive and behavioral investigation of effects of speech rate on spoken word recognition
让单词消失或出现:语速对口语单词识别影响的神经认知和行为研究
  • 批准号:
    1431105
  • 财政年份:
    2014
  • 资助金额:
    $ 26.99万
  • 项目类别:
    Standard Grant

相似国自然基金

Research on Quantum Field Theory without a Lagrangian Description
  • 批准号:
    24ZR1403900
  • 批准年份:
    2024
  • 资助金额:
    0.0 万元
  • 项目类别:
    省市级项目
Cell Research
  • 批准号:
    31224802
  • 批准年份:
    2012
  • 资助金额:
    24.0 万元
  • 项目类别:
    专项基金项目
Cell Research
  • 批准号:
    31024804
  • 批准年份:
    2010
  • 资助金额:
    24.0 万元
  • 项目类别:
    专项基金项目
Cell Research (细胞研究)
  • 批准号:
    30824808
  • 批准年份:
    2008
  • 资助金额:
    24.0 万元
  • 项目类别:
    专项基金项目
Research on the Rapid Growth Mechanism of KDP Crystal
  • 批准号:
    10774081
  • 批准年份:
    2007
  • 资助金额:
    45.0 万元
  • 项目类别:
    面上项目

相似海外基金

Collaborative Research: HNDS-I: NewsScribe - Extending and Enhancing the Media Cloud Searchable Global Online News Archive
合作研究:HNDS-I:NewsScribe - 扩展和增强媒体云可搜索全球在线新闻档案
  • 批准号:
    2341858
  • 财政年份:
    2024
  • 资助金额:
    $ 26.99万
  • 项目类别:
    Standard Grant
Collaborative Research: HNDS-I: NewsScribe - Extending and Enhancing the Media Cloud Searchable Global Online News Archive
合作研究:HNDS-I:NewsScribe - 扩展和增强媒体云可搜索全球在线新闻档案
  • 批准号:
    2341859
  • 财政年份:
    2024
  • 资助金额:
    $ 26.99万
  • 项目类别:
    Standard Grant
Collaborative Research: Frameworks: hpcGPT: Enhancing Computing Center User Support with HPC-enriched Generative AI
协作研究:框架:hpcGPT:通过 HPC 丰富的生成式 AI 增强计算中心用户支持
  • 批准号:
    2411297
  • 财政年份:
    2024
  • 资助金额:
    $ 26.99万
  • 项目类别:
    Standard Grant
Collaborative Research: Frameworks: hpcGPT: Enhancing Computing Center User Support with HPC-enriched Generative AI
协作研究:框架:hpcGPT:通过 HPC 丰富的生成式 AI 增强计算中心用户支持
  • 批准号:
    2411298
  • 财政年份:
    2024
  • 资助金额:
    $ 26.99万
  • 项目类别:
    Standard Grant
CLIMA/Collaborative Research: Enhancing Soil-Based Infrastructure Resilience to Climate Change: Harnessing the Potential of Fractured Soil by Adding Biopolymers
CLIMA/合作研究:增强土壤基础设施对气候变化的抵御能力:通过添加生物聚合物来利用破碎土壤的潜力
  • 批准号:
    2332082
  • 财政年份:
    2024
  • 资助金额:
    $ 26.99万
  • 项目类别:
    Continuing Grant
Collaborative Research: Frameworks: hpcGPT: Enhancing Computing Center User Support with HPC-enriched Generative AI
协作研究:框架:hpcGPT:通过 HPC 丰富的生成式 AI 增强计算中心用户支持
  • 批准号:
    2411299
  • 财政年份:
    2024
  • 资助金额:
    $ 26.99万
  • 项目类别:
    Standard Grant
Collaborative Research: Frameworks: hpcGPT: Enhancing Computing Center User Support with HPC-enriched Generative AI
协作研究:框架:hpcGPT:通过 HPC 丰富的生成式 AI 增强计算中心用户支持
  • 批准号:
    2411296
  • 财政年份:
    2024
  • 资助金额:
    $ 26.99万
  • 项目类别:
    Standard Grant
Collaborative Research: Frameworks: hpcGPT: Enhancing Computing Center User Support with HPC-enriched Generative AI
协作研究:框架:hpcGPT:通过 HPC 丰富的生成式 AI 增强计算中心用户支持
  • 批准号:
    2411295
  • 财政年份:
    2024
  • 资助金额:
    $ 26.99万
  • 项目类别:
    Standard Grant
CLIMA/Collaborative Research: Enhancing Soil-Based Infrastructure Resilience to Climate Change: Harnessing the Potential of Fractured Soil by Adding Biopolymers
CLIMA/合作研究:增强土壤基础设施对气候变化的抵御能力:通过添加生物聚合物来利用破碎土壤的潜力
  • 批准号:
    2332081
  • 财政年份:
    2024
  • 资助金额:
    $ 26.99万
  • 项目类别:
    Continuing Grant
Collaborative Research: Frameworks: hpcGPT: Enhancing Computing Center User Support with HPC-enriched Generative AI
协作研究:框架:hpcGPT:通过 HPC 丰富的生成式 AI 增强计算中心用户支持
  • 批准号:
    2411294
  • 财政年份:
    2024
  • 资助金额:
    $ 26.99万
  • 项目类别:
    Standard Grant
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了