I-Corps: Real-time visual feedback for speech learning

I-Corps：语音学习的实时视觉反馈

• 批准号: 2408991
• 负责人: Tara McAllister
• 金额: $ 5万
• 依托单位: New York University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2024
• 资助国家: 美国
• 起止时间: 2024-03-01 至 2025-02-28
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2408991&HistoricalAwards=false
• 关键词: Corps; Real; time; visual; feedback

The broader impact of this I-Corps project is the development of a speech learning technology using visual-acoustic biofeedback for individuals interested in altering their speech patterns. When individuals are unable to pronounce certain sounds in a normal way or communicate successfully, there are negative impacts to participation in social and professional settings. Speech-language pathologists who treat speech disorders report that evidence-based treatment and resources for some sound pronunciations are scarce. Very few empirically-tested interventions are available that allow visualization of the acoustic speech signal, an evidence-based method to enhance learning. This software can also be implemented remotely via videoconferencing or telepractice, with the potential for significant impact on service providers, clinicians, and individuals. Ultimately, providing access to more efficient technology can improve communication and quality of life for many individuals. While some speech sounds have high salience in clinical and language learning contexts, there is a wide range of sounds that would broaden the impact of this technology in future stages of development. An additional application includes gender-affirming voice training.This I-Corps project utilizes experiential learning coupled with a first-hand investigation of the industry ecosystem to assess the translation potential of the technology. The solution is based on the development of a technology that provides visual-acoustic biofeedback to enhance learning and ultimately help individuals change their speech patterns. This technology is integrated in software that allows learners to view resonant frequencies of the vocal tract and compare them with a visual target representing the desired pronunciation. The technology uses the form of a real-time linear predictive coding spectrum of the speech signal. Manipulating certain characteristics of speech, such as resonant frequencies of the vocal tract, is a complex concept. This software can be used across a wide range of devices and via videoconferencing. The technology includes features to enhance an individual’s speech learning process, which includes adaptive difficulty in stimulus prompts, progress tracking, and gamification. Lastly, this speech visualization software will be integrated with a machine learning classifier developed to extend the utility of the technology.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该 I-Corps 项目的更广泛影响是为有兴趣改变言语模式的个人开发了一种使用视声生物反馈的言语学习技术。 当个人无法以正常方式发出某些声音或无法成功沟通时，会对参与社会和专业环境产生负面影响。治疗言语障碍的言语病理学家报告说，一些声音发音的循证治疗和资源很少。很少有经过经验测试的干预措施可以实现声学语音信号的可视化，这是一种基于证据的增强学习的方法。该软件还可以通过视频会议或远程练习远程实施，可能对服务提供商、临床医生和个人产生重大影响。最终，提供更高效的技术可以改善许多人的沟通和生活质量。虽然某些语音在临床和语言学习环境中具有高度显着性，但有多种声音将扩大该技术在未来发展阶段的影响。另一项应用包括性别肯定语音培训。该 I-Corps 项目利用体验式学习以及对行业生态系统的第一手调查来评估该技术的翻译潜力。该解决方案基于一项技术的开发，该技术提供视觉声学生物反馈以增强学习并最终帮助个人改变他们的言语模式。该技术集成在软件中，允许学习者查看声道的共振频率，并将其与代表所需发音的视觉目标进行比较。该技术采用语音信号的实时线性预测编码频谱的形式。操纵语音的某些特征（例如声道的共振频率）是一个复杂的概念。该软件可在多种设备上并通过视频会议使用。该技术包括增强个人语音学习过程的功能，其中包括刺激提示的自适应难度、进度跟踪和游戏化。最后，该语音可视化软件将与为扩展该技术的实用性而开发的机器学习分类器集成。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。