Automatic detection and modelling of acoustic markers of speech timing

语音计时声学标记的自动检测和建模

• 批准号: DP230101184
• 负责人: Prof Julien Epps
• 金额: $ 29.2万
• 依托单位: The University of New South Wales
• 依托单位国家: 澳大利亚
• 项目类别: Discovery Projects
• 财政年份: 2023
• 资助国家: 澳大利亚
• 起止时间: 2023-01-01 至 2025-12-31
• 项目状态: 未结题
• 来源: https://dataportal.arc.gov.au/RGS/Web/Grants/DP230101184
• 关键词: Automatic; detection; modelling; acoustic; markers

This project aims to create new automatic sensing, analysis and assessment of cognitive, affective, mental and physical state from voice for mobile and computing devices. This project expects to generate new understanding of the effects of these states on detailed timing indicators of speech motor control, and new signal processing and machine learning methods that best exploit it. Expected outcomes from this project include a new and accurate deep neural network framework for learning, analysing and detecting human states from speech automatically using articulatory timing markers. This should provide significant benefits, such as individually-tailored, frequent and low-cost automatic detection, monitoring and analytics for adverse states.

该项目旨在为移动的和计算设备创建新的自动感知，分析和评估认知，情感，精神和身体状态的语音。该项目预计将对这些状态对言语运动控制的详细计时指标的影响产生新的理解，以及最好地利用它的新信号处理和机器学习方法。该项目的预期成果包括一个新的准确的深度神经网络框架，用于使用发音计时标记自动学习，分析和检测语音中的人类状态。这将带来显著的好处，例如针对不利状态的个性化、频繁和低成本的自动检测、监控和分析。