Sound synthesis and sound processing for audio and musical applications

音频和音乐应用的声音合成和声音处理

• 批准号: 262808-2012
• 负责人: Depalle, Philippe
• 金额: $ 1.53万
• 依托单位: McGill University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2015
• 资助国家: 加拿大
• 起止时间: 2015-01-01 至 2016-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=571286
• 关键词: Sound; synthesis; sound; processing; audio

This research project aims at improving the accuracy and the adequacy of audio signal representations and modelling by benefiting from recent advances in signal processing techniques. More precisely the goal is to better address the dual nature of sound signals, which are often a mixture of temporal transients, and modulated frequency components. It will result in a better quality of sound processing, sound synthesis, and will nurture applied projects such as high quality sound source separation or audio morphing. This project is part and parcel of the so-called analysis/synthesis approach for sound synthesis and sound processing, an often used approach in musical applications, but also in sound design, audio coding and sound recording. The basic goal of analysis/synthesis is to conceive relevant models to represent acoustical signals by a set of temporal functions (the control parameters) that controls a synthesis structure. These temporal functions can be generated in abstracto or extracted from a pre-recorded sound during the analysis process. Re-synthesis produces a signal that sounds perceptually identical to the original sound. By modifying and substituting control parameters, this analysis-synthesis scheme can provide for very refined and precise processing of sound material. For example, it may allow one to produce a family of synthetic sound signals derived from a single original one or to carry out a morphing between two key sounds. It can also be used to make decision on source separation by a proper sorting and grouping of temporal functions into coherent subsets. In this context the quality of the representation of audio signals is essential. The proposed research program is two-fold: at a fundamental level the research work consists in strengthening the core foundation of time-frequency representation and parametric modelling of sound signals. At a practical level the research is focused on the audio applications which could benefit from these new signal processing tools.

该研究项目旨在通过受益于信号处理技术的最新进展来提高音频信号表示的准确性和适当性和建模。更确切地说，目标是更好地解决声音信号的双重性质，后者通常是时间瞬变和调制频率组件的混合物。这将导致声音处理的质量更好，声音综合，并将培养应用的项目，例如高质量的声源分离或音频变形。 该项目是声音综合和声音处理的所谓分析/合成方法的一部分，这是音乐应用中经常使用的方法，以及声音设计，音频编码和声音录制。分析/合成的基本目标是通过一组控制合成结构的时间函数（控制参数）来构想相关模型来表示声学信号。这些时间函数可以在分析过程中以摘要形式产生，也可以从预先录制的声音中提取。重新合成产生一个信号，听起来与原始声音相同。通过修改和替换控制参数，这种分析合成方案可以提供非常精致且精确的声音材料处理。例如，它可能允许一个人产生一个由单个原始声音衍生而来的合成声信号，或者在两个关键声音之间进行变形。它也可以用来通过将时间函数的适当分类和分组到连贯的子集进行源分离做出决定。在这种情况下，音频信号表示的质量至关重要。 拟议的研究计划是两个方面：在基本层面上，研究工作包括加强声音信号的时频表示和参数建模的核心基础。在实际层面上，研究集中于可以从这些新信号处理工具中受益的音频应用程序。