Sound analysis, sound synthesis, and sound processing for audio and musical applications
适用于音频和音乐应用的声音分析、声音合成和声音处理
基本信息
- 批准号:RGPIN-2018-05662
- 负责人:
- 金额:$ 4.08万
- 依托单位:
- 依托单位国家:加拿大
- 项目类别:Discovery Grants Program - Individual
- 财政年份:2022
- 资助国家:加拿大
- 起止时间:2022-01-01 至 2023-12-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
This research project aims at improving the accuracy and the adequacy of audio signal representations and modelling by benefiting from recent advances in signal processing techniques. More precisely the goal is to better address the dual nature of sound signals, which are often a mixture of temporal transients, and modulated frequency components. It will result in a better quality of sound processing, sound synthesis, and will nurture applied projects such as high-quality sound source separation or audio morphing.This project is part and parcel of the so-called analysis/synthesis approach for sound synthesis and sound processing, an often-used approach in musical applications, but also in sound design, audio coding and sound recording. The basic goal of analysis/synthesis is to conceive relevant models to represent acoustical signals by a set of temporal functions (the control parameters) that controls a synthesis structure. These temporal functions can be generated in the abstract or extracted from a pre-recorded sound during the analysis process. Re-synthesis produces a signal that sounds perceptually identical to the original sound. By modifying and substituting control parameters, this analysis/synthesis scheme can provide for very refined and precise processing of sound material. For example, it may allow one to produce a family of synthetic sound signals derived from a single original one or to carry out a morphing between two key sounds. It can also be used to make a decision on source separation by a proper sorting and grouping of temporal functions into coherent subsets.We plan to put in place a more general and higher-level description of time-varying parameters of the partials of polyphonic signals, and develop complementary analyses techniques. We also hope to provide better strategies for audio source separation that will benefit from prior knowledge of the underlying structure of sound signals, particularly as regards the phase. Finally, the extension of the analysis/synthesis approach to some classes of non-linear-systems will contribute to a more unified view of sound synthesis and sound processing and will allow for a general representation of several existing audio effects. Beyond the advance of knowledge and the training of highly qualified personnel, the expected significance in terms of applications is that a better analysis/synthesis procedure would lead to refined synthesis and processing methods. More specifically, this refinement could be decisive in applications where the separation of a few sound sources is useful, such as advanced remix for sound recording, audio restoration, coding, game industry, and movie sound effects. It would also help to design industrial applications which involve mixture of complex sounds such as 'environmental sounds' (rolling, balls, wind, water, and motor sounds).
该研究项目旨在通过利用信号处理技术的最新进展来提高音频信号表示和建模的准确性和充分性。更确切地说,目标是更好地解决声音信号的双重性质,声音信号通常是时间瞬变和调制频率分量的混合。它将导致更好的声音处理质量,声音合成,并将培育应用项目,如高质量的声源分离或音频变形。该项目是所谓的声音合成和声音处理的分析/合成方法的一部分,这是一种在音乐应用中经常使用的方法,也是声音设计,音频编码和录音。分析/合成的基本目标是构思相关的模型,以通过一组控制合成结构的时间函数(控制参数)来表示声学信号。这些时间函数可以抽象地生成,或者在分析过程中从预先录制的声音中提取。重新合成产生一个信号,听起来与原始声音相同。通过修改和替换控制参数,该分析/合成方案可以提供对声音材料的非常精细和精确的处理。例如,它可以允许从单个原始声音信号产生一系列合成声音信号,或者在两个关键声音之间进行变形。它也可以用来作出一个适当的排序和分组的时间函数到相干subsets.We计划到位的多音信号的分音的时变参数的一个更一般和更高层次的描述源分离的决定,并开发互补的分析技术。我们还希望提供更好的音频源分离策略,这将受益于声音信号的底层结构的先验知识,特别是关于相位。最后,分析/合成方法扩展到某些类别的非线性系统将有助于声音合成和声音处理的更统一的观点,并将允许几个现有的音频效果的一般表示。除了知识的进步和高素质人员的培训之外,在应用方面的预期意义是,更好的分析/合成程序将导致完善的合成和处理方法。更具体地说,这种改进在一些声源的分离是有用的应用中可能是决定性的,例如用于声音记录、音频恢复、编码、游戏行业和电影音效的高级混音。它还将有助于设计涉及复杂声音混合的工业应用,例如“环境声音”(滚动,球,风,水和电机声音)。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Depalle, Philippe其他文献
Perceptually salient spectrotemporal modulations for recognition of sustained musical instruments
- DOI:
10.1121/1.4971204 - 发表时间:
2016-12-01 - 期刊:
- 影响因子:2.4
- 作者:
Thoret, Etienne;Depalle, Philippe;McAdams, Stephen - 通讯作者:
McAdams, Stephen
Defining a vibrotactile toolkit for digital musical instruments: characterizing voice coil actuators, effects of loading, and equalization of the frequency response
- DOI:
10.1007/s12193-020-00340-0 - 发表时间:
2020-07-26 - 期刊:
- 影响因子:2.9
- 作者:
Bukkapatnam, Aditya Tirumala;Depalle, Philippe;Wanderley, Marcelo M. - 通讯作者:
Wanderley, Marcelo M.
ACOUSTICAL CORRELATES OF TIMBRE AND EXPRESSIVENESS IN CLARINET PERFORMANCE
- DOI:
10.1525/mp.2010.28.2.135 - 发表时间:
2010-12-01 - 期刊:
- 影响因子:2.3
- 作者:
Barthet, Mathieu;Depalle, Philippe;Ystad, Solvi - 通讯作者:
Ystad, Solvi
Interval and Ratio Scaling of Spectral Audio Descriptors.
- DOI:
10.3389/fpsyg.2022.835401 - 发表时间:
2022 - 期刊:
- 影响因子:3.8
- 作者:
Kazazis, Savvas;Depalle, Philippe;McAdams, Stephen - 通讯作者:
McAdams, Stephen
Ordinal scaling of timbre-related spectral audio descriptors
- DOI:
10.1121/10.0005058 - 发表时间:
2021-06-01 - 期刊:
- 影响因子:2.4
- 作者:
Kazazis, Savvas;Depalle, Philippe;McAdams, Stephen - 通讯作者:
McAdams, Stephen
Depalle, Philippe的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Depalle, Philippe', 18)}}的其他基金
Sound analysis, sound synthesis, and sound processing for audio and musical applications
适用于音频和音乐应用的声音分析、声音合成和声音处理
- 批准号:
RGPIN-2018-05662 - 财政年份:2021
- 资助金额:
$ 4.08万 - 项目类别:
Discovery Grants Program - Individual
Sound analysis, sound synthesis, and sound processing for audio and musical applications
适用于音频和音乐应用的声音分析、声音合成和声音处理
- 批准号:
RGPIN-2018-05662 - 财政年份:2020
- 资助金额:
$ 4.08万 - 项目类别:
Discovery Grants Program - Individual
Sound analysis, sound synthesis, and sound processing for audio and musical applications
适用于音频和音乐应用的声音分析、声音合成和声音处理
- 批准号:
RGPIN-2018-05662 - 财政年份:2019
- 资助金额:
$ 4.08万 - 项目类别:
Discovery Grants Program - Individual
Sound analysis, sound synthesis, and sound processing for audio and musical applications
适用于音频和音乐应用的声音分析、声音合成和声音处理
- 批准号:
RGPIN-2018-05662 - 财政年份:2018
- 资助金额:
$ 4.08万 - 项目类别:
Discovery Grants Program - Individual
Sound synthesis and sound processing for audio and musical applications
音频和音乐应用的声音合成和声音处理
- 批准号:
262808-2012 - 财政年份:2016
- 资助金额:
$ 4.08万 - 项目类别:
Discovery Grants Program - Individual
Sound synthesis and sound processing for audio and musical applications
音频和音乐应用的声音合成和声音处理
- 批准号:
262808-2012 - 财政年份:2015
- 资助金额:
$ 4.08万 - 项目类别:
Discovery Grants Program - Individual
Sound synthesis and sound processing for audio and musical applications
音频和音乐应用的声音合成和声音处理
- 批准号:
262808-2012 - 财政年份:2014
- 资助金额:
$ 4.08万 - 项目类别:
Discovery Grants Program - Individual
Sound synthesis and sound processing for audio and musical applications
音频和音乐应用的声音合成和声音处理
- 批准号:
262808-2012 - 财政年份:2013
- 资助金额:
$ 4.08万 - 项目类别:
Discovery Grants Program - Individual
Sound synthesis and sound processing for audio and musical applications
音频和音乐应用的声音合成和声音处理
- 批准号:
262808-2012 - 财政年份:2012
- 资助金额:
$ 4.08万 - 项目类别:
Discovery Grants Program - Individual
Sound synthesis and sound processing for musical and audio applications
音乐和音频应用的声音合成和声音处理
- 批准号:
262808-2003 - 财政年份:2008
- 资助金额:
$ 4.08万 - 项目类别:
Discovery Grants Program - Individual
相似国自然基金
Scalable Learning and Optimization: High-dimensional Models and Online Decision-Making Strategies for Big Data Analysis
- 批准号:
- 批准年份:2024
- 资助金额:万元
- 项目类别:合作创新研究团队
Intelligent Patent Analysis for Optimized Technology Stack Selection:Blockchain BusinessRegistry Case Demonstration
- 批准号:
- 批准年份:2024
- 资助金额:万元
- 项目类别:外国学者研究基金项目
利用全基因组关联分析和QTL-seq发掘花生白绢病抗性分子标记
- 批准号:31971981
- 批准年份:2019
- 资助金额:58.0 万元
- 项目类别:面上项目
基于SERS纳米标签和光子晶体的单细胞Western Blot定量分析技术研究
- 批准号:31900571
- 批准年份:2019
- 资助金额:24.0 万元
- 项目类别:青年科学基金项目
利用多个实验群体解析猪保幼带形成及其自然消褪的遗传机制
- 批准号:31972542
- 批准年份:2019
- 资助金额:57.0 万元
- 项目类别:面上项目
基于Meta-analysis的新疆棉花灌水增产模型研究
- 批准号:41601604
- 批准年份:2016
- 资助金额:22.0 万元
- 项目类别:青年科学基金项目
基于个体分析的投影式非线性非负张量分解在高维非结构化数据模式分析中的研究
- 批准号:61502059
- 批准年份:2015
- 资助金额:19.0 万元
- 项目类别:青年科学基金项目
多目标诉求下我国交通节能减排市场导向的政策组合选择研究
- 批准号:71473155
- 批准年份:2014
- 资助金额:60.0 万元
- 项目类别:面上项目
大规模微阵列数据组的meta-analysis方法研究
- 批准号:31100958
- 批准年份:2011
- 资助金额:20.0 万元
- 项目类别:青年科学基金项目
基于物质流分析的中国石油资源流动过程及碳效应研究
- 批准号:41101116
- 批准年份:2011
- 资助金额:23.0 万元
- 项目类别:青年科学基金项目
相似海外基金
"Mimicking Human Head Sound Responses": Towards an Anatomically Accurate Head Prototype for Bone Conduction Crosstalk Cancellation Analysis with Humans
“模仿人类头部声音反应”:构建解剖学上准确的头部原型,用于人类骨传导串扰消除分析
- 批准号:
24K20786 - 财政年份:2024
- 资助金额:
$ 4.08万 - 项目类别:
Grant-in-Aid for Early-Career Scientists
Automated lung sound analysis to improve the clinical diagnosis of pulmonary tuberculosis in children
自动肺音分析提高儿童肺结核的临床诊断
- 批准号:
10717389 - 财政年份:2023
- 资助金额:
$ 4.08万 - 项目类别:
Analysis of Japanese and English sound emission expressions and their proper characterization in the fields of language acquistion and use, and foreign-language learning
日语和英语的声发射表达分析及其在语言习得和使用以及外语学习领域的正确表征
- 批准号:
23K00579 - 财政年份:2023
- 资助金额:
$ 4.08万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
A study on environmental sound analysis based on unified and continual learning
基于统一持续学习的环境声分析研究
- 批准号:
23K16908 - 财政年份:2023
- 资助金额:
$ 4.08万 - 项目类别:
Grant-in-Aid for Early-Career Scientists
Nonlinear wave interactions in the cochlea and their application to sound processing
耳蜗中的非线性波相互作用及其在声音处理中的应用
- 批准号:
10577844 - 财政年份:2022
- 资助金额:
$ 4.08万 - 项目类别:
Early diagnostics of hearing loss based on numerical analysis and measurement of the emitted sound by auditory sensory cell
基于听觉感觉细胞发出声音的数值分析和测量的听力损失早期诊断
- 批准号:
22K18183 - 财政年份:2022
- 资助金额:
$ 4.08万 - 项目类别:
Grant-in-Aid for Early-Career Scientists
Advancing DNA sequence analysis algorithms using biologically inspired and mathematical sound analysis at the University of Tokyo
东京大学利用生物学启发和数学声音分析推进 DNA 序列分析算法
- 批准号:
577723-2022 - 财政年份:2022
- 资助金额:
$ 4.08万 - 项目类别:
Canadian Graduate Scholarships Foreign Study Supplements
Nonlinear wave interactions in the cochlea and their application to sound processing
耳蜗中的非线性波相互作用及其在声音处理中的应用
- 批准号:
10427031 - 财政年份:2022
- 资助金额:
$ 4.08万 - 项目类别:
Noise Analysis and Control of Reactor Using Combined Magnetic-Vibration-Sound Analysis
采用磁-振动-声联合分析法对反应堆进行噪声分析与控制
- 批准号:
22K04048 - 财政年份:2022
- 资助金额:
$ 4.08万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
Data-driven sound field measurement for high-resolution spatial audio analysis and its applications
数据驱动的高分辨率空间音频分析声场测量及其应用
- 批准号:
22H03608 - 财政年份:2022
- 资助金额:
$ 4.08万 - 项目类别:
Grant-in-Aid for Scientific Research (B)