Perception and cognition of musical timbre

对音乐音色的感知和认知

• 批准号: RGPIN-2015-05280
• 负责人: Mcadams, Stephen
• 金额: $ 5.17万
• 依托单位: McGill University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2019
• 资助国家: 加拿大
• 起止时间: 2019-01-01 至 2020-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=691613
• 关键词: Perception; cognition; musical; timbre

Timbre is one of the least studied auditory attributes, and yet it plays a crucial role in many aspects of audition. Timbre refers to many attributes of sound other than pitch, duration, loudness, and spatial position. Attempts to model its perceptual representation have been fairly rudimentary. No comprehensive program elsewhere in the world addresses the many task-dependent aspects of timbre representation and relates them to auditory perception in general and music perception in particular. This program will extend work on scalar acoustic parameters that correlate with the perceptual dimensions of timbre to the psychophysics of time-varying parameters and higher-dimensional representations such as spectrotemporal receptive fields modeled on auditory cortical neurons. I will confront these different models of sensory representation and feature extraction to assess their ability to account for perceptual results related to similarity perception, perceptual fusion, auditory stream formation, auditory salience, recognition of sound sources, and memory effects. I will determine how perceptual representations capture the way timbre, pitch, and playing effort covary in instrument sounds and will study their contribution to recognition and identification through the acquisition of mental models of sound sources. I will define how the relations between auditory representations of concurrent sounds condition their perceptual fusion and determine the resulting blended timbral qualities. I will study the aspects of timbre representation that affect auditory stream segregation and that capture listeners' attention by intrinsic salient timbral properties or extrinsic contextual salience. Finally, I will investigate the ways in which timbre is encoded in auditory memory and will study the impact of memory traces and perceptual models of sound sources on timbre dissimilarity structures. This research program will take our understanding of timbre processing to the next level by introducing a quantitative framework involving time-varying properties, by systematically evaluating and comparing representation models in terms of accuracy, generalizability and parsimony on a wide range of data sets, by characterizing the malleability of feature representations under different perceptual tasks, and by demonstrating that timbre contributes to attention, learning and memory. The program will provide a unique training environment for the acquisition of skills in behavioural testing techniques, experimental design, complex data analysis and statistics, mathematical modeling of auditory processes, and digital signal processing. It will have an impact on a variety of application domains such as auditory prostheses, music recommendation, and computer-aided orchestration.**

音色是研究最少的听觉属性之一，但它在试听的许多方面都起着至关重要的作用。音色指的是除音调、持续时间、响度和空间位置以外的声音的许多属性。对其知觉表征进行建模的尝试还相当初级。在世界其他地方，没有一个全面的计划解决音色表现的许多与任务相关的方面，并将它们与一般的听觉感知，特别是音乐感知联系起来。该计划将把与音色感知维度相关的标量声学参数的工作扩展到时变参数和更高维度表示的心理物理学，例如以听觉皮质神经元为模型的频谱时间感受场。我将面对这些不同的感觉表征和特征提取模型，以评估它们解释与相似性感知、知觉融合、听觉流形成、听觉突显、声源识别和记忆效果相关的知觉结果的能力。我将确定知觉表征如何捕捉乐器声音中音色、音调和演奏努力的共同变化方式，并将通过获取声源的心理模型来研究它们对识别和识别的贡献。我将定义同时声音的听觉表征之间的关系如何调节它们的知觉融合，并确定产生的混合音色质量。我将研究音色表征影响听流分离的方面，以及通过内在显著音色属性或外在语境突显吸引听者注意力的方面。最后，我将研究音色在听觉记忆中的编码方式，并将研究记忆痕迹和声源的感知模型对音色差异结构的影响。这项研究计划将我们对音色加工的理解提升到一个新的水平，通过引入一个涉及时变属性的量化框架，通过在广泛的数据集上系统地评估和比较表征模型的准确性、概括性和简洁性，通过表征不同知觉任务下特征表征的延展性，并通过证明音色有助于注意力、学习和记忆。该计划将为获得行为测试技术、实验设计、复杂数据分析和统计、听觉过程数学建模和数字信号处理方面的技能提供独特的培训环境。它将对各种应用领域产生影响，如听觉假体、音乐推荐和计算机辅助编排。**