Acoustics, perception and modelling of musical timbre

音乐音色的声学、感知和建模

• 批准号: RGPIN-2020-04022
• 负责人: McAdams, Stephen
• 金额: $ 4.01万
• 依托单位: McGill University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2020
• 资助国家: 加拿大
• 起止时间: 2020-01-01 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=716774
• 关键词: Acoustics; perception; modelling; musical; timbre

Timbre refers to many dimensions of sound other than pitch, duration, loudness, and spatial position. My long-term research program studies the perception and cognition of musical timbre, with the aim of providing perceptual models for phenomena that play a significant role in musical practice and in the reception of music by listeners, as well as in everyday auditory experience. Acoustic descriptors related to timbre have been developed, but we need to test whether the way such descriptors vary over time is crucial to perception. We will also study timbre's covariation with pitch and playing effort in musical instrument sounds and will study the cognitive mechanisms responsible for the failure to identify instruments when played in extreme registers. We will also study how long-term representations of the timbral variations across pitch and playing effort are embodied in mental models of the behaviour of musical sound sources. Applying the psychomechanical approach and using digital models that can simulate processes representing sounding objects and the actions that make them vibrate, we will explore mental models of sound source behaviour by combining unlikely actions and objects (such as a blown plate and a struck air column). Timbre plays several roles in musical organization. It arises as an emergent property from the perceptual fusion of acoustic components into auditory events, including the blending of several events produced by separate instruments to create new timbres. We will test the hypothesis that emergent timbral properties of combinations depend on their blending. Other work will explore the effect of room reverberation, spatial position of instruments, and microphone placement on performance and perception of timbral blend in music recordings. We will study the timbral properties that play a crucial role in the segmentation of sound sequences into patterns that can be processed in working memory. In much orchestral music, timbral similarity plays a role, in concert with other musical parameters such as pitch and musical texture, in the looser grouping of instruments into foreground and background orchestral layers. We will study the contribution of timbre to auditory salience that brings some musical materials to the foreground, capturing a listener's attention. Memory for timbre is also of paramount importance in music. We will study short-term memory processes for the timbre of single events and timbral sequences. Timbral properties also strongly affect the emotional tone of music. We will explore the role of timbre in communicating emotion and inducing emotional response in music and will characterize the role of individual differences, acculturation, and familiarity with the instruments in felt emotion. This research has important implications for auditory psychology, hearing prostheses, auditory alarms, music recommendation engines, orchestral simulation, music performance, and sound engineering.

音色是指声音的许多方面，而不是音高，持续时间，响度和空间位置。我的长期研究计划研究音乐音色的感知和认知，目的是为在音乐实践和听众对音乐的接受以及日常听觉体验中发挥重要作用的现象提供感知模型。 与音色相关的声学描述符已经开发出来，但我们需要测试这些描述符随时间变化的方式是否对感知至关重要。我们还将研究音色的协变与音高和演奏乐器的声音努力，并将研究的认知机制，负责识别乐器时，在极端寄存器。我们还将研究如何跨音高和演奏努力的音色变化的长期表征体现在音乐声源的行为的心理模型。 应用心理力学的方法，并使用数字模型，可以模拟代表发声物体的过程和使它们振动的动作，我们将通过结合不太可能的动作和物体（如吹板和打击空气柱）来探索声源行为的心理模型。 音色在音乐组织中扮演着几个角色。它作为一种新兴的属性出现在听觉事件中的声学成分的感知融合中，包括由不同乐器产生的几个事件的混合，以创造新的音色。我们将检验这个假设，即组合的涌现音色特性取决于它们的混合。其他工作将探讨室内混响，乐器的空间位置和麦克风放置对音乐录音中音色混合的表现和感知的影响。我们将研究音色特性，它在将声音序列分割成可以在工作记忆中处理的模式中起着至关重要的作用。在许多管弦乐中，音色相似性与其他音乐参数（如音高和音乐织体）一起发挥作用，将乐器松散地分组为前景和背景管弦乐层。我们将研究音色对听觉显著性的贡献，这种听觉显著性将一些音乐材料带到前景，吸引听众的注意力。 音色记忆在音乐中也是至关重要的。我们将研究单个事件和音色序列的音色的短时记忆过程。 音色特性也强烈影响音乐的情感基调。我们将探讨音色在沟通情感和诱导音乐中的情感反应的作用，并将描述个体差异，文化适应和对乐器的熟悉程度在感受情感中的作用。 这项研究对听觉心理学、听觉假体、听觉警报、音乐推荐引擎、管弦乐模拟、音乐表演和声音工程都有重要意义。