Music in our ears: the biological bases of musical timbre perception.
Music in our ears: the biological bases of musical timbre perception.
复制标题
DOI：
10.1371/journal.pcbi.1002759
复制
发表时间：
2012
影响因子：
4.3
通讯作者：
Elhilali M
中科院分区：
文献类型：
--
作者：
Patil K;Pressnitzer D;Shamma S;Elhilali M
音色是声音的属性，使人类和其他动物能够区分不同的声源。基于音乐音色的心理物理判断、声音物理特征的生态分析以及机器学习方法的研究都表明，音色是一个多方面的属性，它调用了频谱和时间声音特征。在这里，我们探索了音乐音色的神经基础。我们使用了一个基于光谱-时间接受野的神经计算框架，该框架记录了哺乳动物初级听觉皮层中的1000多个神经元以及模拟皮层神经元，并辅以非线性分类器。无论音高和演奏风格如何，该模型都能够进行稳健的乐器分类，准确率达到98.7%。使用相同的前端，该模型还能够再现人类听众感知到的音色之间的感知距离判断。该研究表明，在哺乳动物初级听觉皮层中观察到的联合光谱-时间特征，对于提供足够丰富的表征至关重要，这对于解释人类听众对音色的感性判断以及对乐器的识别是必要的。音乐是一种复杂的声音体验，我们常常认为这是理所当然的。无论是坐在交响乐大厅里，还是戴着耳机欣赏一段旋律，我们都能毫不费力地分辨出演奏的乐器，跟随不同的节拍，或者简单地区分长笛和双簧管。我们的大脑依靠一些声音属性来分析我们耳朵里的音乐。这些属性可以很简单，比如响度，也可以很复杂，比如乐器的特性。我们能够识别乐器的一个主要因素是所谓的“音色”。在音乐的所有感知属性中，音色仍然是最神秘的，最不适合简单的数学抽象。在这项工作中，我们研究了音乐音色的神经基础，试图定义其感知空间并探索基于音色的识别过程。我们提出了一种基于哺乳动物初级听觉皮层水平的反应的方案，并表明它可以准确地预测人类听者的声源识别和感知音色判断。本文的分析有力地表明，在听觉皮层中观察到的丰富表征对于调节音色感知至关重要。
Timbre is the attribute of sound that allows humans and other animals to distinguish among different sound sources. Studies based on psychophysical judgments of musical timbre, ecological analyses of sound's physical characteristics as well as machine learning approaches have all suggested that timbre is a multifaceted attribute that invokes both spectral and temporal sound features. Here, we explored the neural underpinnings of musical timbre. We used a neuro-computational framework based on spectro-temporal receptive fields, recorded from over a thousand neurons in the mammalian primary auditory cortex as well as from simulated cortical neurons, augmented with a nonlinear classifier. The model was able to perform robust instrument classification irrespective of pitch and playing style, with an accuracy of 98.7%. Using the same front end, the model was also able to reproduce perceptual distance judgments between timbres as perceived by human listeners. The study demonstrates that joint spectro-temporal features, such as those observed in the mammalian primary auditory cortex, are critical to provide the rich-enough representation necessary to account for perceptual judgments of timbre by human listeners, as well as recognition of musical instruments. Music is a complex acoustic experience that we often take for granted. Whether sitting at a symphony hall or enjoying a melody over earphones, we have no difficulty identifying the instruments playing, following various beats, or simply distinguishing a flute from an oboe. Our brains rely on a number of sound attributes to analyze the music in our ears. These attributes can be straightforward like loudness or quite complex like the identity of the instrument. A major contributor to our ability to recognize instruments is what is formally called ‘timbre’. Of all perceptual attributes of music, timbre remains the most mysterious and least amenable to a simple mathematical abstraction. In this work, we examine the neural underpinnings of musical timbre in an attempt to both define its perceptual space and explore the processes underlying timbre-based recognition. We propose a scheme based on responses observed at the level of mammalian primary auditory cortex and show that it can accurately predict sound source recognition and perceptual timbre judgments by human listeners. The analyses presented here strongly suggest that rich representations such as those observed in auditory cortex are critical in mediating timbre percepts.
登录
查看更多内容
DOI：
10.1523/jneurosci.5249-08.2009
发表时间：
2009-03-18
期刊：
The Journal of neuroscience : the official journal of the Society for Neuroscience
影响因子：
--
作者：
David SV;Mesgarani N;Fritz JB;Shamma SA
通讯作者：
Shamma SA
影响因子：
5.3
作者：
Elhilali, M;Fritz, JB;Shamma, SA
通讯作者：
Shamma, SA
影响因子：
2.4
作者：
Agus, Trevor R.;Suied, Clara;Pressnitzer, Daniel
通讯作者：
Pressnitzer, Daniel
影响因子：
5.3
作者：
Elhilali, Mounya;Fritz, Jonathan B.;Shamma, Shihab A.
通讯作者：
Shamma, Shihab A.
DOI：
10.1109/tasl.2009.2036300
发表时间：
2010-03-01
影响因子：
--
作者：
Burred, Juan Jose;Roebel, Axel;Sikora, Thomas
通讯作者：
Sikora, Thomas