Auditory perception of sources, events and sequences

这个研究项目将探索声音来源、事件和序列的听觉感知和认知，包括日常声音和音乐。主要的焦点是对多种信息来源的整合：在听觉模态内的多维属性，如音色，或跨听觉、视觉和触觉模态。音色是一种内在多维度的听觉属性，在声源识别和音乐组织中起着重要作用。我们将研究使某些音色比其他音色更突出的声学特性，我们如何感知来自不同音色的乐器的声音流，以及如何更容易听到突出的音色。我们还将研究周围的音乐环境如何影响音色感知。音乐聆听动力学的研究越来越多地使用测量聆听过程中心理生理反应的技术。然而，很少注意到这些措施的方法基础。我们将分析当听众听到声音序列中单个或多个听觉属性的各种变化时所记录的心理生理数据，以试图衡量反应的大小如何依赖于几个维度上的累积变化。我们将特别关注预期和意外变化之间的差异，以便为解释音乐情感的心理生理学研究提供坚实的基础。动作和知觉在事件和源知觉中相互作用，来自其他感觉系统的输入影响听觉知觉。我们将研究人们在控制特定手势时如何整合听觉、触觉、本体感受和视觉信息。多感觉整合的主流理论强调辨别能力在决定单模信息来源在多感觉任务中占主导地位方面的作用。我们将研究人们如何学习不同感官信息来源之间的统计依赖关系。我们的工作将推动信息集成理论的发展，并对虚拟现实系统等多个应用领域产生影响。

This research program will explore the auditory perception and cognition of sound sources, events and sequences, including everyday sounds and music. The primary focus is on the integration of multiple sources of information: within the auditory modality for multidimensional attributes such as timbre, or across auditory, visual and haptic modalities. Musical timbre, an inherently multidimensional auditory attribute, plays several roles in sound source identification and in musical organization. We will study the acoustic properties that make some timbres more salient than others, how we perceive streams of sounds coming from instruments with different timbres, and how salient ones seem easier to hear out. We will also study how the surrounding musical context affects timbre perception. Research on the dynamics of musical listening increasingly uses techniques measuring psychophysiological response during listening. However, little attention has been given to the methodological underpinnings of many of these measures. We will analyze psychophysiological data recorded while listeners hear various kinds of change in single or multiple auditory attributes in sound sequences in an attempt to gage how the magnitude of the reaction depends on accumulated change across several dimensions. We will focus in particular on differences between expected and unexpected changes in order to provide a solid base against which to interpret psychophysiological studies of musical emotions. Action and perception interact in event and source perception and input from other sensory systems affects auditory perception. We will study how people integrate auditory, haptic, proprioceptive and visual information while controlling a specific gesture. Mainstream theories of multisensory integration emphasize the role of discrimination abilities in determining what unimodal source of information will dominate in a multisensory task. We will study how people learn statistical dependencies between different sources of sensory information. Our work will advance theories of information integration and have an impact on several application domains such as virtual reality systems.