Auditory perception of sources, events and sequences

这项研究计划将探索声音来源、事件和序列的听觉感知和认知，包括日常声音和音乐。主要关注的是多个信息源的整合：在音色等多维属性的听觉通道内，或跨听觉、视觉和触觉通道。音乐音色是一种内在的多维听觉属性，在音源识别和音乐组织中扮演着多种角色。我们将研究使某些音色比其他音色更突出的声学特性，我们如何感知来自不同音色的乐器的声音流，以及突出的声音如何看起来更容易听出来。我们还将研究周围的音乐环境如何影响音色感知。对音乐听力动力学的研究越来越多地使用测量听力过程中心理生理反应的技术。然而，很少有人注意到其中许多措施的方法论基础。我们将分析在听者听到声音序列中单一或多个听觉属性的各种变化时记录的心理生理学数据，试图测量反应的大小如何取决于几个维度上的累积变化。我们将特别关注预期和意想不到的变化之间的差异，以便为解释音乐情感的心理生理学研究提供坚实的基础。行为和知觉在事件中相互作用，来源知觉和来自其他感觉系统的输入影响听觉知觉。我们将研究人们如何在控制特定手势的同时整合听觉、触觉、本体感觉和视觉信息。多感觉整合的主流理论强调辨别能力在决定什么单峰信息源将在多感觉任务中占据主导地位中的作用。我们将研究人们如何学习不同感官信息来源之间的统计相关性。我们的工作将推动信息集成理论的发展，并对虚拟现实系统等多个应用领域产生影响。

This research program will explore the auditory perception and cognition of sound sources, events and sequences, including everyday sounds and music. The primary focus is on the integration of multiple sources of information: within the auditory modality for multidimensional attributes such as timbre, or across auditory, visual and haptic modalities. Musical timbre, an inherently multidimensional auditory attribute, plays several roles in sound source identification and in musical organization. We will study the acoustic properties that make some timbres more salient than others, how we perceive streams of sounds coming from instruments with different timbres, and how salient ones seem easier to hear out. We will also study how the surrounding musical context affects timbre perception. Research on the dynamics of musical listening increasingly uses techniques measuring psychophysiological response during listening. However, little attention has been given to the methodological underpinnings of many of these measures. We will analyze psychophysiological data recorded while listeners hear various kinds of change in single or multiple auditory attributes in sound sequences in an attempt to gage how the magnitude of the reaction depends on accumulated change across several dimensions. We will focus in particular on differences between expected and unexpected changes in order to provide a solid base against which to interpret psychophysiological studies of musical emotions. Action and perception interact in event and source perception and input from other sensory systems affects auditory perception. We will study how people integrate auditory, haptic, proprioceptive and visual information while controlling a specific gesture. Mainstream theories of multisensory integration emphasize the role of discrimination abilities in determining what unimodal source of information will dominate in a multisensory task. We will study how people learn statistical dependencies between different sources of sensory information. Our work will advance theories of information integration and have an impact on several application domains such as virtual reality systems.