Understanding speech in the presence of other speech: Perceptual mechanisms for auditory scene analysis in human listeners

我们想当然地认为，我们可以在日常生活中与其他人匡威，并以很少的，如果有的话，明显的努力被理解。然而，孤立地听到特定说话者的讲话是相当不寻常的;讲话通常是在存在干扰声音的情况下听到的，例如其他说话者的声音。因此，负责我们听觉的人类听觉系统面临着识别到达我们耳朵的声音的哪些部分来自同一环境源的挑战。这涉及分离来自一个源的那些声音元素（例如，一个说话者的声音）从其他来源产生的声音中区分出来，并以大脑中更高层次的过程（例如我们对语言的理解）可以解释的方式对它们进行分组。如果不解决这个“听觉场景分析”问题，我们对语言（和其他声音）的感知就不会与产生它们的事件相对应。在进化过程中，人类已经暴露在各种复杂的听觉环境中，因此我们通常非常成功地理解一个人在其他说话者在场的情况下的讲话。这与开发听力机器的尝试形成了鲜明对比，当面对复杂的听力环境时，例如开放式办公室或拥挤的聚会时，听力机器往往会灾难性地失败。有听力障碍的人类听众也发现这些环境非常困难，即使使用助听器或耳蜗植入技术的最新发展。到目前为止，大多数关于听觉场景分析的研究都集中在相对简单的声音上，并且已经确定了一些声音元素的感知分组和分离的一般原则。然而，至少就目前的理解而言，这些原则似乎不足以完全解释语音的感知分组。这是因为语音信号由多样化且快速变化的声音流组成。我们的母语也是一种非常熟悉的刺激，所以到了成年，我们的听觉系统已经有很多年的时间来学习它的语音特性。理解语音所需的大部分信息是由语音信号频谱中几个宽峰（称为共振峰）随时间的频率变化携带的。这个项目的目的是研究人类听众如何在听到语音混合后，能够将适当的共振峰组合在一起，并拒绝其他共振峰，这样我们想要听的说话者的语音就可以被理解。我们将使用人类听众的感知实验来实现这一点，在这些实验中，我们测量目标语音的可懂度（例如，测量为正确报告的单词数量）在各种条件下的变化。该项目将探讨通用分组因素的作用（即，适用于各种声音的那些）和语音特定分组因素，包括与语音清晰度相关联的更高级约束（即，我们说话时舌头、嘴唇和下巴的移动方式）以及我们语言的规则。我们的方法是生成人工语音样的刺激与精确控制的属性，混合目标语音与精心设计的“竞争对手”，提供替代分组的可能性，并测量如何操纵这些竞争对手的属性影响人类听众的能力，以识别目标语音的混合物。该项目的结果不仅将提高我们对人类听众如何从干扰声音中分离语音的理解，而且还将有助于完善听力的计算机模型。这种改进反过来将提供改善助听器和自动语音识别器等设备在嘈杂环境中工作时的性能的方法。

We take it for granted that we can converse with other people in daily life and be understood with little, if any, noticeable effort. However, it is fairly unusual to hear the speech of a particular talker in isolation; speech is typically heard in the presence of interfering sounds, such as the voices of other talkers. The human auditory system, which is responsible for our sense of hearing, therefore faces the challenge of identifying which parts of the sounds reaching our ears have originated from the same environmental source. This involves separating those sound elements coming from one source (e.g., the voice of one talker) from those arising from other sources, and grouping them in ways that can be interpreted by higher-level processes in the brain (such as those involved in our understanding of speech). Without a solution to this "auditory scene analysis" problem, our perceptions of speech (and other sounds) would not correspond to the events that produced them. Humans have been exposed to a variety of complex listening environments over the course of evolution, and so we are generally very successful at understanding the speech of one person in the presence of other talkers. This contrasts with attempts to develop listening machines, which often fail catastrophically when confronted with complex listening environments, such as an open-plan office or a crowded party. Human listeners with hearing impairment also find these environments very difficult, even when using the latest developments in hearing-aid or cochlear-implant technology.So far, most research on auditory scene analysis has focussed on relatively simple sounds and has identified a number of general principles for the perceptual grouping and separation of sound elements. However, at least as currently understood, these principles seem inadequate to explain fully the perceptual grouping of speech. This is because the speech signal consists of a diverse and rapidly changing stream of sounds. The speech of our native language is also a highly familiar stimulus, and so by adulthood our auditory system has had many years to learn about its speech-specific properties. These properties may also assist in the successful perceptual grouping of speech.Much of the information necessary to understand speech is carried by the changes in frequency over time of a few broad peaks in the frequency spectrum of the speech signal, known as formants. The aim of this project is to investigate how human listeners presented with speech sound mixtures are able to group together the appropriate formants, and to reject others, such that the speech of the talker we want to listen to can be understood. We will do so using perceptual experiments with human listeners, in which we measure how the intelligibility of target speech (measured, for example, as the number of words reported correctly) changes under a variety of conditions. The project will explore the roles of general-purpose grouping factors (i.e., those that apply to a wide variety of sounds) and of speech-specific grouping factors, including higher-level constraints associated with the articulation of speech (i.e., the way our tongue, lips, and jaw move when we speak) and with the rules of our language. Our approach is to generate artificial speech-like stimuli with precisely controlled properties, to mix target speech with carefully designed "competitors" that offer alternative grouping possibilities, and to measure how manipulating the properties of these competitors affects the ability of human listeners to recognise the target speech in the mixture. The results of this project will not only improve our understanding of how human listeners separate speech from interfering sounds, but will also help to refine computer models of listening. Such refinements will in turn provide ways of improving the performance of devices such as hearing aids and automatic speech recognisers when they operate in noisy environments.