Neural underpinnings of bottom-up and top-down auditory attention in real-life environments

我们有能力一次专注于一项听力任务，而把周围的其他声音推到背景中。这种自发的、自上而下的注意力指向最相关的声音流，可能会被突出的背景声音事件（如汽车喇叭声）打断——这是一种自下而上的机制，使我们能够及时地对周围的事件做出反应。根据周围的听觉场景和听者的认知状态，一些重要事件可能无法被察觉。这在我们的日常生活中经常发生，因为我们倾向于忽略与我们无关的声音。然而，有时候，没有察觉到一个显著的声音可能会导致严重的后果。理解这样一个常见的神经过程的基础，如背景突出事件的检测，本身是非常重要的。此外，只有理解了这些过程，才有可能在侦听器没有检测到相关的显著事件时提出替代警告的解决方案。目前对自然情况下的显著事件处理知之甚少。大多数关于听觉注意的发现来自高度控制的实验室实验。该项目的目标有两个方面：(1)研究现实生活中对显著事件的神经反应及其对主要听力任务的影响；(2)探索在脑机接口（bci）中应用近实时分类检测到的和未检测到的显著事件的可能性。我将在三个独立的脑电图（EEG）研究中实现这些目标，在这些研究中，人类参与者将听到背景中出现的显著声音。由于我的目标是研究现实生活条件下的神经过程，所有三项研究都将使用一个不显眼的移动脑电图装置进行。我将在受控的实验室条件下开始我的研究，使用自然刺激，获得与先前文献相当的结果。我的下一步将是研究对实验室之外自然发生的、不受控制的显著事件的神经反应，这是由最近发展的显著性模型实现的，该模型可以自动估计听觉场景中事件的显著性。一旦知道了显著事件检测的神经关联，第三项研究将调查听觉脑机接口的可行性，该接口可以为未检测到的显著事件提供反馈。我将采用两种互补的分析方法——一种新颖的P3分析方法来研究背景突出事件的神经反应，一种新颖的听觉包络注意跟踪方法来观察突出事件对自上而下对前景音频流的注意的影响。将这两种方法应用于脑电图数据可能会导致显著事件检测的鲁棒神经相关性，从而为日常场景设计可靠的闭环听觉BCI提供手段。

We have an ability to focus on one listening task at time and push other surrounding sounds into background. This voluntary, top-down attention directed towards the most relevant sound stream can be interrupted by salient background sound events such as car horn - a bottom-up mechanism that allows us to timely react to events from our surroundings. Depending on the surrounding auditory scene and cognitive state of a listener some salient events can go undetected. This happens often in our daily routine, as we tend to ignore sounds irrelevant to us. Sometimes, however, not detecting a salient sound may be followed by severe consequences. Understanding the basis of such a common neural process as detection of a background salient event is on its own of great importance. Furthermore, only by understanding these processes it is possible to come up with solutions for alternative warnings if a relevant salient event is not detected by a listener.Not much is currently known about salient event processing in natural situations. Most findings on auditory attention come from highly-controlled laboratory experiments. The goal of this project is two-fold: (1) to investigate neural responses to salient events in real life and their influence on main listening task and (2) to explore the possibility of near-real-time classification of detected vs. undetected salient events for application in brain-computer interfaces (BCIs). I will achieve these goals in three separate electroencephalography (EEG) studies where human participants will be listening to speech with salient sounds occurring in background. As my aim is to study neural processes in real life conditions, all three studies will be conducted using an unobtrusive mobile EEG setup. I will start my investigation in controlled laboratory conditions using naturalistic stimuli, obtaining results comparable to those in previous literature. My next step will be to investigate neural responses to naturally occurring, uncontrolled salient events outside of laboratory, which is made possible by recent development of saliency models that can automatically estimate salience of events in an auditory scene. Once the neural correlates of salient event detection are known, the third study will investigate feasibility of an auditory BCI that could provide feedback on undetected salient events.I will apply two complementary analysis approaches- a novelty P3 analysis to investigate neural responses to background salient events and novel auditory envelope attention tracking approach to observe the influence of salient events on the top-down attention to foreground audio stream. Applying both methods to EEG data is likely to lead to robust neural correlates of salient event detection to the point of providing means of designing a reliable closed-loop auditory BCI for every-day scenarios.