Disentangling Perceptual and Cognitive Explanations for Auditory-Induced Bouncing

人类感知的一个基本组成部分是随着时间的推移对对象的识别。如果不建立这种所谓的物体对应关系，我们的视觉体验很可能是不连贯的，物体随意地进入和消失存在。除了纯粹的视觉信息，跨模式信息也被证明改变了感知的对应关系。关于跨通道对视觉对象对应的影响，人们已经提出了知觉和认知的解释，但到目前为止还没有得到支持其中之一的决定性证据。因此，在拟议的实验中，我们调查了弹跳/流范例的变化(一种模棱两可的显示，可以解释为两个圆盘相互流动，以及两个圆盘相互反弹)，以理清对所产生的视觉印象的知觉和认知解释。在这个展示中，同时呈现在重叠中心时刻的音调或振动触觉刺激从流动到跳跃转变为主导印象。为了系统地解开感知跳跃的知觉和认知过程，我们将采取四个互补的研究策略。在第一个工作包中，我们计划调查在不可能进行认知处理的情况下，是否会产生跳跃的印象。在第二个工作包中，我们旨在评估是否对支持认知加工的最突出的论点--重合的声音和自然反弹事件之间的语义一致性的影响--有感性的解释。在第三个工作包中，我们打算探索知觉和认知过程是否有助于超越反弹/流范式中的操纵而相互反弹的光盘的视觉印象。为此，我们旨在研究知觉弹跳与视听整合的时间窗之间的关系，以及刺激认知区域对已报道的弹跳印象的影响。之所以很难区分知觉解释和认知解释，主要原因在于这两个过程都容易受到相当明确的因变量的影响。因此，在第四个工作包中，我们的目标是调查不那么直接的视听错觉(光盘之间感知重叠的数量变化)是否能够解释视觉印象从流媒体到跳跃的转变。通过结合这些方法，我们期望获得系统的洞察力，以了解感知和认知过程在建立对象对应时的贡献。

An elementary component of human perception is the identification of objects over time. Without establishing this so-called object correspondence, our visual experience would likely be incoherent, with objects popping into and out of existence haphazardly. Beyond purely visual information, cross-modal information has also been shown to alter the perceived correspondence. Perceptual as well as cognitive explanations for the cross-modal impact on visual object correspondence have been proposed, but no decisive evidence in favor of one or the other has been obtained to date. In the proposed experiments, we therefore investigate variations of the bouncing/streaming paradigm (an ambiguous display which could be interpreted as two discs streaming past each other as well as two discs bouncing off each other) in order to disentangle perceptual and cognitive explanations for the resulting visual impression. In this display, the simultaneous presentation of a tone or vibrotactile stimulation at the central moment of overlap alters to dominant impression from streaming to bouncing.In order to disentangle perceptual and cognitive processes for perceived bouncing systematically, we will pursue four complimentary research strategies. In the first working package, we plan to investigate whether bouncing impressions could be elicited under circumstances that render cognitive processing unlikely. In the second work package, we aim to evaluate whether there is a perceptual explanation for the most prominent argument in favor of the cognitive processing – the effect of semantic congruency between the coinciding sounds and naturalistic bouncing events. In the third work package, we intend to probe whether perceptual and cognitive processes contribute to the visual impression of the discs bouncing off each other beyond the manipulations within the bouncing/streaming paradigm. To do so, we aim to study the relation between perceived bouncing and the temporal window of audio-visual integration as well as the effects of the stimulation of cognitive areas on the reported bouncing impressions. The major reason why it is so difficult to distinguish between perceptual and cognitive explanations arises from the rather explicit dependent variable which is vulnerable to both processes. In the forth work package, we therefore aim to investigate whether a less direct audio-visual illusion (a quantitative change in the perceived overlap between the discs) is capable of explaining the shift in the visual impression from streaming to bouncing. From combining these approaches, we expect to gain systematic insights into the contribution of perceptual and cognitive processes when establishing object correspondence.