Disentangling Perceptual and Cognitive Explanations for Auditory-Induced Bouncing

理清听觉诱发弹跳的感知和认知解释

• 批准号: 428932406
• 负责人: Professor Dr. Christian Frings
• 金额: --
• 依托单位: Lehrstuhl für Allgemeine Psychologie und Instruktionspsychologie
• 依托单位国家: 德国
• 项目类别: Research Grants
• 资助国家: 德国
• 项目状态: 未结题
• 来源: https://gepris.dfg.de/gepris/projekt/428932406?language=en
• 关键词: Disentangling; Perceptual; Cognitive; Explanations; Auditory

An elementary component of human perception is the identification of objects over time. Without establishing this so-called object correspondence, our visual experience would likely be incoherent, with objects popping into and out of existence haphazardly. Beyond purely visual information, cross-modal information has also been shown to alter the perceived correspondence. Perceptual as well as cognitive explanations for the cross-modal impact on visual object correspondence have been proposed, but no decisive evidence in favor of one or the other has been obtained to date. In the proposed experiments, we therefore investigate variations of the bouncing/streaming paradigm (an ambiguous display which could be interpreted as two discs streaming past each other as well as two discs bouncing off each other) in order to disentangle perceptual and cognitive explanations for the resulting visual impression. In this display, the simultaneous presentation of a tone or vibrotactile stimulation at the central moment of overlap alters to dominant impression from streaming to bouncing.In order to disentangle perceptual and cognitive processes for perceived bouncing systematically, we will pursue four complimentary research strategies. In the first working package, we plan to investigate whether bouncing impressions could be elicited under circumstances that render cognitive processing unlikely. In the second work package, we aim to evaluate whether there is a perceptual explanation for the most prominent argument in favor of the cognitive processing – the effect of semantic congruency between the coinciding sounds and naturalistic bouncing events. In the third work package, we intend to probe whether perceptual and cognitive processes contribute to the visual impression of the discs bouncing off each other beyond the manipulations within the bouncing/streaming paradigm. To do so, we aim to study the relation between perceived bouncing and the temporal window of audio-visual integration as well as the effects of the stimulation of cognitive areas on the reported bouncing impressions. The major reason why it is so difficult to distinguish between perceptual and cognitive explanations arises from the rather explicit dependent variable which is vulnerable to both processes. In the forth work package, we therefore aim to investigate whether a less direct audio-visual illusion (a quantitative change in the perceived overlap between the discs) is capable of explaining the shift in the visual impression from streaming to bouncing. From combining these approaches, we expect to gain systematic insights into the contribution of perceptual and cognitive processes when establishing object correspondence.

人类感知的一个基本组成部分是随着时间的推移对物体的识别。如果没有建立这种所谓的对象对应关系，我们的视觉体验很可能是不连贯的，对象会随意地出现和消失。除了纯粹的视觉信息之外，跨模态信息也被证明可以改变感知到的对应关系。已经提出了对视觉对象对应的跨模态影响的知觉和认知解释，但迄今为止尚未获得支持其中一个或另一个的决定性证据。因此，在拟议的实验中，我们研究了弹跳/流范式的变化（一种模棱两可的显示，可以解释为两个圆盘相互流过，也可以解释为两个圆盘相互弹跳），以解开由此产生的视觉印象的知觉和认知解释。在这种展示中，在重叠的中心时刻同时呈现音调或振动触觉刺激将主导印象从流动变为弹跳。为了系统地解开知觉弹跳的知觉和认知过程，我们将采取四种互补的研究策略。在第一个工作包中，我们计划调查在不太可能进行认知处理的情况下是否会产生弹跳印象。在第二个工作包中，我们的目标是评估是否有一个感性的解释，以支持认知加工的最突出的论点-一致的声音和自然弹跳事件之间的语义一致性的影响。在第三个工作包中，我们打算探讨知觉和认知过程是否有助于在弹跳/流范式中操纵光盘相互弹跳的视觉印象。为此，我们旨在研究知觉弹跳与视听整合时间窗口的关系，以及认知区域的刺激对报道的弹跳印象的影响。区分知觉解释和认知解释如此困难的主要原因是，相当明确的因变量容易受到这两个过程的影响。因此，在第四个工作包中，我们的目标是研究一种不太直接的视听错觉（在光盘之间感知重叠的定量变化）是否能够解释视觉印象从流到弹跳的转变。通过结合这些方法，我们期望在建立对象对应时获得对感知和认知过程的贡献的系统见解。