Perceived Congruency in Audiovisual Stimuli Consisting of Gabor Patches and AM and FM Tones
Perceived Congruency in Audiovisual Stimuli Consisting of Gabor Patches and AM and FM Tones
复制标题
由 Gabor 补丁以及 AM 和 FM 音调组成的视听刺激的感知一致性
DOI：
10.1163/22134808-bja10041
复制
发表时间：
2021
影响因子：
1.6
通讯作者：
G.B.
中科院分区：
文献类型：
--
作者：
Postnova;N.;Remijn;G.B.
专注于人类如何感知视听感官信息中的时间，空间或通感一致性的实验通常采用由伽柏贴片和振幅（AM）或频率（FM）调制的声音组成的刺激。在Gabor贴片的静态和动态特征与声音的（载波）频率或调制频率之间引入相似性通常被认为足以有效地诱导一致性。然而，各种刺激参数的感知一致性的比较经验数据是不容易获得的，特别是相对于声音调制，它仍然不清楚哪种类型（AM或FM）诱导感知一致性最好的串联与各种补丁参数。在两个实验中，我们研究了各种空间频率的伽柏补丁闪烁（2，3和4闪烁/秒）或漂移（0.5，1.0和1.5度/秒）光栅与AM或FM音调的组合2，3和4赫兹调制和500，1000和2000赫兹载波频率。感知一致性评级通过要求参与者从1（不一致）到7（一致）对刺激（不一致）进行评级来获得。数据表明，不同的空间频率的伽柏补丁和调制的音调的载波频率感知一致性的影响相对较小。与先前的研究结果相似，Gabor贴片的时间频率和调制音调之间的相似性有效地促进了感知一致性。此外，直接比较令人信服地表明，AM音调与闪烁的Gabor补丁相结合，收到显着更高的视听一致性评级相比，FM音调。
Experiments that focus on how humans perceive temporal, spatial or synaesthetic congruency in audiovisual sensory information have often employed stimuli consisting of a Gabor patch and an amplitude (AM) or frequency (FM)-modulated sound. Introducing similarity between the static and dynamic features of the Gabor patch and the (carrier) frequency or modulation frequency of the sound is often assumed to be effective enough to induce congruency. However, comparative empirical data on perceived congruency of various stimulus parameters are not readily available, and in particular with respect to sound modulation, it is still not clear which type (AM or FM) induces perceived congruency best in tandem with various patch parameters. In two experiments, we examined Gabor patches of various spatial frequencies with flickering (2, 3 and 4 flickers/s) or drifting (0.5, 1.0 and 1.5 degrees/s) gratings in combinations with AM or FM tones of 2-, 3- and 4-Hz modulation and 500-, 1000- and 2000-Hz carrier frequencies. Perceived congruency ratings were obtained by asking participants to rate stimulus (in)congruency from 1 (incongruent) to 7 (congruent). The data showed that varying the spatial frequency of the Gabor patch and the carrier frequency of the modulated tone had comparatively little impact on perceived congruency. Similar to previous findings, similarity between the temporal frequency of the Gabor patch and the modulated tone effectively promoted perceived congruency. Furthermore, direct comparisons convincingly showed that AM tones in combination with flickering Gabor patches received significantly higher audiovisual congruency ratings compared to FM tones.