Questioning the automaticity of audiovisual correspondences
Questioning the automaticity of audiovisual correspondences
复制标题
DOI：
10.1016/j.cognition.2018.02.015
复制
发表时间：
2018-06-01
期刊：
影响因子：
3.4
通讯作者：
Kubovy, Michael
中科院分区：
文献类型：
--
作者：
Getz, Laura M.;Kubovy, Michael
视听对应（AVC）是指观察者在两种模态之间看似任意但一致的感觉特征匹配;例如，听觉音高和视觉大小之间。AVCs的研究经常使用一种快速分类程序，要求参与者在伴随一致或不一致声音（反之亦然）时对图像进行快速分类。通常情况下，当存在一致的刺激时，分类速度更快，研究人员推断AVC是自动的和自下而上的。这样的推断是不完整的，因为该过程没有表明AVC不受自上而下的影响。为了解决这个问题，我们设计了一个程序，使我们能够评估的程度“自下而上”和“自上而下”的AVC的处理。我们在研究音高和五个视觉特征之间的AVCs时做到了这一点：大小，高度，空间频率，亮度和角度。我们发现，我们研究的所有AVCs都涉及自下而上和自上而下的处理，从而破坏了普遍的泛化，AVCs是自动的。
An audiovisual correspondence (AVC) refers to an observer's seemingly arbitrary yet consistent matching of sensory features across the two modalities; for example, between an auditory pitch and visual size. Research on AVCs has frequently used a speeded classification procedure in which participants are asked to rapidly classify an image when it is either accompanied by a congruent or an incongruent sound (or vice versa). When, as is typically the case, classification is faster in the presence of a congruent stimulus, researchers have inferred that the AVC is automatic and bottom-up. Such an inference is incomplete because the procedure does not show that the AVC is not subject to top-down influences. To remedy this problem, we devised a procedure that allows us to assess the degree of "bottom-up-ness" and "top-down-ness" in the processing of an AVC. We did this in studies of AVCs between pitch and five visual features: size, height, spatial frequency, brightness, and angularity. We find that all the AVCs we studied involve both bottom-up and top-down processing, thus undermining the prevalent generalization that AVCs are automatic.