Multisensory recognition of actively explored objects
Multisensory recognition of actively explored objects
复制标题
DOI：
10.1037/cjep2007025
复制
发表时间：
2007-09-01
影响因子：
1.3
通讯作者：
Newell, Fiona N.
中科院分区：
文献类型：
--
作者：
Ernst, Marc O.;Lange, Christoph;Newell, Fiona N.
可以通过视觉或触摸来实现形状识别，从而提出了如何跨模式共享此信息的问题。在这里，我们简要审查了有关跨模式对象识别的先前发现，并提供了有关主动探索对象的多感觉识别的新经验数据。以前证明，与视觉相似，对空间中固定的物体的触觉识别是特定于方向的，并且当对象在感觉方式上匹配这些对象的这些视图时，跨模式对象识别性能相对有效（Newell，Ernst，Ernst，Tjan，Tjan，tjan，tjan，tjan，tjan， ＆Bulthoff，2001）。对于积极探索的对象（即，在空间不受约束的对象）中，我们现在发现了相对于模式内识别性能的交叉模式成本。起初，这似乎与Newell等人的发现相反。 （2001）。但是，对学习和识别过程中视觉和触觉探索行为的详细视频分析表明，对象的一种观点主要相对于所有其他物体进行了探索。因此，主动的视觉和触觉探索无法在对象视图中平衡。积极探索的对象跨模态识别性能的成本可以归因于以下事实：在跨模式条件下，学习和识别测试之间的主要学习对象视图在学习和识别测试之间没有适当匹配。因此，似乎参与者自然会在视觉和触觉对象学习期间采用探索策略，涉及限制对象的方向。尽管此策略确保了良好的内模性能，但对于在跨模式中实现最佳识别表现并不是最佳的。
Shape recognition can be achieved through vision or touch, raising the issue of how this information is shared across modalities. Here we provide a short review of previous findings on cross-modal object recognition and we provide new empirical data on multisensory recognition of actively explored objects. It was previously shown that, similar to vision, haptic recognition of objects fixed in space is orientation specific and that cross-modal object recognition performance was relatively efficient when these views of the objects were matched across the sensory modalities (Newell, Ernst, Tjan, & Bulthoff, 2001). For actively explored (i.e., spatially unconstrained) objects, we now found a cost in cross-modal relative to within-modal recognition performance. At first, this may seem to be in contrast to findings by Newell et al. (2001). However, a detailed video analysis of the visual and haptic exploration behaviour during learning and recognition revealed that one view of the objects was predominantly explored relative to all others. Thus, active visual and haptic exploration is not balanced across object views. The cost in recognition performance across modalities for actively explored objects Could be attributed to the fact that the predominantly learned object view was not appropriately matched between learning and recognition test in the cross-modal conditions. Thus, it seems that participants naturally adopt an exploration strategy during visual and haptic object learning that involves constraining the orientation of the objects. Although this strategy ensures good within-modal performance, it is not optimal for achieving the best recognition performance across modalities.