Multimodal similarity and categorization of novel, three-dimensional objects
Multimodal similarity and categorization of novel, three-dimensional objects
复制标题
DOI：
10.1016/j.neuropsychologia.2006.02.009
复制
发表时间：
2007-01-01
期刊：
影响因子：
2.6
通讯作者：
Buelthoff, Heinrich H.
中科院分区：
文献类型：
--
作者：
Cooke, Theresa;Jaekel, Frank;Buelthoff, Heinrich H.
相似性被认为是心理客体表征的基本原则，并能够支持认知水平的任务，如分类。然而，大部分的研究都认为使用一个单一的感知模态执行任务的相似性和分类之间的连接。考虑相似性和多模态背景下的分类打开了一些重要的问题：当他们被认为是使用不同的方式或使用一个以上的方式在同一时间的对象之间的相似性是相同的？相似性是否仍然能够解释多模态体验时的分类性能？在这项研究中，我们通过让受试者单独使用视觉、单独触摸或触摸和视觉一起探索形状和纹理参数化变化的新颖3D物体来解决这些问题。然后，受试者进行成对相似性评级任务和自由排序分类任务。多维标度（MDS）相似性数据的分析表明，一个单一的基本感知地图，其尺寸对应的形状和纹理可以解释视觉，触觉和双峰相似性评级。然而，相对尺寸的权重变化根据模态：形状占主导地位的纹理时，看到的对象，而形状和纹理大致同样重要的触觉和双峰条件。一些证据被发现的相似性和分类之间的多模态连接：类别成员的概率增加相似性，而被放置在两个刺激之间的类别边界的概率减少相似性。此外，维度权重根据模态以相同的方式为两个任务。该研究还证明了3D打印技术和MDS技术在视觉触觉对象处理研究中的有用性。(c)2006爱思唯尔有限公司保留所有权利。
Similarity has been proposed as a fundamental principle underlying mental object representations and capable of supporting cognitive-level tasks such as categorization. However, much of the research has considered connections between similarity and categorization for tasks performed using a single perceptual modality. Considering similarity and categorization within a multimodal context opens up a number of important questions: Are the similarities between objects the same when they are perceived using different modalities or using more than one modality at a time? Is similarity still able to explain categorization performance when objects are experienced multimodally? In this study, we addressed these questions by having subjects explore novel, 3D objects which varied parametrically in shape and texture using vision alone, touch alone, or touch and vision together. Subjects then performed a pair-wise similarity rating task and a free sorting categorization task. Multidimensional scaling (MDS) analysis of similarity data revealed that a single underlying perceptual map whose dimensions corresponded to shape and texture could explain visual, haptic, and bimodal similarity ratings. However, the relative dimension weights varied according to modality: shape dominated texture when objects were seen, whereas shape and texture were roughly equally important in the haptic and bimodal conditions. Some evidence was found for a multimodal connection between similarity and categorization: the probability of category membership increased with similarity while the probability of a category boundary being placed between two stimuli decreased with similarity. In addition, dimension weights varied according to modality in the same way for both tasks. The study also demonstrates the usefulness of 3D printing technology and MDS techniques in the study of visuohaptic object processing. (c) 2006 Elsevier Ltd. All rights reserved.