权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

Psychological experiment for clarifying the neural mechanism of complementary interaction between visual and haptic information in their binding process

阐明视觉与触觉信息结合过程中互补相互作用的神经机制的心理实验

基本信息

批准号：
15500209
负责人：
KASHIMORI Yoshiki
金额：
$ 2.43万
依托单位：
The University of Electro-Communications
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (C)
财政年份：
2003
资助国家：
日本
起止时间：
2003 至 2004
项目状态：
已结题

项目摘要

When a person looks at an object while exploring it with their hand, vision frequently dominates the integrated visual-haptic perception, but in some circumstances the process is clearly affected by haptics. The aim of this study is to investigate the neural mechanism of the complementary interaction between visual and haptic information in their binding process, based on psychological experiment.1.Psychological experimentsWe conducted psychological experiments in which virtual spaces were constructed with a haptic device and 3D-visual system. The task of the psychological experiment is as follow : The subject feels the weight of a cube presented on a computer screen by manipulating the haptic device, and then feels the weight of an another cube in the same way, which has different visual characters (i.e.size, color) from the cube firstly presented. The subject has to make a decision of which cube has larger weight. We examined the effect of the visual characters on the weight-discrimination task. We showed that the visual characters of cube cause significant changes in the discrimination task, supporting a hypothesis that the visual information is rapidly processed and then act as a prediction signal in binding process of visual and haptic information.2.Neural network model for binding visual and haptic informationTo investigate the neural mechanism of sensory information processing, we made neural models for visual, auditory, and electrosensory systems. Based on the modeling study, we made a computational model for binding process of visual and haptic information. The network model of visual system was made based on backpropagation network, and the output of the network affects the network of haptic system as a prediction signal. The computational model reproduced qualitatively our psychological data described in section 1.

当一个人用手探索一个物体时，视觉通常会主导整合的视觉-触觉感知，但在某些情况下，这个过程显然会受到触觉的影响。本研究的目的是在心理学实验的基础上探讨视觉和触觉信息在结合过程中互补作用的神经机制。1.心理学实验我们进行了心理学实验，在实验中使用触觉设备和三维视觉系统构建虚拟空间。心理学实验的任务是：被试通过操纵触觉设备感受计算机屏幕上呈现的立方体的重量，然后以同样的方式感受另一个立方体的重量，该立方体具有与最初呈现的立方体不同的视觉特征（即大小、颜色）。受试者必须决定哪个立方体具有更大的权重。我们研究了视觉特征对重量辨别任务的影响。结果表明，立方体的视觉特征引起了辨别任务的显著变化，支持了视觉信息被快速加工，并在视觉和触觉信息的结合过程中作为预测信号的假设。2.视觉和触觉信息结合的神经网络模型为了研究感觉信息加工的神经机制，我们分别建立了视觉、听觉、听觉和触觉信息的神经网络模型，并在此基础上建立了视觉和触觉信息结合的神经网络模型。和电感觉系统。在建模研究的基础上，建立了视觉和触觉信息结合过程的计算模型。基于反向传播网络建立了视觉系统的网络模型，网络的输出作为预测信号影响力觉系统的网络。计算模型从质量上再现了我们在第1节中描述的心理数据。