Crossmodal perception from visual and vestibular information

研究了视觉和前庭信息两种跨模知觉。第一种是自我运动知觉，即来自视觉和前庭的身体运动方向不一致。以往的研究表明，当视觉信息和前庭信息方向差相反（180度）时，旋转或线状自我运动感知的多模态整合是一个非选或非选的过程，且以前庭感觉为主感知自我运动方向需要一定的加速度。然而，自运动正交方向的组合尚未得到研究。我们向观察者展示了真实的身体运动和正交定向光流模式，并研究了我们大脑中的感知系统是一个非此即彼的过程，还是它交叉地整合了不一致的自我运动方向。从这个实验的结果和其他的视觉和前庭信息的不同方向差异的实验中，我们发现这种整合的方向差异的极限是90度。第二种是自我运动的随颜色变化的后效。以前的研究报告了方向-偶然的颜色后效，McCollough效应，以及另一种颜色后效，这是偶然的扩张和收缩螺旋图案。然而，没有跨模态特征的偶发后效的报道。我们研究了颜色随机的自我运动后效应是否会发生，使观察者适应振荡的真实身体运动和同步的颜色视觉刺激的组合，例如向前/红色和向后/绿色。观察者报告了视觉-前庭交叉运动-后效，即测试螺旋图案的扩张或收缩，尽管没有发现一致的颜色随机自运动后效。

Two kinds of crossmodal perception from vision and vestibular information were investigated. The first is self-motion perception when the directions of body movement from vision and vestibular are inconsistent each other. Previous studies revealed that the multimodal integration in the perception of rotational or linier self motion is an either-or process when the direction difference between visual and vestibular information is opposite (180 degrees), and a certain acceleration is required in perceiving the self-motion direction from vestibular sense dominantly. The combination of orthogonal directions of self-motion, however, has not been investigated. We presented real somatic motion and orthogonally directed optic flow patterns to observers, and examined whether the perceptual system in our brain is an either-or process OR it crossmodally integrates the inconsistent self-motion directions. From the results of this experiment and additional experiments with various direction differences in vision and vestibular information, we found that the limit of direction difference for this integration is 90 degrees.The second is a color-contingent aftereffect of self-motion. Former studies reported an orientation-contingent color aftereffect, the McCollough effect, and another color aftereffect that is contingent to expanding and contracting spiral pattern. However, no crossmodal feature-contingent aftereffect has been reported. We examined whether a color-contingent self-motion aftereffect would occur or not, adapting observers to a combination of oscillatory real somatic motion and synchronized color visual stimulation, for example, forward/red and backward/green. Observers reported vision-vestibular crossmodal motion-aftereffect, i.e., expansion or contraction of a test spiral pattern, although no consistent color-contingent self-motion aftereffect was found.