权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

The computation of multimodal representation through dynamic interaction

通过动态交互进行多模态表示的计算

基本信息

批准号：
16200020
负责人：
INUI Toshio
金额：
$ 31.95万
依托单位：
Kyoto University
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (A)
财政年份：
2004
资助国家：
日本
起止时间：
2004 至 2007
项目状态：
已结题

来源：
https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-16200020/
关键词：
multimodal information integration reach-to-grasp vision motor command 触覚触角

项目摘要

Interactions between hand movements and visual feedback are investigated. Results suggest that the central nervous system controls movements based on the prediction or the estimation of consequent motor accuracy taking into account both sensory and motor error. It is also suggested that the pre-supplementary motor area (pre-SMA), the right posterior parietal cortex (PPC), and the right temporo-parietal junction (TPJ) are involved in internal movement prediction, online evaluation of visuomotor error, and movement estimation to compensate for visual feedback delay, respectively. Experiments on cross-modal integration between vision and haptics with dynamic objects revealed that representation of dynamics as a weighted linear summation of sensory cues mediates cross-modal integration, and that temporal cues used in integration is independent of those used in simultaneity judgments. Experiments on cross-modal object recognition showed that recognition of 3-D objects within single modality … More utilized both viewpoint-dependent and viewpoint-invariant information, whereas object recognition by a modality not used in learning exclusively utilized viewpoint-invariant information.It was found that the motor program for a familiar object is highly activated during the execution of the action in conventional manner, while the role of visual feedback is more dominant for an unfamiliar action. These results suggest that the motor representation for a familiar object is based on the previous interactions between the part of the object to be grasped and a particular hand shape. It was experimentally shown that active exploration of object views using a track ball facilitates object recognition. It suggested that a rule for view transformation of objects was learned by the interaction between information provided by hand movements from the motor system and visual information. Moreover, it was demonstrated that active exploration leads to a significant decrease of the amplitude of the magnetic field in the left hemisphere at the time period when the current dipole was estimated in the left parietal cortex. Less

手的动作和视觉反馈之间的相互作用进行了研究。结果表明，中枢神经系统控制运动的基础上的预测或估计随之而来的运动准确性，同时考虑到感觉和运动错误。此外，前辅助运动区（pre-SMA）、右后顶叶皮层（PPC）和右颞顶叶交界区（TPJ）分别参与内部运动预测、视觉误差在线评估和补偿视觉反馈延迟的运动估计。视觉和触觉与动态物体之间的跨模态整合的实验表明，作为感官线索的加权线性总和的动态表示介导跨模态整合，并且在整合中使用的时间线索是独立于那些在一致性判断中使用的。跨模态目标识别实验表明，单模态三维目标识别 ...更多信息利用视点依赖和视点不变的信息，而对象识别的方式不用于学习专门利用视点不变的信息。结果发现，运动程序的一个熟悉的对象是高度激活的执行过程中的行动，在传统的方式，而视觉反馈的作用是更占主导地位的一个不熟悉的行动。这些结果表明，熟悉物体的运动表征是基于之前的相互作用的对象之间的一部分，以把握和一个特定的手形。实验表明，使用轨迹球的对象视图的主动探索促进对象识别。这表明，一个规则的看法转换的对象是学习之间的相互作用的信息之间的手运动提供的运动系统和视觉信息。此外，它被证明，积极的探索导致一个显着的减少在左半球的磁场的幅度的时间段时，电流偶极子估计在左顶叶皮层。少