Spatiotemporal integration of multimodal sensory information

本研究旨在从时空事件标记的角度精确描述多通道感知，建立描述多媒体信息真实性、在场性、自然性等高层次感性信息感知的脑计算模型。基于这样的认识，本项目还旨在为多媒体时空信息显示系统提供量化的设计指南。作为该项目的成果，我们积累了许多关于多通道时空感知的新知识，并描述了人类对高层感性信息的感知模型。最后，我们制定了多媒体时空信息显示系统的量化设计准则。

This research project aims at precisely describing multimodal perception from the view point of spatiotemporal event marking to build up brain computation models to describe perception of high-level kansei information such as verisimilitude, presence and naturalness for multimedia information. Based on such knowledge, this project also aims at providing quantitative design guidelines for multimedia spatiotemporal information display systems. As results of this project, we have accumulated a lot of new knowledge on multimodal spatiotemporal perception and have described human perception models of high-level kansei information. Finally, we have drawn up the quantitative design guidelines for multimedia spatiotemporal information display systems.