Multiple Scale and Multimodal Data and Information Fusion in Human Sensory Discrimination

这是一个跨学科的项目，涉及结合人类的单模态和跨模态的感觉歧视和场景分析的心理物理学研究，沿着使用多维时间序列分析的数据的计算建模。心理物理学实验将提供新的信息，使用多个触觉输入作为被刺激的受体的类型和相对位置的函数，以及并发触觉和视觉输入是如何集成的信息。计算研究将评估基于Copula的小波分析是否能够模拟人类的辨别能力，信息可以立即通过感官输入进行组合。作为一种替代方案，这将与时间序列（包括基于小波的）分析方法进行比较，在集成发生在输入之前，每个输入。这项工作将提供一个详细的说明如何感觉整合内和跨模态，随后可以用来指导人工感觉系统的建设。

This is an inter-disciplinary project involving combined psychophysical studies of human uni- and cross-modal sensory discrimination and scene analysis, along with computational modeling of the data using multi-dimensional time series analysis. The psychophysical experiments will provide novel information on the use of multiple haptic inputs as a function of type and relative positions of receptors being stimulated, as well as information on how concurrent haptic and visual input is integrated. The computational studies will evaluate whether copula-based wavelet analyses are able to simulate human discrimination performance, with information being combined immediately across sensory inputs. As an alternative, this will be compared with approaches in which time series (including wavelet-based) analyses are conducted for each input before integration takes place across inputs. The work will provide a detailed account of how sensory integration operates within and across modalities, which can subsequently be used to guide the construction of artificial sensory systems.