Multiple Scale and Multimodal Data and Information Fusion in Human Sensory Discrimination

这是一个跨学科项目，涉及人类单模态和跨模态感官辨别和场景分析的心理物理学研究，以及使用多维时间序列分析对数据进行计算建模。心理物理实验将提供关于多种触觉输入作为受刺激受体类型和相对位置的函数的新信息，以及关于并发触觉和视觉输入如何整合的信息。计算研究将评估基于copula的小波分析是否能够模拟人类的识别表现，并通过感官输入立即组合信息。作为替代方案，这将与在跨输入进行整合之前对每个输入进行时间序列（包括基于小波的）分析的方法进行比较。这项工作将提供一个关于感觉整合如何在模式内和跨模式运作的详细说明，这可以随后用于指导人工感觉系统的构建。

This is an inter-disciplinary project involving combined psychophysical studies of human uni- and cross-modal sensory discrimination and scene analysis, along with computational modeling of the data using multi-dimensional time series analysis. The psychophysical experiments will provide novel information on the use of multiple haptic inputs as a function of type and relative positions of receptors being stimulated, as well as information on how concurrent haptic and visual input is integrated. The computational studies will evaluate whether copula-based wavelet analyses are able to simulate human discrimination performance, with information being combined immediately across sensory inputs. As an alternative, this will be compared with approaches in which time series (including wavelet-based) analyses are conducted for each input before integration takes place across inputs. The work will provide a detailed account of how sensory integration operates within and across modalities, which can subsequently be used to guide the construction of artificial sensory systems.