Multiple Scale and Multimodal Data and Information Fusion in Human Sensory Discrimination

点击翻译按钮获取中文摘要

This is an inter-disciplinary project involving combined psychophysical studies of human uni- and cross-modal sensory discrimination and scene analysis, along with computational modeling of the data using multi-dimensional time series analysis. The psychophysical experiments will provide novel information on the use of multiple haptic inputs as a function of type and relative positions of receptors being stimulated, as well as information on how concurrent haptic and visual input is integrated. The computational studies will evaluate whether copula-based wavelet analyses are able to simulate human discrimination performance, with information being combined immediately across sensory inputs. As an alternative, this will be compared with approaches in which time series (including wavelet-based) analyses are conducted for each input before integration takes place across inputs. The work will provide a detailed account of how sensory integration operates within and across modalities, which can subsequently be used to guide the construction of artificial sensory systems.