An exploratory study of multimodal interaction modeling based on neural computation
An exploratory study of multimodal interaction modeling based on neural computation
复制标题
基于神经计算的多模态交互建模探索性研究
DOI：
10.1007/s11432-016-5520-1
复制
发表时间：
2016-09-01
影响因子：
8.8
通讯作者：
Wang, Hongan
中科院分区：
文献类型：
--
作者：
Lu, Lu;Lyu, Fei;Wang, Hongan
Multimodal interaction serves an important role in human-computer interaction. In this paper we propose a multimodal interaction model based on the latest cognitive research findings. The proposed model combines two proven neural computations, and helps to reveal the enhancement or depression influence of multimodal presentation upon the corresponding interaction task performance. A set of experiments is designed and conducted within the constraints of the model, which demonstrates the observed performance enhancement and depression effects. Our exploration and the experimental results help to further solve the question about how tactile feedback signal contribute the multimodal interaction efficiency which could provide guidelines for designing the tactile feedback in multimodal interaction.
