A study on multimodal emotion integrated feedback interface in e-learning environment

本研究的重点是在电子学习内容中整合多模态反馈界面，以促进学习动机、意义理解并提高学习效果。作为典型的多模态反馈界面，手写备忘录、情绪和视线跟踪在学习中非常重要。在这项研究中，开发并评估了视线跟踪和手写备忘录集成视频幻灯片同步电子学习内容。因此，可以向学习者呈现个性化的非语言和情感信息。结果表明，多模态情感集成界面能够有效促进学习动机、教学临场感、提高学习效果。

This study focuses on integrating multimodal feedback interfaces in e-learning contents to promote learning motivation, meaning understanding, and to improve learning effects. As typical multimodal feedback interfaces, handwriting memo, emotion, and gaze tracking are important in learning. In the study, gaze tracking and handwriting memo integrated video-slide synchronized e-learning contents are developed and evaluated. As a result, personalized nonverbal and emotion information could be presented to learners. And it shows that the multimodal emotion integrated interfaces are effective in promoting learning motivation, teaching presence, and in improving learning effect.