Research on development of evaluation method and learning effectiveness in the multi-media educational system by using emotional and biological information.

眼球运动、眨眼和瞳孔大小对视觉或听觉刺激做出反应，需要进行信息处理。众所周知，瞳孔大小随着任务难度的增加而增加。我们调查了它们的变化是否相互关联，是否可以作为精神活动的指标。实验一，在注视和跟踪一个在中心点和同心圆上周期性移动的标志点的同时，给出了音频指令。音频指令被要求回忆记忆的单词、大写的诗句或口头计算。实验二，受试者以相同的音频任务参与驾驶模拟游戏。两个实验都观察到了学生的瞳孔大小、眨眼和眼动。在第一个实验中，平均的瞳孔大小和眨眼频率随着注视和后续任务的视角以及音频指令的增加而显著增加。目标的凝视时间和扫视反应随着音频指令的响应而减少。在第二个实验中，对音频指令的反应也显著增加了瞳孔大小和眨眼。根据这些结果，提出了基于眨眼时间与凝视时间、眨眼时间与眼跳发生时间的眼动模型来评价心智活动。为了验证这一模型，我们在一定的眼动条件下检验了它们之间的相关性。这一验证提供了证据，证明瞳孔、眨眼和眼动反应可以作为精神活动的指标。

Eye-movements, blinking and pupil size respond to visual or audio stimulus to require information processing. It is well known pupil size increase with task difficulty. We investigated whether their changes are correlated and can be indices of mental activity. First experiment, audio instruction was presented while gazing and following a marked point which moved periodically in the central point and a point on concentric circle. Audio instructions asked to recall memorized word, cap verses or oral calculation. Second experiment, subjects took part in driving simulation game with same audio tasks. Pupil size, blinking and eye-movements were observed in both experiments.In the first experiment, the averaged pupil sizes and blinking rate significantly increased with visual angle of gazing and following task, and audio instructions. The gazing time and saccadic responses for the target decreased in response to audio instructions. In the second experiment, pupil sizes and blinking also significantly increased in response to audio instructions. The gazing time and saccadic responses also significantly decreased in response to audio instructions.From these results, it suggested eye movement model for evaluating mental activity, which was based on correlations between blinking time and gazing time, and between blinking time and saccade occurrence time. For verifying this model, the correlations among them were examined under some eye movement conditions. This verification provided the evidence that pupil, blinking and eye-movement responses can be indices of mental activity.