Research on development of evaluation method and learning effectiveness in the multi-media educational system by using emotional and biological information.

眼球运动、眨眼和瞳孔大小对视觉或听觉刺激作出反应，需要信息处理。众所周知，瞳孔大小随着任务难度的增加而增加。我们研究了它们的变化是否相关，是否可以作为心理活动的指标。第一个实验是在注视和跟随一个在中心点和同心圆上周期性移动的标记点的同时进行语音教学。音频指令要求学生回忆记忆过的单词、诗句或口头计算。第二个实验，受试者参加驾驶模拟游戏，并进行相同的音频任务。在两个实验中都观察到瞳孔大小、眨眼和眼球运动。在第一个实验中，瞳孔的平均大小和眨眼频率随着注视和跟随任务的视角以及音频指示的增加而显著增加。目标注视时间和跳变响应随音频指令的变化而减少。在第二个实验中，听到音频指令后，瞳孔大小和眨眼次数也显著增加。注视时间和跳跃性反应也显著减少。在此基础上，提出了基于眨眼时间与凝视时间、眨眼时间与扫视发生时间相关性的心理活动评价眼动模型。为了验证这一模型，在一些眼动条件下检验了它们之间的相关性。这一验证为瞳孔、眨眼和眼动反应可以作为心理活动的指标提供了证据。

Eye-movements, blinking and pupil size respond to visual or audio stimulus to require information processing. It is well known pupil size increase with task difficulty. We investigated whether their changes are correlated and can be indices of mental activity. First experiment, audio instruction was presented while gazing and following a marked point which moved periodically in the central point and a point on concentric circle. Audio instructions asked to recall memorized word, cap verses or oral calculation. Second experiment, subjects took part in driving simulation game with same audio tasks. Pupil size, blinking and eye-movements were observed in both experiments.In the first experiment, the averaged pupil sizes and blinking rate significantly increased with visual angle of gazing and following task, and audio instructions. The gazing time and saccadic responses for the target decreased in response to audio instructions. In the second experiment, pupil sizes and blinking also significantly increased in response to audio instructions. The gazing time and saccadic responses also significantly decreased in response to audio instructions.From these results, it suggested eye movement model for evaluating mental activity, which was based on correlations between blinking time and gazing time, and between blinking time and saccade occurrence time. For verifying this model, the correlations among them were examined under some eye movement conditions. This verification provided the evidence that pupil, blinking and eye-movement responses can be indices of mental activity.