Research on development of evaluation method and learning effectiveness in the multi-media educational system by using emotional and biological information.

眼睛运动、眨眼和瞳孔大小会对视觉或听觉刺激做出反应，从而需要信息处理。众所周知，瞳孔大小随着任务难度的增加而增大。我们研究了它们的变化是否相关并且可以作为心理活动的指标。第一个实验，在凝视并跟随在中心点和同心圆上的点周期性移动的标记点的同时呈现音频指令。音频指令要求回忆已记住的单词、大写诗句或口算。第二个实验，受试者参加具有相同音频任务的驾驶模拟游戏。在两个实验中都观察到了瞳孔大小、眨眼和眼睛运动。在第一个实验中，平均瞳孔大小和眨眼率随着注视和跟随任务的视角以及音频指令而显着增加。响应音频指令，目标的凝视时间和扫视反应减少。在第二个实验中，瞳孔大小和眨眼次数也随着音频指令而显着增加。对音频指令的反应也显着减少了凝视时间和扫视反应。从这些结果中，提出了用于评估心理活动的眼动模型，该模型基于眨眼时间和凝视时间之间以及眨眼时间和扫视发生时间之间的相关性。为了验证该模型，在某些眼动条件下检查了它们之间的相关性。这一验证提供了证据，证明瞳孔、眨眼和眼球运动反应可以作为心理活动的指标。

Eye-movements, blinking and pupil size respond to visual or audio stimulus to require information processing. It is well known pupil size increase with task difficulty. We investigated whether their changes are correlated and can be indices of mental activity. First experiment, audio instruction was presented while gazing and following a marked point which moved periodically in the central point and a point on concentric circle. Audio instructions asked to recall memorized word, cap verses or oral calculation. Second experiment, subjects took part in driving simulation game with same audio tasks. Pupil size, blinking and eye-movements were observed in both experiments.In the first experiment, the averaged pupil sizes and blinking rate significantly increased with visual angle of gazing and following task, and audio instructions. The gazing time and saccadic responses for the target decreased in response to audio instructions. In the second experiment, pupil sizes and blinking also significantly increased in response to audio instructions. The gazing time and saccadic responses also significantly decreased in response to audio instructions.From these results, it suggested eye movement model for evaluating mental activity, which was based on correlations between blinking time and gazing time, and between blinking time and saccade occurrence time. For verifying this model, the correlations among them were examined under some eye movement conditions. This verification provided the evidence that pupil, blinking and eye-movement responses can be indices of mental activity.