Research on the educational effects of multimedia contents using eye tracks as an index

本研究的目的之一，是记录观察多媒体电子学习内容的参与者的眼动轨迹。从认知过程的角度对数据进行分析，以探讨教育效果。在实验中，眼标记录仪EMR-NL 8（NAC Image Technology Co.）记录眼轨迹，并使用专用软件（EMR-dFactory）对数据进行分析。通过这个软件，参与者正在观察的屏幕图像被捕获为AVI数据，我可以得到不仅显示眼睛注视的坐标，而且还显示特定区域的眼睛注视的数量和持续时间的图表。实验结果与实验结果一致. (1)在文本内容方面，对单词的注视时间和注视次数不利于记忆。即使一些重要的单词被着色或标记以吸引参与者的注意力，也没有观察到后测结果的改善。(2)在使用动画的说明内容中，与教师的谈话配合良好的说明内容在理解和记忆内容方面是有效的。在这些屏幕图像中，眼睛注视幻灯片和教练脸上的持续时间是平衡的。然而，那些与讲师的演讲不协调的人并没有表现出眼睛注视的效果。对于该项目的第二个目的，我试图使用创作软件Xpert制作有效的多媒体电子学习内容。“首先，必须准备Powerpoint幻灯片。我非常小心地在每张幻灯片中设置动画，以配合讲师的演讲。接下来，幻灯片在与讲师面部的视频记录同步后被存储为HTML文件。内容的主题是“人类视觉信息处理。发言人说：“动画在教材的文字及说明内容上均得到有效运用，是一套良好的教材。

For one of the purposes of this project, I conducted experiments of recording eye tracks of the participants who were observing multimedia e-learning contents. The data were analyzed to investigate the educational effects from the viewpoint of cognitive processes. In the experiments, Eye-mark Recorder EMR-NL8 (NAC Image Technology Co.) was used to record eye tracks, and the data were analyzed using the special software (EMR-dFactory). By this software, the screen images which participants were observing were captured as AVI data, and I could get diagrams which show not only coordinates of the eye fixations but also number and duration of the eye fixations in the specific areas. The results of the experiments were as Mows. (1) About the textual contents, duration and number of fixations on the words did not facilitate memorizing the contents. Even if some important words were colored or marked to attract participants' attention, no improvement in the results of the post-test was observed. (2) About the illustrative contents using animation, those which coordinated well with the instructor's talk were effective in understanding and memorizing the contents. In those screen images, durations of the eye fixations on the slide and on the face of the instructor were well-balanced. However, those which did not coordinate with the instructor's talk did not show the effects of eye fixations.For the second purpose of the project, I tried to make effective multimedia e-learning contents using the authoring software 'Xpert.' First, the Powerpoint slides had to be prepared. I took much care with setting animation in each slide to coordinate with the instructor's talk. Next, the slides were stored as HTML files after synchronizing with the video record of the instructor's face. The topic of the contents was on "human visual information processing."Animation was effectively used in both textual and illustrative contents to make a good teaching material.