Research on development of evaluation method for emotinal change and effectiveness in the learning with information technology

人的情感活动是影响学习动机和学习有效性的重要因素。我们考察了生物反应是否可以作为学习者活动的情感因素，以实现信息技术下的有效学习。主要研究结果包括三个方面：第一，以瞳孔图功率谱密度(PSD)为指标，观察小学生对口语计算任务难度的反应。提出了一种基于单隐层模型的多层感知器，用于估计眨眼时的瞳孔大小。对两种口算任务中的造影进行观察。三种实验条件下的PSD在1.6-3.5赫兹范围内均有显着变化，平均瞳孔大小也不同。PSD和平均大小均随任务难度的增加而增加：对照组、1x1和1x2数字口算。比较有无眨眼伪影的瞳孔图的PSD结果，无眨眼伪影的PSD结果清楚地显示了任务解决的因素。SE…根据口算任务和眼球跟踪任务的任务难度，测量眼球跳动频率及其路径长度。第一个实验的结果发现，眼跳发生率和眼跳长度都随着任务难度的增加而减少。在第二个实验中，眼动频率是由视觉目标的切换频率引起的。眼跳时间随频率的增加而增加，而凝视时间随频率的增加而减少。此外，眨眼和眼跳时间之间的相关性出现在较高的频率上。此外，眼动频率似乎扮演着与任务难度不同的角色。第三，通过观察汉字辨别任务的脑电事件相关电位(ERP)来考察汉字的知觉加工过程，在完成汉字辨别任务时，随机呈现单个已知汉字、未知汉字和伪汉字的视觉图像。ERP分析表明，作为词汇认知指标的N400已经出现。对事件相关电位的独立成分分析(ICA)结果显示，位于枕叶皮质的独立成分的激活时程无差异，位于左侧颞叶后下皮质(PITC)的独立成分的激活时程有差异，从320ms刺激开始激活。这一结果表明，汉字在枕叶皮质被加工为视觉特征，在左侧PITC被加工为词汇C12项。较少

Human emotional activity plays major role of learning motivation and effectiveness. We examined whether bio-response can be a measure as emotional factor of learner's activity to achieve effectiveness learning with information technology. Major results are addressed in three points.Firstly, pupil response for task difficulty of oral calculation was observed as-power spectrum density (PSD) of pupillogram. Multi layer perceptron with one hidden layer model for pupillary change was developed to estimate pupil size during blink. Pupillography in the two types of oral calculation task were observed. The PSDs in the area of 1.6-3.5Hz were significantly changed among three experimental conditions as well as averages of pupil size. Both of PSD and average size increased with task difficulty : control, 1x1 and 1x2 digits oral calculation. Comparing PSD results of pupillography between with and without blink artifact, PSD result without blink artifact clearly showed the factor of task solving.Se … More condly, saccadic eye-movement frequency and it's path length were measured in response to the task difficulty during oral calculation task and ocular following task. The results of first experiment found that both the saccade occurrence rate and saccade length were found to decrease with the increased difficulty of the task. In second experiment, eye-movement frequencies were elicited by the switching frequency of a visual target. The saccade time were found to increase with the frequency however, gazing time were found to decrease in response to the frequency. Additionally, the correlation between blinking and saccade time appeared in the higher frequencies. Furthermore, eye-movement frequency appears to play a different role than that of task difficulty. Thirdly, perceptual process for Japanese Kanji character was examined by observing event related potential (ERP) in electroencephalogram for Kanji discrimination task, Visual images of single known kanji, unknown kanji and fake-kanji were presented randomly while the subjects perform the kanji discrimination task. ERP analysis revealed that N400, the index as word cognition, is emerged. The result of independent component analysis (ICA) on ERP revealed that the activation timecourse of the independent components located in the occipital cortex had no difference and those located in the left posterior inferior temporal cortex (PITC) had difference and were activated from 320ms stimulus onset. This result indicates that kanji is processed as visual feature in occipital cortex and as lexical C12item in the left PITC. Less