Research on development of evaluation method for emotinal change and effectiveness in the learning with information technology

信息技术学习中情绪变化及效果评价方法的开发研究

• 批准号: 13680228
• 负责人: NAKAYAMA Minoru
• 金额: $ 2.24万
• 依托单位: TOKYO INSTITUTE OF TECHNOLOGY
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 2001
• 资助国家: 日本
• 起止时间: 2001 至 2002
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-13680228/
• 关键词: pupil; eye-movement; blink; task solving; oculo-motor; event related potential; emotional information; biological information; 瞳孔面積; 周波数解析; 脳波; 漢字認識; 音環境; 感性情報

Human emotional activity plays major role of learning motivation and effectiveness. We examined whether bio-response can be a measure as emotional factor of learner's activity to achieve effectiveness learning with information technology. Major results are addressed in three points.Firstly, pupil response for task difficulty of oral calculation was observed as-power spectrum density (PSD) of pupillogram. Multi layer perceptron with one hidden layer model for pupillary change was developed to estimate pupil size during blink. Pupillography in the two types of oral calculation task were observed. The PSDs in the area of 1.6-3.5Hz were significantly changed among three experimental conditions as well as averages of pupil size. Both of PSD and average size increased with task difficulty : control, 1x1 and 1x2 digits oral calculation. Comparing PSD results of pupillography between with and without blink artifact, PSD result without blink artifact clearly showed the factor of task solving.Se … More condly, saccadic eye-movement frequency and it's path length were measured in response to the task difficulty during oral calculation task and ocular following task. The results of first experiment found that both the saccade occurrence rate and saccade length were found to decrease with the increased difficulty of the task. In second experiment, eye-movement frequencies were elicited by the switching frequency of a visual target. The saccade time were found to increase with the frequency however, gazing time were found to decrease in response to the frequency. Additionally, the correlation between blinking and saccade time appeared in the higher frequencies. Furthermore, eye-movement frequency appears to play a different role than that of task difficulty. Thirdly, perceptual process for Japanese Kanji character was examined by observing event related potential (ERP) in electroencephalogram for Kanji discrimination task, Visual images of single known kanji, unknown kanji and fake-kanji were presented randomly while the subjects perform the kanji discrimination task. ERP analysis revealed that N400, the index as word cognition, is emerged. The result of independent component analysis (ICA) on ERP revealed that the activation timecourse of the independent components located in the occipital cortex had no difference and those located in the left posterior inferior temporal cortex (PITC) had difference and were activated from 320ms stimulus onset. This result indicates that kanji is processed as visual feature in occipital cortex and as lexical C12item in the left PITC. Less

人的情感活动对学习动机和学习效果起着重要作用。本研究探讨生物反应是否可以作为学习者活动的情感因素，以达到资讯科技有效学习的目的。主要结果有三点：首先，以瞳孔图功率谱密度（PSD）的形式观察了学生对口算任务难度的反应。提出了一种基于瞳孔变化的隐层模型的多层感知器来估计眨眼过程中瞳孔的大小。观察两种口算任务的瞳孔图。1.6-3.5Hz范围内的PSD在三种实验条件下均存在显著性差异，瞳孔平均大小也存在显著性差异。在控制、1 × 1和1 × 2数字口算任务中，PSD和平均尺寸均随任务难度的增加而增加。比较有无眨眼伪影时的PSD结果，无眨眼伪影时的PSD结果更清楚地显示了任务解决的因素。 ...更多信息 第二，在口算任务和眼跟随任务中，测量了被试在不同任务难度下的扫视眼动频率和路径长度。实验一的结果发现，随着任务难度的增加，被试的眼跳发生率和眼跳长度都呈下降趋势。在实验二中，通过视觉目标的切换频率来诱发眼动频率。研究发现，眼跳时间随着频率的增加而增加，而凝视时间则随着频率的增加而减少。此外，眨眼和眼跳时间的相关性出现在较高的频率。此外，眼动频率似乎起着不同的作用比任务难度。第三，在汉字识别任务中，随机呈现单个已知汉字、未知汉字和假汉字的视觉图像，通过观察脑电中事件相关电位（ERP）来考察汉字的知觉过程。事件相关电位分析显示，作为词汇认知指标的N400出现了。独立成分分析（伊卡）结果显示，枕叶皮层的独立成分激活时程无差异，而左后下颞叶皮层（PITC）的独立成分激活时程有差异，均从320 ms刺激开始激活。这一结果表明汉字在枕叶皮层是作为视觉特征加工的，而在左侧PITC是作为词汇C12项目加工的。少

项目成果

Minoru NAKAYAMA, Koji TAKAHASHI and Yasutaka SHIMIZU: "Influence on Oculo-Motor Indices by the Frequency of Gazing and Saccade"The Transaction of the Institute of Electronics, Information and Communication Engineers. J82-D-I, No.9. 931-935 (2002)

Minoru NAKAYAMA、Koji TAKAHASHI 和 Yasutaka SHIMIZU：“凝视和扫视频率对眼运动指数的影响”电子、信息和通信工程师学会会刊。

Koji TAKAHASHI, Minoru NAKAYAMA and Yasutaka SHIMIZU: "The Eye-movement and Pupil size Respond to Audio Instruction in Viewing a Target"The Transaction of the Institute of Electronics, Information and Communication Engineers. J84-D-I, No.11. 1573-1576 (20

Koji TAKAHASHI、Minoru NAKAYAMA 和 Yasutaka SHIMIZU：“观看目标时眼球运动和瞳孔大小对音频指令的反应”电子、信息和通信工程师学会会刊。

Kazuhiro SHIGETA, Minoru NAKAYAMA, Yasutaka SHIMIZU: "The Relationship between the Prsentation Position of a Figure and Characters on a 3D Display and Cognitive Time"Electronics and Communications in Japan. Part 3, J84, No.12. 10-20 (2001)

Kazuhiro SHIGETA、Minoru NAKAYAMA、Yasutaka SHIMIZU：“3D 显示上图形和字符的呈现位置与认知时间之间的关系”日本电子与通信。

Kazuhiro SHIGETA, Minoru NAKAYAMA, Yasutaka SHIMIZU: "Study on the Depth position of Title in 3D Presentation"Electronics and Communications in Japan. Part 3, J85, No.11. 26-35 (2002)

Kazuhiro SHIGETA、Minoru NAKAYAMA、Yasutaka SHIMIZU：《3D 呈现中标题的深度位置研究》日本电子与通信。

M.Nakayama, K.Takahashi, Y.Shimizu: "The Act of Task Difficulty and Eye-Movement Frequency for the Oculo-Motor Indices"ACM ETRA02. 37-42 (2002)

M.Nakayama、K.Takahashi、Y.Shimizu：“眼运动指数的任务难度和眼球运动频率的表现”ACM ETRA02。