Development of an Effective ESL Listening Lesson by Using Captioned Visuals with Sound with the Basis of the Analysis of Eye Movement

基于眼动分析，使用带声音的字幕视觉效果开发有效的 ESL 听力课程

• 批准号: 06451149
• 负责人: SUZUKI Hiroko
• 金额: $ 3.39万
• 依托单位: Kanagawa University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (B)
• 财政年份: 1994
• 资助国家: 日本
• 起止时间: 1994 至 1996
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-06451149/
• 关键词: Eye movement; ESL; Media literacy; Cognition; English captions; 視線運動; メディア学習; キャプション付き映像; 英語学習; キャプションつき映像

There kinds of experiments were conducted in this project to investigate how the captioned video should be used. The first experiment attempted to investigate the effect of preview exercise before the subject saw the captioned video when the caption interferes with his/her understanding. The experiment showed a beginning ESL learner did not see the visuals or read the caption effectively. In the meantime, it was also found an advaced ESL learner applied the triangular processing pattern of viewing among the three presentation modes such as visuals, sound, and captions. More exactly, an adavanced ESL learner's eye movement typically moves to the visual first, focuses on the beginning part of the caption right after it is presented, repeats fixation, mini-movement and saccade to understand written dialogue, and then moves back to some part of the visual.The result of the first experiment showed some subjects received assistantce from the excercise. Subjects with the limited English, by contrast, were not assisted with the exersie and achieved the traiangular viewing pattern with more comprehension.The second experiement attempted to investigate the effect of different leves/kinds of preview exercise considering the subjects' English level. The short exercise mainly included receptive kinds such as the reading and listening of the caption, whiile a long exercise included both receptive and productive kinds like reading loudly and translation. It was found the appropriate exercise helped the subject with various English levels to use the additional informational mode of captions effectively.In addition to the above, how the different size of the caption, small (24 points), medium (32) and large (40), affects the understanding and the viewing attitude of the subject in the third experiment early this year. Athough analysis still continues at the time of writing this report, the result roughly suggesteds many learners did not notice the difference of the size of captions.

本计画进行了三种实验来探讨如何使用字幕影片。第一个实验试图研究当字幕干扰被试理解时，被试在观看字幕视频之前进行预览练习的效果。实验表明，初学者没有有效地看到视觉效果或阅读标题。同时，本研究还发现，在视觉、声音和字幕三种呈现方式中，高级ESL学习者采用的是三角形的观看加工模式。更准确地说，一个高级ESL学习者的眼动通常首先移动到视觉部分，在字幕呈现后立即聚焦于字幕的开头部分，重复注视、微运动和扫视以理解书面对话，然后再移动回到视觉部分。相比之下，英语水平有限的受试者在练习中没有得到帮助，而是通过更多的理解来实现三角观看模式。第二个实验试图根据受试者的英语水平来探讨不同水平/类型的预览练习的效果。短练习主要包括接受性练习，如阅读和听字幕，而长练习包括接受性和产出性练习，如阅读和翻译。结果发现，适当的练习有助于不同英语水平的被试有效地使用字幕的附加信息模式，此外，在今年初的第三个实验中，小（24分），中（32分）和大（40分）的字幕大小如何影响被试的理解和观看态度。虽然在撰写本报告时分析仍在继续，但结果大致表明，许多学习者没有注意到字幕大小的差异。

项目成果

保崎則雄: "字幕つき映像の視聴過程を知るための視線運動分析" 神奈川大学 心理 教育論集. 15号. 58-67 (1997)

安崎纪夫：“通过注视运动分析来了解带字幕的视频的观看过程”《神奈川大学心理教育评论》第 15 期。58-67（1997 年）。

Hiroko Suzuki: "The Effect of the English Caption in the Viewing Process of Video -Analysis of Eye Movement-" Language Studies. No.19.

铃木弘子：《视频观看过程中英文字幕的影响-眼动分析-》语言研究。

保崎則雄: "外国語教育の視線運動分析による映像教材におけるキャプションの効果" 教育工学関連協会連合第4回全国大会講演論文集. 425-426 (1994)

Norio Yasaki：“基于外语教育中凝视运动分析的视频教材中字幕的效果”第四届全国教育技术协会会议记录425-426（1994）。

鈴木広子 保崎則雄: "字幕付映像の理解を高める提示方法についての一考察" Language Laboratoy. 34号. (1997)

Hiroko Suzuki 和 Norio Yasaki：“提高对字幕视频的理解的演示方法的研究”语言实验室第 34 号。（1997 年）

鈴木広子: "コンピュータの使い方" 神奈川大学言語研究センターNEWSLETTER. 16. 6-7 (1995)

铃木宏子：“如何使用计算机”神奈川大学语言研究中心通讯。16. 6-7 (1995)