Incorporating the Time-scale Modification of Speech and Visual Processing, and Captions into Learning and Instructional System for Oral, Aural and Visual Comprehension of ESL

将语音和视觉处理的时间尺度修改以及字幕纳入 ESL 口语、听觉和视觉理解的学习和教学系统中

• 批准号: 09680242
• 负责人: YAMAGUCHI Tsuneo
• 金额: $ 2.56万
• 依托单位: Yamagata University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C).
• 财政年份: 1997
• 资助国家: 日本
• 起止时间: 1997 至 1998
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-09680242/
• 关键词: English as a Second Language(ESL); visuals; cue visuals; time-scale modification; audio-visual strategies; SV-processing; captions; listening comprehension; 多重チャンネルモード; 英語字幕; 提示モード間干渉; 音声情報; 視覚情報; 語学教育; 効果・否定特性

Varied presentation of signal-processed speech and its synchronized visuals (SV) with and without captions are demonstrated to develop helping learners of a foreign language (1) listen to authentic foreign speeches that are spoken fast with some different tonal forms and (2) watch value-bearing visual information that disappear fast with better and deeper understanding. Closed-captioned (OC) video materials, on the other hand, are designed to help those learners with difficulty in listening comprehension by reading subtitles presented on the display.An attempt from these perspectives in this research study was made to determine some of the effects of the presentation, combined these three strategies in the ESL classroom settings. The findings are as follows : (1) Subjects are likely to rely more on captions than listening to the speech and watching visuals, thus the effect of SV is not observed, (2) Prepared cue visuals that are cut out from the learning video materials turn out to be a great contributor to the subjects' understanding in terms of listening comprehension.From the perspective of how listening comprehension ability develops over time, captioned video materials combined with SV system are a powerful motivating tool and can be successfully used in Japan not only for improving students' listening comprehension, but also for reading and vocabulary. However, further longitudinal studies are suggested.

经过信号处理的语音及其带和不带字幕的同步视觉效果（SV）的不同呈现方式被证明可以帮助外语学习者（1）聆听具有一些不同音调形式的快速口语的真实外国演讲和（2）观看随着更好和更深入的理解而快速消失的承载价值的视觉信息。另一方面，闭路字幕（OC）视频材料是通过阅读字幕来帮助听力有困难的学习者理解的，本研究试图从这些角度出发，结合这三种策略，在ESL课堂环境中确定字幕呈现的一些效果。调查结果如下：（1）受试者更倾向于使用字幕，而不是听演讲和观看视频，因此没有观察到SV效应。（2）从学习视频材料中截取的准备好的视频提示对受试者的听力理解有很大的促进作用。从听力理解能力如何随着时间的推移而发展的角度来看，字幕视频材料与SV系统相结合是一种强有力的激励工具，在日本不仅可以成功地提高学生的听力理解能力，而且可以提高学生的阅读能力和词汇量。然而，建议进一步的纵向研究。