Optimum Conditions for Simultaneous Presentation of Letter and Speech for Video Viewing/ Listening

用于视频观看/聆听的同时呈现字母和语音的最佳条件

• 批准号: 62580014
• 负责人: HIKI Shizuo
• 金额: $ 1.47万
• 依托单位: Waseda University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for General Scientific Research (C)
• 财政年份: 1987
• 资助国家: 日本
• 起止时间: 1987 至 1989
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-62580014/
• 关键词: Vision; Hearing; Letter; Speech; Video; Kana; Kanji

Purpose of this project was to obtain a practical guide line for superposing letter and speech in recording of video teaching materials, based on the analysis of optimum conditions for simultaneous presentation of letter and speech through audio/visual experiments with special regards to l) kind of letter to be superposed on the video picture, 2) rules of introducing Kanji to Kana sentence, 3) interaction of phonetic component, temporal synchronization and correspondence of contents between letter and speech simultaneously presented each other, and 4) characteristics of short term memory in processing letter and speech in visual and hearing sensation.1. Recording of Letter and Speech MaterialsTexts of letter and speech materials for the audio/visual experiments were edited taking into account of legibility of Kana, complexity of Kanji patterns and factors involved in short term memory of Kanji. Then, the materials were recorded on video tapes using a video camera and microphone.2. Audio/visual ExperimentsBy playing back the recorded letter and speech materials, audio/visual experiments were conducted, and accuracy of transmission of language information was estimated through various mode of response such as writing and rehearsing.3. Analysis of the results of the experimentsThe optimum conditions for simultaneous presentation of letter and speech obtained as results of analysis of the audio/visual experiments were summarized in a chart which can be practically utilized for superposition of letter and speech in video recording. The results were also arranged for demonstration on a video tape.

本研究的目的是通过视听实验，分析视听教材中文字与语音同时呈现的最佳条件，并从1）文字在视频画面上的叠加类型，2）汉字引入假名句的规则，3）语音成分的相互作用，文字和言语内容的时间同步性和对应性同时呈现; 4）视觉和听觉中文字和言语加工的短时记忆特点.视听实验中的文字和语音材料的记录考虑到假名的易读性、汉字模式的复杂性和汉字短时记忆的相关因素，对文字和语音材料进行了编辑。然后，用摄像机和麦克风把材料录在录像带上。视听实验通过回放记录的文字和语音材料，进行视听实验，并通过书写和复述等多种反应方式来评估语言信息传递的准确性.实验结果的分析作为视听实验的分析结果获得的字母和语音同时呈现的最佳条件总结在图表中，该图表可实际用于视频记录中字母和语音的叠加。研究结果亦已制成录影带播放。