Eye-Movement measurement while Learning Pronunciation Using English Pronunciation Practice CAI System Based on Sound and Mouth Movement

点击翻译按钮获取中文摘要

The pronunciation practice CAI system called “Lip Reading" based on lip reading techniques has been developed. “Lip Reading" enables a learner to practice English pronunciation by looking at the model speaker's mouth movement and allows to compare his/her own mouth movement which is simultaneously shown on the screen by the video camera connected to a computer. After Using “Lip Reading", the native speakers could easily recognize the students' performance. “Lip Reading" is effective for improvements of pronunciation by correcting of mouth movements.However, it is not always clear which part of the mouth should be focused on for each sound. Therefore, eye cameras were used to precisely measure both native speakers' and students' eye movements as they observed the model speaker's mouth on the computer screen. A variety of aspects regarding eye movement were analyzed and the data was conveyed numerically. For example, some students did not observe the model speaker's mouth, but rather other parts of the face. Some students did not understand when, where or how to properly observe the model speaker's mouth.In order to capture the student's attention and focus it on the proper aspects of pronunciation and mouth movement, we produced a new computer graphics (CG) animation film emphasizing the precise areas of mouth movement. Using this new CG animation system, students were able to practice proper pronunciation much more effectively.