The Practical Study of the Real-time Captioning System Using Automatic Speech Recognition Technology in order to Support Students with Hearing Impairment

点击翻译按钮获取中文摘要

H161 Development of the real-time captioning system using automatic speech recognition technology which was adapted for the lecture of a university(1) We employed the system which is repeated in a remote place and corrected in a classroom so that it might become the system suitable for the lecture of a university.(2) In the actual employment scene of a system, we recorded the reaction of a middle supporter and a student with hearing impairment on video, and analyzed it.As a result, it turned out that it is difficult that a middle supporter performs to correct a title and to offer circumference information together.(3) In order to carry out regular use of the real-time captioning system at a university, we tried use of improvement of a check sheet, a network camera, etc.2 Examination of the legible title display methodWe devised the method of carrying out title presentation that it is easier to understand quickly, when a middle supporter made correction of a title.H171 Analysis of the e … More ase of understanding of a caption 1(1) About the text including audio incorrect recognition, we classified into what an original meaning tends to guess, and what has a difficult analogy, and analyzed the difference.(2) We understood it is difficult for the student with hearing impairment to guess the meaning of the sentence including the mistake of the phonemic change.2 Analysis of the ease of understanding of a caption 2It was guessed that the grammatical misuses and the omission of the voice element like the intonation etc. of the spoken language caused difficulty.3 Execution of the repetition work by the intramural staffIn order to plan simplification of a system, and low cost, we built the system by which the staff of a university works as a repetition worker.4 Development of the program for middle supporter trainingWe created the work manual for middle supporters, and the manual for practice of repetition work. Moreover, carried out the middle supporter training program, and made evaluation and correction. Less