The Practical Study of the Real-time Captioning System Using Automatic Speech Recognition Technology in order to Support Students with Hearing Impairment

利用自动语音识别技术支持听力障碍学生的实时字幕系统的实践研究

• 批准号: 16530617
• 负责人: FUKUSHIMA Satoshi
• 金额: $ 2.3万
• 依托单位: The University of Tokyo
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 2004
• 资助国家: 日本
• 起止时间: 2004 至 2005
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-16530617/
• 关键词: the Real-time captioning system; students with a hearing impairment; access service; higher education; support services to remote locations; 中間支援者

H161 Development of the real-time captioning system using automatic speech recognition technology which was adapted for the lecture of a university(1) We employed the system which is repeated in a remote place and corrected in a classroom so that it might become the system suitable for the lecture of a university.(2) In the actual employment scene of a system, we recorded the reaction of a middle supporter and a student with hearing impairment on video, and analyzed it.As a result, it turned out that it is difficult that a middle supporter performs to correct a title and to offer circumference information together.(3) In order to carry out regular use of the real-time captioning system at a university, we tried use of improvement of a check sheet, a network camera, etc.2 Examination of the legible title display methodWe devised the method of carrying out title presentation that it is easier to understand quickly, when a middle supporter made correction of a title.H171 Analysis of the e … More ase of understanding of a caption 1(1) About the text including audio incorrect recognition, we classified into what an original meaning tends to guess, and what has a difficult analogy, and analyzed the difference.(2) We understood it is difficult for the student with hearing impairment to guess the meaning of the sentence including the mistake of the phonemic change.2 Analysis of the ease of understanding of a caption 2It was guessed that the grammatical misuses and the omission of the voice element like the intonation etc. of the spoken language caused difficulty.3 Execution of the repetition work by the intramural staffIn order to plan simplification of a system, and low cost, we built the system by which the staff of a university works as a repetition worker.4 Development of the program for middle supporter trainingWe created the work manual for middle supporters, and the manual for practice of repetition work. Moreover, carried out the middle supporter training program, and made evaluation and correction. Less

H161 适合大学讲座的采用自动语音识别技术的实时字幕系统的开发（1）我们采用了该系统，在远程重复并在教室进行校正，使其成为适合大学讲座的系统。（2）在系统的实际使用场景中，我们通过视频记录了中间支持者和听力障碍学生的反应，并进行了分析。 (3) 为了在大学中正常使用实时字幕系统，我们尝试使用检查表、网络摄像机等的改进。2 标题清晰显示方法的检查我们设计了在中支持者纠正标题时更容易快速理解的进行标题呈现的方法。H171 的 e … More ase 的分析 字幕的理解 1(1) 关于包括音频错误识别在内的文本，我们将其分为易于猜测的原始含义和难以类比的类型，并分析了差异。(2) 我们了解听力障碍学生很难猜测句子的含义，包括音素变化的错误。2 字幕易于理解的分析 2 推测语法误用和语音元素的遗漏，如 3 校内工作人员重复工作的执行 为了计划系统的简化和低成本，我们建立了大学工作人员作为重复工作人员的系统。 4 中层支持者培训计划的制定我们制定了中层支持者工作手册和重复工作实践手册。此外，还开展了中层支持者培训计划，并进行了评估和纠正。较少的

项目成果

the Real-time Captioning System Using Automatic Speech Recognition Technology in order to Support Students with Hearing Impairment 1 - Focusing a middle supporter performances to correct a caption -

使用自动语音识别技术来支持听力障碍学生的实时字幕系统 1 - 集中中间支持者的表演来纠正字幕 -

• 发表时间: 2005
• 期刊: The 43rd Conference of The Japanese Association of Special Education
• 作者: Kikuchi;Mari;Kanazawa;Takayuki;Nakano;Satoko;Kuroki;Hayato;Ino;Shuichi;Ifukube;Tohru;Fukushima;Satoshi
• 通讯作者: Satoshi

Some Issues about the Real-time Captioning System Using Automatic Speech Recognition Technology - Focusing the Difference of the Characteristics between Spoken Language and Written Language -

利用自动语音识别技术的实时字幕系统的一些问题——聚焦口语和书面语言特征的差异——

• 发表时间: 2006
• 期刊: Research in Educational Practice and Development, Gunma University Vol.23,
• 作者: Nakano;Satoko;Makihara;Tsutomu;Kanazawa;Takayuki;Kikuchi;Mari;Kuroki;Hayato;Ino;Shuichi;Ifukube;Tohru;Fukushima;Satoshi
• 通讯作者: Satoshi

the Real-time Captioning System Using Automatic Speech Recognition Technology in order to Support Students with Hearing Impairment 2 - Focusing the Difference of the Characteristics between Spoken Language and Written Language -

利用自动语音识别技术支援听障学生的实时字幕系统2 - 关注口语与书面语言的特点差异 -

• 发表时间: 2005
• 期刊: The 43rd Conference of The Japanese Association of Special Education
• 作者: Nakano;Satoko;Makihara;Tsutomu;Kanazawa;Takayuki;Kikuchi;Mari;Kuroki;Hayato;Ino;Shuichi;Ifukube;Tohru;Fukushima;Satoshi
• 通讯作者: Satoshi

音声認識技術を活用した高等教育機関における聴覚障害者の情報保障(1)-中間支援者の修正作業に注目して-

利用语音识别技术保障高等院校听障人员的信息安全（一）-重点关注中级辅助人员的矫正工作-

• 发表时间: 2005
• 期刊: 日本特殊教育学会第43回大会論文集
• 作者: 菊池真里;金澤貴之;中野聡子;黒木速人;井野秀一;伊福部達;福島智
• 通讯作者: 福島智

the Possibility of Using Automatic Speech Recognition Technology for Supporting Students with Hearing Impairment

使用自动语音识别技术支持听力障碍学生的可能性

• 发表时间: 2004
• 期刊: The 10th Conference of Japanese Society for Study of Special Needs Education
• 作者: Kikuchi;Mari;Kanazawa;Takayuki;Nakano;Satoko;Kuroki;Hayato;Ino;Shuichi;Ifukube;Tohru;Hori;Kohtaro
• 通讯作者: Kohtaro