Development of a computer-assisted language learning system utilizing a speaker adaptation and a grammatical error modeling

利用说话者适应和语法错误建模开发计算机辅助语言学习系统

基本信息

批准号：
16300260
负责人：
ITO Akinori
金额：
$ 5万
依托单位：
Tohoku University
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (B)
财政年份：
2004
资助国家：
日本
起止时间：
2004 至 2007
项目状态：
已结题

项目摘要

1. Improvement of Pronunciation EvaluationWe developed a method to detect pronunciation mistakes made by a foreign language learner by applying a speech recognition technology. We focused on the following two targets: learning of English by Japanese native speakers and learning of Japanese by Korean native speakers. To improve the accuracy of detection of mispronunciations, we developed a bilingual speaker adaptation method to adapt both of English and Japanese HMMs to the learner. To solve a problem that the strictness of the detection of mispronunciations depends on the linguistic context of the pronunciation, we developed a method of detecting mispronunciations using a decision tree, which gave a detection accuracy of more than 90% on English utterances made by Japanese native speakers.2. Evaluation of Intonation and RhythmIn addition to the detection of mispronunciations, we developed methods to evaluate intonation and rhythm of the English utterances. We found that the log F0, log power and their derivatives were good features for the evaluation of intonation. To adjust the strictness of intonation evaluation from word to word, we introduced a method to estimate the word importance factors using a decision tree. We also found that a word duration ratio was a good feature for rhythm evaluation.3. Development of an interactive CALL systemWe developed a method of detecting grammatical errors from utterances of a learner for the application to an interactive CALL system that enables for a learner to learn a foreign language through dialogues with a computer. As for the learning of Japanese, we developed a method to recognize the learner's speech using a finite state automaton to which grammatical error rules were applied. As for the learning of English, we developed a method to use an n-gram language model trained from a corpus that was automatically generated using the grammatical error rules.

1。发音评估的改进我们开发了一种通过应用语音识别技术来检测外语学习者犯的发音错误的方法。我们专注于以下两个目标：日本母语人士学习英语，以及以韩国为母语的人学习日语。为了提高发现错误发音的准确性，我们开发了一种双语扬声器适应方法，以使英语和日本HMM适应学习者。为了解决一个问题，即对错误发音的严格性的严格性取决于发音的语言背景，我们开发了一种使用决策树来检测错误发音的方法，该方法对日本母语者的英语说法提供了超过90％的探测准确性。2。评估语调和节奏为检测错误发音的添加，我们开发了评估英语话语的语调和节奏的方法。我们发现日志F0，日志功率及其导数是评估语调的良好特征。为了将语调评估的严格性从单词调整为单词，我们介绍了一种使用决策树估算重要性因素一词的方法。我们还发现，单词持续时间比是节奏评估的好功能。3。交互式呼叫Systemwe的开发开发了一种方法，从学习者的话语中检测到语法错误，用于应用程序的互动呼叫系统，该系统使学习者能够通过与计算机对话学习外语。至于对日语的学习，我们开发了一种使用有限状态自动机识别学习者的语音的方法，将语法错误规则应用于其中。至于英语的学习，我们开发了一种方法，使用了从语料库训练的N-Gram语言模型，该模型是使用语法错误规则自动生成的。