Robust Incremental Parsing based on Finite-State Approximation of Context Free Grammar

基于上下文无关文法有限状态逼近的鲁棒增量解析

• 批准号: 15300044
• 负责人: OGAWA Yasuhiro
• 金额: $ 8.58万
• 依托单位: Nagoya University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (B)
• 财政年份: 2003
• 资助国家: 日本
• 起止时间: 2003 至 2004
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-15300044/
• 关键词: natural language processing; parsing; finite state automaton; algorithm; simultaneous interpretation; spoken language; corpus; context free grammar; 有限オートマン

In this research, it has been aiming at the development of high speed and gradual progress the parsing technology treatable by the same degree of the speed as the voice input to develop the translation technology between several languages that have the simultaneous interpreter function. The approach of developing the approximation conversion technique based on the statistical method that was able to reflect the use frequency etc. of the grammatical rule appropriately by using the language corpus with the syntax tree was selected. The research of the following items was concretely promoted.^*English, Japanese, and Thai corpus maintenance.The simultaneous interpreter conversation corpus that had been collected in the Nagoya University integration sound information research base was used. In this research, the translation data of it was made by using Japanese data of 24 hours and the English translation with the original data among these about Thai. The syntax tree data was given to each … More language corpus in the form of the phrase structure grammar.^*Acquisition of statistical information from large-scale corpus with syntax tree.The technique to acquire various statistical informations was examined from the language corpus from which the syntax tree was given. It was statistically analyzed by searching for the position in the syntax tree where the grammatical rule appeared, and describing it with the context information.^*Development of limited automata approximation conversion technique.The technique for converting it from the context-free grammar into limited automata was researched. In conversion. Automata were made by expressing the context-free grammar in the form of the reflexive transition network, and developing them descending. The algorithm that developed the are with high use frequency by priority was developed as a development method according to the probability calculation.^*Design and mounting of parsing gradual progress system.The system of grammatical acquisition, the limited automata approximation, and parsing was designed, and mounted. Limited automata that consisted of the are of about 50 million were made for the achievement of a practicable analysis.^*Evaluation for comparison of parsing.The parsing experiment in English, Japanese, and Thai was executed by using the bench mark. The evaluation for comparison of this analytical technique from a diversified viewpoint like accuracy, time, and the number and the form etc. of the syntax tree was executed as a result.The realizability of robust incremental parsing was verified by the automata approximation of the context-free grammar through the research on two years, and the effect on the speed-up of the analysis was able to be confirmed. Less

本研究以开发具有同声传译功能的多种语言之间的翻译技术为目标，以高速化、渐进地处理与语音输入同等速度的解析技术为目标。选择了开发基于统计方法的近似转换技术的方法，该技术能够通过使用具有语法树的语言语料库来适当地反映语法规则的使用频率等。具体推进了以下项目的研究。^*英语、日语、泰语语料库维护。使用名古屋大学综合声音信息研究基地收集的同声传译会话语料库。在本研究中，其翻译数据是利用其中关于泰语的24小时的日文数据和原始数据的英文翻译来制作的。语法树数据以短语结构语法的形式赋予每个语言语料库。^*利用语法树从大规模语料库中获取统计信息。从给出语法树的语言语料库中研究了获取各种统计信息的技术。通过搜索语法树中语法规则出现的位置，并用上下文信息对其进行描述，进行统计分析。^*有限自动机近似转换技术的开发。研究了将其从上下文无关语法转换为有限自动机的技术。在转换中。自动机是通过以自反转换网络的形式表达上下文无关语法并将其降序发展而制成的。作为根据概率计算的开发方法，开发了优先开发使用频率高的区域的算法。^*解析渐进系统的设计和安装。设计并安装了语法获取、有限自动机近似和解析系统。为了实现实用的分析，制作了由约 5000 万个区域组成的有限自动机。^*解析比较的评估。英语、日语和泰语的解析实验是使用基准进行的。结果从准确性、时间、语法树的数量和形式等多个角度对该分析技术进行了比较评价。通过两年的研究，通过上下文无关语法的自动机逼近验证了鲁棒增量解析的可实现性，并证实了对分析加速的效果。较少的

项目成果

Itsuki Kishida: "Construction of an Advanced In-Car Spoken Dialogue Corpus and its Characteristic Analysis"Proceedings of 8th European Conference on Speech Communication and Technology. (2003)

岸田Itsuki Kishida：《先进车载口语对话语料库的构建及其特征分析》第八届欧洲语音通信与技术会议论文集。

CIAIR In-car Speech Corpus-Influence of Driving Status-

CIAI​​R车载语音语料库-驾驶状态的影响-

• 发表时间: 2005
• 期刊: IEICE Transactions on Information and Systems E88-D・3
• 作者: Yoshihide Kato;Tomohiro Ohno;Nobuo Kawaguchi
• 通讯作者: Nobuo Kawaguchi

CIAIR Simultaneous Interpretation Corpus

CIAI​​R同声传译语料库

• 发表时间: 2004
• 期刊: Proceedings of Oriental COCOSDA 2004
• 作者: Yoshihide Kato;Hitomi Tohyama
• 通讯作者: Hitomi Tohyama

Expansion of a Japanese-Uighur Bilingual Dictionary by Paraphrasing

通过释义扩充日维双语词典

• 发表时间: 2005
• 期刊: Journal of Natural Language Processing Vol.11, No.5
• 作者: Yoshihide Kato;Tomohiro Ohno;Nobuo Kawaguchi;Makoto Tachibana;Yoshihide Kato;能勢 隆;Tomohiro Ohno;川島 啓吾;Nobuo Kawaguchi;Yasuhiro Ogawa
• 通讯作者: Yasuhiro Ogawa

大原 誠: "同時通訳を介した異言語間対話の時間的特長--逐次通訳との比較に基づく対訳コーパスの分析"通訳研究. 3. 35-53 (2003)

大原诚：“同声传译中的语际对话的时间特征——基于与交替传译比较的双语语料库分析”《口译研究》3. 35-53 (2003)。