Natural language processing and Improvement of full text retrieval

自然语言处理和全文检索的改进

• 批准号: 09680393
• 负责人: IKEDA Takashi
• 金额: $ 0.7万
• 依托单位: GIFU UNIVERSITY
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 1997
• 资助国家: 日本
• 起止时间: 1997 至 1999
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-09680393/
• 关键词: full text retrieval; modifier-modifee; syntactic analysis; BUNSETSU analysis; proximity condition; Japanese; フレーズ検査; 分節解析; 適合率; フレーズ検索

So far in the full text information retrieval, query condition has been Boolean of words or proximity of two words. The aim of our research is to make possible to use modifier-modifee relation in query to improve the precision rate. For this purpose, we develop Japanese BUNSETSU analysis system (i.e. morphological analysis system) and modifier-modifiee relation analysis system(i.e. syntactic analisys system). They are integrated into the system on PC named IBUKI. The accuracy of IBUKI is more than 99% in BUNSETSU analysis and about 90% in modifier-modifee analysis. To improve its accuracy further we are now developing compound word analysis module based on automaton formulalization and developing a new idea of function words dictionary which registers almost all function words sequence appeared in BUNSETSU. As for retrieval system, we have builet systems for patent documents, news paper articles and example sentence collection in Japanese-English dictionary. By using modifier-modifee condition, retrieval precision was shown to be improved from 84% to 96% in comparison with proximity condition.

在目前的全文信息检索中，查询条件一直是词的布尔型或词的接近度。我们的研究目的是使修改者-修改者关系在查询中的使用成为可能，以提高查准率。为此，我们开发了日语文句分析系统（即词法分析系统）和修饰语-被修饰语关系分析系统（即句法分析系统）。它们被集成到名为IBUKI的PC上的系统中。IBUKI法在文色法分析中的准确率大于99%，在修饰剂-修饰剂法分析中的准确率约为90%。为了进一步提高其准确性，我们正在开发基于自动机公式化的复合词分析模块，并开发了一种新的虚词词典的想法，它几乎记录了所有出现在BUNSETSU中的虚词序列。在检索系统方面，我们建立了专利文献、新闻论文和日英词典例句收集系统。与邻近条件相比，使用修饰-修饰条件，检索精度从84%提高到96%。

项目成果

M. Wakata, Y. Hyodo, T. Ikeda: "The Dependency Analysis of a Long Japanese Sentence -On a Scope of "wa" and a scope of an adnominaladnominal embedded structure -"Technical Report of IPSJ. NL130-9. 65-72 (1999)

M. Wakata、Y. Hyodo、T. Ikeda：“日语长句的依存分析 - 关于“wa”的范围和主词嵌入结构的范围 -”IPSJ 的技术报告。

兵藤安昭, 池田尚志: "文節単位のコスト最小法による日本語形態素解析" 電子情報通信学会言語理解とコミュニケーション研究会. NLC98-2. 9-14 (1998)

Yasuaki Hyodo，Takashi Ikeda：“使用子句成本最小化方法的日语形态分析”IEICE 语言理解和交流研究组（1998）。

池田尚志: "助詞「は」と「が」の認識"言語・認識・表現研究会(LA-CE). 2. 61-80 (1997)

Naoshi Ikeda：“助词‘wa’和‘ga’的识别”语言、认知和表达研究小组 (LA-CE)。 2. 61-80 (1997)。

K. Niimi, Y. Hyodo, T. Ikeda: "Full-text retrieval using dependency structure and its evaluation"Digital Libraries. vol-11. 27-34 (1998)

K. Niimi、Y. Hyodo、T. Ikeda：“使用依赖结构的全文检索及其评估”数字图书馆。

Y.Hyodo, K.Niimi, T.Ikeda: "Conparison between proximity operation and dependency operation in Japanese full text cetrienal" Prov.of the 21st Annical International ACM SIGIR Condence. sigzR'98. 341-342 (1998)

Y.Hyodo、K.Niimi、T.Ikeda：“日语全文 cetrienal 中邻近操作和依赖操作的比较”Prov.of the 21st Annical International ACM SIGIR Condence。