Construction of Large Scale Japanese Text Database Based on Advanced Retrieval Method

点击翻译按钮获取中文摘要

The study of construction of a large scale text database with advanced retrieval functions yielded the following outcomes.1. Compilation of word dictionary for linguistic analysis: the dictionary, which was already generated from two computer-readable dictionaries, i<e., the Shinmeikai-Kokugojiten and the Nihongotango-Kikaijisho, was modified and expanded by adding proper nouns and other words frequently occurring in daily newspaper articles in orser for the dictionary to be applied to analyze a large amount of newspaper articles. The number of lexical items of this dictionary reachek about 200,000. Each item holds information on spellings, conjugations and declensions.2. Algorithms for analysis of morphemes and part of speeches and their implementation on a computer: Relationship between part of speeches was exhaustively investigated. As the result, as 86 by 59 connection table of part of speech was obtained and the structure ob bunsetsu was described in a transition network. Furthermore, algorithms for analysis of morphemes and part of speeches, which are based on the grammatical knowledge mentioned above, were made up and implemented in FORTRAN77 on a large scale computer of the University of Tokyo.3. Equipment of newspaper date: Articles of Japanese daily newspaper of 84 days were selected from the Asahi Newspaper in 1982, and were processed and stored on the large scale computer as a text data.4. Construction of database system with advanced retrieval functions: Based on these outcomes, a large scale text database was constructed, which is furnished with the advanced retrieval functions such that character, sequence of characters, word, sequence of words, part of speech, sequence of part of speeches and arbitrary combinations of these can be utilized as retrieval keys. The database management system was built in FORTRAN77 on the large scale computer.As mentioned above, the aims of this study has fully accomplished.