Construction of an Intelligent System for information Retrieval in an Environment of Information Network

该项目旨在实现一个基于Internet的智能信息检索系统，取得的主要成果如下：(1)基本原则--使用“关键概念”、估计检索结果的相关性、以口语对话作为用户界面。(2)未登录词的处理为了根据关键概念进行搜索，系统必须推断未登记在系统词典中的关键词的概念。在对未登录词进行广泛收集和分类的基础上，发展了处理因音标变化而产生的未登录词以及由已知语素组成的未登录复合词的方法。(3)多义词和同义词的处理为了实现基于概念的搜索，必须同时处理关键词的多义性和同义性。对于多义词，提出了一种基于搭配信息的歧义消解方法。对于同义词，提出了一种基于关键词概念对关键词进行扩展的方法。(4)检索结果的相关性估计提出了一种基于关键词在文档中出现的数量和位置来估计文档与查询的相关度的方法。(5)基于用户和系统建模的对话管理在分析用户与系统之间模拟对话的基础上，提出了一种对话管理方法。它对用户和系统分别进行建模，用两个有限状态自动机表示，主要通过用户的话语进行信息交换。(6)结合上述结果构建了一个原型系统原型系统，并通过实验验证了其有效性。

The project aimed at realizing an intelligent system for information retrieval over the Internet, The main results obtained are as follows.(1)Basic principlesUse of 'key concepts', estimation of relevance of retrieved results, and spoken dialogue as the user interface, were adopted as basic principles.(2)Processing of unknown wordsIn order to conduct search based on key concepts, the system has to infer the concepts of key words that are not registered in the system's lexicon. On the basis of an extensive collection and classification of such 'unknown words', methods were developed for processing unknown words arising from variations of transcription as well as unknown compound words consisting of known morphemes.(3)Processing of polysemy and synonymyIn order to realize concept-based search, both polysemy and synonymy of keywords have to be coped with. As for polysemy, a method for disambiguation was developed on the basis of collocation information. As for synonymy, a method was developed to expand a keyword on the basis of its concept.(4)Relevance estimation of retrieved resultsA method was developed for estimating the degree of relevance of a document to a query on the basis of number and location of occurrence of keywords within a document. The estimation was optimized to maximize the correlation between the estimated relevance score and the actual score based on human judgment.(5)Dialogue management based on user and system modelingA method for dialogue management was developed on the basis of analysis of simulated dialogues between a user and the system. It adopts separate modeling of the user and the system, represented by two finite-state automata exchanging information mainly through their utterances.(6)Construction of a prototype systemA prototype system was constructed combining the above-mentioned results, and its validity was tested and confirmed experimentally.