SGER/Collaborative Research: Intelligent Use of Dictionaries for Document Retrieval

这个合作探索性研究项目（0738652,Clement Yu， UIC和0738727 Weiyi孟，SUNY Binghamton）的目标是调查基于词典的文档检索方法的潜在好处。本项目旨在在一年内证明在给定的领域内，使用多个字典（包括特定领域的字典和通用字典）将获得很高的检索效率。使用现有的TREC查询和文档集合将简化演示。将确定用于向查询添加语义相关术语的规则，这些规则可以在所选域内产生高检索效率。这些规则将被仔细分析，以获得由于使用词典而获得的有效性的基本见解。该项目还寻求证据，证明某些字典结构（例如，在上下文中使用单词的频率）如果添加到字典中，可以显著提高效率。该项目的研究成果将为实现长期目标奠定基础，包括确定在同一系统中使用不同类型字典的领域独立原则，开发跨字典添加有用字典结构的工具，以及在有多个字典时帮助用户半自动扩展查询。预计拟议的项目可以对搜索引擎技术产生重大影响，包括在法律和医学等专业领域的检索、问答、博客检索和分析以及企业搜索。研究成果将被纳入pi教授的几门课程中，学生将被招募参与研究活动。研究成果将通过出版的论文和一本关于网络搜索技术的教科书来传播。该项目的网站（http://www.cs.binghamton.edu/~meng/DocRetSGER.html）提供了对研究结果的访问。

The goal of this collaborative exploratory research project (0738652, Clement Yu, UIC and 0738727 Weiyi Meng, SUNY Binghamton) is to investigate the potential benefit of a dictionary-based approach for document retrieval. This project aims to demonstrate within one year that within a given domain, the use of multiple dictionaries (both domain specific dictionaries and general dictionaries) will obtain high retrieval effectiveness. The demonstration will be facilitated using existing TREC query and document collections. Rules for adding semantically related terms to queries that can yield high retrieval effectiveness within the selected domain will be identified. These rules will be carefully analyzed to obtain fundamental insights for the gain of effectiveness achieved due to the use of the dictionaries. This project is also to seek evidence that certain dictionary constructs (e.g., the frequency of use of a word in a context) can lead to significant gains in effectiveness if they are added to a dictionary. The research results from this project will lay the foundation in achieving longer-term goals that include the identification of domain independent principles of using different types of dictionaries in the same system, and the development of tools to add useful dictionary constructs across dictionaries and to assist users in query expansion semi-automatically when there are multiple dictionaries. It is expected that the proposed project can have a significant impact on search engine technology, including retrieval in specialized domains such as law and medicine, question-answering, blog retrieval and analysis, and enterprise search. Research results will be incorporated into several courses the PIs teach and students will be recruited to participate in the research activities. Research results will be disseminated through published papers as well as a textbook on Web-based search technology. The project Web site (http://www.cs.binghamton.edu/~meng/DocRetSGER.html) provides access to research results.