SGER/Collaborative Research: Intelligent Use of Dictionaries for Document Retrieval

这一合作探索性研究项目(0738652，Clement Yu，UIC和0738727 Weyi Meng，纽约州立大学宾厄姆顿分校)的目标是调查基于词典的文档检索方法的潜在好处。这个项目的目的是在一年内证明，在给定的领域内，使用多种词典(包括特定领域词典和通用词典)将获得较高的检索效果。将利用现有的TREC查询和文件集合促进演示。将识别用于将语义相关的词语添加到能够在所选域内产生高检索效率的查询的规则。将仔细分析这些规则，以获得因使用词典而获得的有效性的基本见解。该项目还寻求证据表明，如果将某些词典结构(例如，某个单词在上下文中的使用频率)添加到词典中，可以导致显著的有效性提高。该项目的研究成果将为实现长期目标奠定基础，这些目标包括确定在同一系统中使用不同类型词典的独立于领域的原则，以及开发工具以跨词典添加有用的词典结构，并在存在多个词典的情况下帮助用户半自动地进行查询扩展。预计拟议的项目将对搜索引擎技术产生重大影响，包括法律和医学、问题回答、博客检索和分析以及企业搜索等专门领域的检索。研究成果将被纳入PIS教授的几门课程中，并将招募学生参与研究活动。研究成果将通过发表的论文和一本关于网络搜索技术的教科书进行传播。该项目的网站(http://www.cs.binghamton.edu/~meng/DocRetSGER.html)提供了对研究结果的访问。

The goal of this collaborative exploratory research project (0738652, Clement Yu, UIC and 0738727 Weiyi Meng, SUNY Binghamton) is to investigate the potential benefit of a dictionary-based approach for document retrieval. This project aims to demonstrate within one year that within a given domain, the use of multiple dictionaries (both domain specific dictionaries and general dictionaries) will obtain high retrieval effectiveness. The demonstration will be facilitated using existing TREC query and document collections. Rules for adding semantically related terms to queries that can yield high retrieval effectiveness within the selected domain will be identified. These rules will be carefully analyzed to obtain fundamental insights for the gain of effectiveness achieved due to the use of the dictionaries. This project is also to seek evidence that certain dictionary constructs (e.g., the frequency of use of a word in a context) can lead to significant gains in effectiveness if they are added to a dictionary. The research results from this project will lay the foundation in achieving longer-term goals that include the identification of domain independent principles of using different types of dictionaries in the same system, and the development of tools to add useful dictionary constructs across dictionaries and to assist users in query expansion semi-automatically when there are multiple dictionaries. It is expected that the proposed project can have a significant impact on search engine technology, including retrieval in specialized domains such as law and medicine, question-answering, blog retrieval and analysis, and enterprise search. Research results will be incorporated into several courses the PIs teach and students will be recruited to participate in the research activities. Research results will be disseminated through published papers as well as a textbook on Web-based search technology. The project Web site (http://www.cs.binghamton.edu/~meng/DocRetSGER.html) provides access to research results.