Collaborative Research: WebScales-Towards a Large Scale Metasearch Engine

点击翻译按钮获取中文摘要

This project is to develop enabling techniques for a large-scalemetasearch engine that aims at covering a much larger portion of theWeb and at the same time retrieving more up-to-date and more usefuldocuments than existing search engines and metasearch engines. Ametasearch engine is a system that supports unified access to multipleexisting search engines. It is estimated that there are hundreds ofthousands of search engines on the Web (including deep Web). Theproposed metasearch engine (WebScales) will attempt to connect toas many of these search engines as possible. The focus of the researchis on advancing highly scalable distributed information retrievaltechnology and the research issues to be investigated in this project include (1) how to discover these search engines automatically, (2) how to incorporate them into the proposed metasearch engine automatically, (3) how to identify potentially useful search engines to use for any given user query submitted to the metasearch engine, and (4) how to achieve high retrieval effectiveness.