DP9: an OAI gateway service for web crawlers
DP9: an OAI gateway service for web crawlers
复制标题
DP9：网络爬虫的OAI网关服务
DOI：
10.1145/544220.544284
复制
发表时间：
2002
期刊：
影响因子：
--
通讯作者：
Michael L. Nelson
中科院分区：
文献类型：
--
作者：
Xiaoming Liu;K. Maly;M. Zubair;Michael L. Nelson
许多图书馆和数据库对通用网络爬虫关闭，它们仅通过自己的搜索引擎公开其内容。与此同时，许多研究人员尝试通过通用网络搜索引擎查找技术论文。 DP9 是一种开源网关服务，允许通用搜索引擎（例如 Google、Inktomi）对符合 OAI 的档案进行索引。 DP9 通过为存储库记录提供一致的 URL，并在请求 URL 时将它们转换为针对适当存储库的 OAI 查询来实现此目的。这允许不支持 OAI 协议的搜索引擎对 OAI 兼容存储库中包含的“深层网络”进行索引。
Many libraries and databases are closed to general-purpose Web crawlers, and they expose their content only through their own search engines. At the same time many researchers attempt to locate technical papers through general-purpose Web search engines. DP9 is an open source gateway service that allows general search engines, (e.g. Google, Inktomi) to index OAI-compliant archives. DP9 does this by providing consistent URLs for repository records, and converting them to OAI queries against the appropriate repository when the URL is requested. This allows search engines that do not support the OAI protocol to index the "deep Web" contained within OAI compliant repositories.