An Effectively Focused Crawling System
An Effectively Focused Crawling System
复制标题
DOI：
10.1007/978-3-642-23190-2_5
复制
发表时间：
2012
期刊：
影响因子：
--
通讯作者：
Yuki Uemura;Tsuyoshi Itokawa;T. Kitasuka;M. Aritsugi
中科院分区：
文献类型：
--
作者：
Yuki Uemura;Tsuyoshi Itokawa;T. Kitasuka;M. Aritsugi
In this article, we illustrate design and implementation of a focused crawling system for effectively collecting webpages concerning specific topics. An algorithm for deciding where to crawl next is developed by exploiting not only anchor texts but also the concept of PageRank. Given a topic to be focused on, our system attempts to collect webpages concerning the topic by crawling webpages that are expected to have not only close similarities to the topic but also high rank. Experimental results using many topics are reported and investigated in this article.
