Search engine using automatic web page ranking procedure and automatic classification

使用自动网页排名程序和自动分类的搜索引擎

• 批准号: 12558038
• 负责人: UEDA Shuichi
• 金额: $ 3.58万
• 依托单位: Keio University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (B)
• 财政年份: 2000
• 资助国家: 日本
• 起止时间: 2000 至 2001
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-12558038/
• 关键词: World Wide Web; Search engine; Web page; Automatic Classification; サーチエンジン; 自動格付け

The amount of World Wide Web (WWW) pages has grown dramatically over the last few years with the growth of internet. It is estimated that there are currently over 3,200 million WWW pages. In order to satisfy the requirement for new search engines for WWW pages, it is necessary to develop automatic mechanisms for the deletion of less important pages, judgment of usefulness of pages, and subject classification for Web pages.The first year, the automatic judging procedure for page type was developed. Web page were typed manually to standard pages, top pages, contents pages, bulletin boards, chat pages, link pages, diary pages, and input forms. The automatic judgment method based on quantitative analysis of judged pages was developed. The algorithm of a type judgment was based on the frequency of appearance of HTML tags, page length or words in titles and file names obtained from Web pages in Japanese.In the second year, the total amount of a Web page was estimated, and automatic judgment system of useful Web pages and automatic classification system were developed. The algorithm of automatic judgment system is based on the morphological analysis of pages which obtained the high score by the judgment of "being good sources of information". In order to classify WWW pages in Japanese by subject, we present two classification algorithms based on relative frequencies of terms and information retrieval technique using vector-space model.These methods are included in the search engine and it participated in the 2nd NTCIR workshop Web task.

随着互联网的增长，在过去的几年中，万维网（www）页面的数量显着增长。据估计，目前有超过32亿个www页面。为了满足对www页面新搜索引擎的要求，有必要开发自动机制以删除较少重要的页面，页面的判断以及网页的主题分类。第一年，开发了页面类型的自动判断程序。将网页手动输入到标准页面，顶部页面，内容页，公告板，聊天页，链接页面，日记页和输入表格中。开发了基于判断页面的定量分析的自动判断方法。类型判断的算法是基于HTML标签的外观频率，页面长度或单词中的标题和文件名中的单词和文件名，从日语中获得的网页获得。在第二年，估算了网页的总量，并开发了有用的网页和自动分类系统的自动判断系统。自动判断系统的算法基于对页面的形态分析，该页面通过“成为良好信息来源”的判断获得了高分。为了根据受试者对日语进行www页面进行分类，我们根据使用矢量空间模型的术语和信息检索技术的相对频率提出了两种分类算法。这些方法包括在搜索引擎中，并参与了第二个NTCIR研讨会Web任务。

项目成果

上田修一: "情報源としてのWWW"メディア・コミュニケーション. 51. 42-50 (2001)

Shuichi Ueda：“WWW 作为信息源”媒体传播。51. 42-50 (2001)

上田修一他: "Webページ評価の視点と基準"三田図書館・情報学会研究大会発表論文集. 2000. 33-36 (2000)

Shuichi Ueda 等：“网页评估的观点和标准”三田图书馆和信息社会研究会议记录 2000。 33-36 (2000)。

安形 輝: "WWW調査におけるサンプル集合の収集法"三田図書館・情報学会研究大会発表論文集. 2000. 37-40 (2000)

Akira Agata：“WWW 调查中收集样本集的方法”三田图书馆和信息社会研究会议记录 2000 年。 37-40 (2000)。

AGATA, Teru, et al: "Sampling Mathods for WWW survey"Proceedings of MITA Society for Library and Information Science 2000. 37-40 (2000)

AGATA, Teru 等人：“WWW 调查的抽样方法”MITA 图书馆和信息科学学会会议记录 2000. 37-40 (2000)

UEDA, Shuichi et al.: "Viewpoints for Evaluation of Web pages"Proceedings of MITA Society for Library and Information Science 2000. 33-36 (2000)

UEDA, Shuichi 等：“网页评估的观点”MITA 图书馆情报学会会议记录 2000. 33-36 (2000)