SGER: Exploratory Research: Using the Cuberinfrastructure to build a Full Text Index to the Web

SGER：探索性研究：使用 Cuberinfrastruct 构建网络全文索引

• 批准号: 0634677
• 负责人: William Arms
• 金额: $ 12万
• 依托单位: Cornell University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2006
• 资助国家: 美国
• 起止时间: 2006-10-01 至 2007-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0634677&HistoricalAwards=false
• 关键词: SGER; Exploratory; Research; Using; Cuberinfrastructure

This project will attempt to build a full text index to the textual web pages in the historical collections of the Internet Archive. The Internet Archive has taken a snapshot of the web every two months since 1996 and stored it. It now comprises approximately 40 billion web pages, consuming multiple petabytes of storage.The resulting index of the project may be the largest and best organized inverted index ever created that is freely available to academic researchers. It will enable social and information scientists to explore altogether new dimensions of contemporary events and practices, while offering information scientists a vital large-scale testing resource in areas such as advanced information retrieval on semistructured collections.

这个项目将尝试建立一个全文索引的文本网页的历史收藏的互联网档案馆。自1996年以来，互联网档案馆每两个月对网络进行一次快照，并将其存储起来。现在，它包含了大约400亿个网页，消耗了数PB的存储空间。该项目的最终索引可能是有史以来最大和组织最好的反向索引，可供学术研究人员免费使用。 它将使社会和信息科学家能够探索当代事件和实践的全新维度，同时为信息科学家提供重要的大规模测试资源，例如半结构化集合的高级信息检索。