ITR: TeraScale Retrieval

newby, Gregory b .北卡罗来纳大学教堂山分校信息与图书馆科学学院itr /SW: TeraScale检索TeraScale检索致力于大规模信息检索（IR）的科学研究。TeraScale检索将通过实施IR研究和开发的软件工具包，促进实验，以提高信息检索的知识，特别是文本检索。IR系统试图识别满足人类信息需求的文件或文件中的段落。文本检索针对的是相对非结构化文档的集合，比如HTML文档，以及结构化程度更高的文档（比如XML）。为了推进科学知识和提高红外性能，需要一个软件工具包，使实验红外系统能够快速和实际地实施。TeraScale检索工具包将强调使用TeraScale数据集的大规模性能：数亿个具有tb级原始数据的文档，数百万个唯一术语，多种语言，以及潜在的千万亿（petascale）子文档或文档片段。该工具包将强调软件重用、高性能算法，以及用于快速原型和评估的模块化。TeraScale检索将专注于实验和评估，而不是快速从学术到商业化，以促进有关信息搜索和使用的科学知识。

ITR-0082655Newby, Gregory B.School of Information and Library Science, Universityof North Carolina at Chapel HillITR/SW: TeraScale RetrievalTeraScale Retrieval addresses the scientific investigation oflarge-scale information retrieval (IR). TeraScale Retrieval willfacilitate experimentation to advance knowledge of informationretrieval, especially text retrieval, by implementing a softwaretoolkit for IR research and development. IR systems seek to identifydocuments or passages from documents that satisfy a human informationneed. Text retrieval is directed at collections of relativelyunstructured documents, such as HTML documents, as well as morestructured documents (e.g., XML). In order to advance scientificknowledge and improve performance of IR, there is a need for asoftware toolkit that enables rapid and practical implementation ofexperimental IR systems. The TeraScale Retrieval toolkit willemphasize large-scale performance with terascale datasets: hundreds ofmillions of documents with terabytes of raw data, millions of uniqueterms, multiple languages, and potential for quadrillions (petascale)of sub-documents or document fragments. The toolkit will emphasizesoftware reuse, high-performance algorithms, and modularity for rapidprototyping and evaluation. Rather than moving quickly from academicuse to commercialization, TeraScale Retrieval will focus onexperimentation and evaluation to contribute to scientific knowledgeabout information seeking and use.