CRI: CI-SUSTAIN: Collaborative Research: CiteSeerX: Toward Sustainable Support of Scholarly Big Data

近几十年来，获取科学和学术文献的途径发生了根本性的变化。越来越多的研究人员和学者在网络上免费提供他们的出版物。利用这个机会，新的科学搜索引擎工具被开发出来，如谷歌Scholar、Semantic Scholar和CiteSeer，现在是CiteSeerX。CiteSeerX已成为计算机与信息科学与工程（CISE）研究界最全面、最广泛使用的在线公共资源之一。数以百万计的CiteSeerX可移植文档格式（PDF）文档由谷歌索引。CiteSeerX在数字图书馆搜索引擎中是独一无二的。它是开放获取的，它的大部分文档都是从公共网络上获取的，用户可以在它的网站上搜索到所有文档的全文。此外，它通过开放档案计划（OAI）元数据服务接口提供所有自动提取的元数据和引用上下文，并在公共云上批量下载——所有这些都在知识共享许可下。其他学术搜索引擎通常不提供这项服务。CiteSeerX对表（在生产中）、图（已开发）和算法（已开发）执行自动提取和索引，这些功能在其他学术搜索引擎中很少看到。CiteSeerX在GitHub上提供开源软件和架构。此时，上述其他系统都没有发布其数字图书馆软件。利用已建立的CiteSeerX基础设施，本提案旨在创建一个具有新数据资源和更大数据收集的可持续的CiteSeerX系统。我们将开发一个运行成本低、无单点故障的新系统，并以可移植格式提供高质量和丰富的数据和元数据，这些数据和元数据将通过可访问的用户界面提供。我们将吸收网络上所有可免费获取的科学文献，目前估计有3000万份。CiteSeerX将通过可访问的Web用户界面、应用程序编程接口和数据转储提供高质量的元数据。构建CiteSeerX的平台SeerSuite将被重构，以便成为一个易于部署和配置的学术数字图书馆框架。它将建立在商业级开源软件上。此外，我们将提供可搜索的语义元数据，如关键短语和消歧作者姓名，以及非文本内容，如来自图形、表格、算法和方程的数据。为了长期可持续发展，我们将探索不同的盈利模式。结果将是一个重构的数字图书馆搜索引擎，它在可移植、可维护和自包含的框架上为多种类型的科学文献提供稳定、可用和可靠的数据服务，该框架可以部署到其他研究文献数字收藏中。源代码将托管在https://github.com/SeerLabs。系统发展和相关研究将在有关场所发表，并向公众提供。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Access to the scientific and scholarly literature has changed radically in recent decades. Increasingly researchers and scholars make their publications freely available on the Web. Taking advantage of this opportunity, new scientific search engine tools have been developed such as Google Scholar, Semantic Scholar, and CiteSeer, now CiteSeerX. CiteSeerX has become one of the most comprehensive and widely-used online public resources for the Computer and Information Science and Engineering (CISE) research community. Millions of CiteSeerX Portable Document Format (PDF) documents are indexed by Google. CiteSeerX is unique among digital library search engines. It is open access, most all of its documents are harvested from the public Web, and users have full-text access to all documents searchable on its website. Moreover, it provides all automatically extracted metadata and citation context via an Open Archive Initiative (OAI) metadata service interface and bulk downloads on a public cloud - all under a Creative Commons license. This service is usually not available from other scholarly search engines. CiteSeerX performs automatic extraction and indexing of tables (in production), figures (developed)}, and algorithms (developed), capabilities rarely seen in other scholarly search engines. CiteSeerX provides its open source software and architecture on GitHub. At this time none of the other above-mentioned systems release their digital library software. Utilizing the established CiteSeerX infrastructure, this proposal aims to create a sustainable CiteSeerX system with new data resources and a much larger data collection. We will develop a new system that runs with low operation overhead, without a single point of failure, and that provides quality and enriched data and metadata in portable formats that will be available through accessible user interfaces. We will ingest all freely accessible scientific documents on the Web, currently estimated to be 30 million. CiteSeerX will make available high-quality metadata through an accessible Web User Interface, Application Programming Interface, and data dumps. SeerSuite, the platform on which CiteSeerX is built, will be refactored so as to be an easily deployable and configurable scholarly digital library framework. It will be built on commercial grade open source software. In addition, we will provide searchable semantic metadata, such as key phrases and disambiguated author names, and non-textual content such as data from figures, tables, algorithms, and equations. For long-term sustainability we will explore different monetization models. The result will be a refactored digital library search engine that provides stable, usable, and reliable data services on multiple types of scientific documents built on a portable, maintainable, and self-contained framework that can be deployed for other research document digital collections. Source code will be hosted at https://github.com/SeerLabs. System development and related research will be published in relevant venues and be made publicly available.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.