Frameworks: arXiv as an accessible large-scale open research platform

Arxiv是一个开放获取的存储库，30多年来一直在计算机科学、数学和物理等学科中发挥着主导作用。它拥有200多万篇科学论文，并拥有庞大的用户社区。每个月大约有500万活跃用户和1亿网络访问。尽管arxiv的规模和用途都很大，但它的搜索和推荐功能非常有限。为了更好地服务于arxiv社区，该项目正在构建新一代搜索和推荐功能，同时创建一个研究沙盒，以减少对第三方商业服务的依赖。为了让视障人士能够访问arxiv的科学内容宝库，增加了对结构良好的HTML和PDF的支持。研究成果的改进发现在科学领域提供了广泛的多学科利益。这些措施包括减少研究人员浪费时间浏览大量无关的论文，揭示“未知的未知”，以及通过意想不到的协同效应加快不同学科领域的研究。为了打破孤岛，迫切需要改进的推荐工具，它可以提供公正和多样化的相关研究成果和技术来源。Arxiv将为科学家提供改进的机制，以便他们发现自己专业领域和邻近领域的重要进展。该项目包括4个主要重点领域：开放A/B测试、科学文本的神经表示、arxiv动力学和安全与隐私。(1)开放A/B测试，使arxiv成为搜索和推荐算法A/B测试的平台。除了在线A/B测试外，还使用历史数据和反事实估计器提供离线A/B测试，以获得政策回报。(2)科学文本的神经表示提供了一种基于向量的科学文本(文档、段落和句子)的表示，适用于多个任务，包括引文、作者、标题和关键词预测。研究可区分搜索索引是因为它们在不需要增量重新训练的情况下提供额外的搜索性能改进的潜力。最后，这有助于建立一个科学的问答系统，该系统还可以用作与上下文相关的“聊天机器人”，使研究人员能够与他们交谈，并获得与他们感兴趣的最新出版物的清单。(3)arxiv Dynamic项目研究科学领域如何随时间增长、缩小和变化。创建一个“热门和新兴的arxiv主题”模式识别系统，可以预测研究人员对当前和历史文章的兴趣程度。研究人员正在研究方法，以消除该模型中的“变得更富有”的影响，修正该模型对用户与系统的历史交互的影响，并随着这些模型随着时间的推移而变化，跟踪性能并征求用户反馈。(4)根据Security&amp；Privacy，arxiv的隐私政策进行了更新，以便用户知道他们的(元)数据可能被如何使用，以及将部署哪些保护措施来保护他们的隐私。“第一层”API允许研究人员对匿名的arxiv网络博客进行粗粒度查询，而“第二层”API允许研究人员安全地在arxiv元数据和网络博客上进行实验。隐私通过查询限制和研究人员使用协议的组合来保护。一个支持差异隐私的机器学习API层正在开发中，并允许研究人员调查这些工具在基于ML的新颖应用中的效用，例如关于科学文本的自由形式问题回答、神经推荐系统等。这项由高级网络基础设施办公室颁发的奖项由计算机和信息科学与工程局的信息和智能系统司以及数学和物理科学局的物理司联合支持。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

arXiv is an open-access repository that has played a leading role in disciplines such as computer science, mathematics and physics for over 30 years. It hosts more than 2 million scientific papers and has a large user community. Each month there are approximately 5 million active users and 100 million web accesses. Despite its size and usage, arXiv has very limited search and recommendation functionality. In order to better serve the arXiv community, this project is building a new generation of search and recommendation functionality and simultaneously creating a research sandbox to reduce reliance on third-party, commercial services. To make arXiv's trove of scientific content accessible to the visually impaired, support is being added for well-structured HTML as well as PDF. Improved discovery of research results provides broad multidisciplinary benefits across areas of science. These include less researcher time wasted browsing through large amounts of irrelevant papers, revelation of "unknown unknowns," and accelerating research across different subject areas through unexpected synergies. Improved recommendation tools, which can provide unbiased and diverse sources of relevant research results and techniques, are urgently needed to break silos. arXiv will provide improved mechanisms for scientists to find out about important advances, both in their own field of expertise and in adjacent fields.This project includes 4 major focus areas: Open A/B Testing, Neural Representations of Scientific Text, arXiv Dynamics, and Security & Privacy. (1) Open A/B Testing enables arXiv to become a platform for A/B testing of search and recommendation algorithms. In addition to online A/B testing, offline A/B testing is provided using historical data along with counterfactual estimators for policy rewards. (2) Neural Representation of Scientific Text provides a vector-based representation of scientific texts (documents, paragraphs, and sentences) appropriate for multiple tasks, including citation, author, title, and keyword prediction. Differentiable search indices are investigated due to their potential to provide additional search performance improvements without requiring incremental re-training. Finally, this supports the construction of a scientific question-answering system which can also be used as a context-sensitive "chat-bot" enabling researchers to converse with and get a list of recent publications relevant to their interests. (3) The arXiv Dynamics project investigates how scientific fields grow, shrink, and transform over time. Creating a "trending and emerging arXiv topics" pattern recognition system predicts how interesting current and historical articles are to researchers. Research is investigating methods to remove the "rich-get-richer" effect from this model, to correct the model for the effects of the users' historical interactions with the system, and to track performance and solicit user feedback as these models change over time. (4) Under Security & Privacy arXiv's privacy policy is updated so that users are aware of how their (meta-)data may be used and the protections that will be deployed to protect their privacy. A "Layer 1" API allows researchers to make coarse-grained queries on anonymized arXiv weblogs and a "Layer 2" API which allows researchers to securely experiment on arXiv metadata and weblogs. Privacy is preserved by a combination of query restrictions and researcher usage agreements. A machine-learning API layer is being developed which supports differential privacy, and allows researchers to investigate the utility of these tools for novel ML-based applications, such as free-form question answering about scientific texts, neural recommender systems, etc.This award by the Office of Advanced Cyberinfrastructure is jointly supported by the Division of Information and Intelligent Systems in the Directorate for Computer and Information Science and Engineering and the Division of Physics within the Directorate for Mathematical and Physical Sciences.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.