Pelican: Advancing the Open Science Data Federation Platform

Pelican软件套件提供了一个促进研究数据集共享的平台。通过跨机构边界联合他们的数据集，从单个主要研究者实验室到国际合作的研究努力使远程客户端可以访问他们的本地数据集，用于查看、缓存或处理。鹈鹕联盟的旗舰是开放科学数据联盟（OSDF），它覆盖了整个开放科学社区。OSDF利用嵌入在国家和国际网络中的存储，独立或与分布式计算资源结合，促进对远程数据集的有效访问，作为各种科学工作流程的一部分。遵循翻译计算机科学的方法，来自三个机构的团队开发了鹈鹕软件套件，这样OSDF就可以承担全国范围的数据共享支柱的责任。Pelican的分布式计算原理使数据集提供者能够行使数据主权、访问控制、存储和网络容量保护以及使用情况的可观察性。Pelican客户端可以嵌入到web浏览器、Jupyter笔记本或计算基础设施中。作为一个Pelican联盟，OSDF可以被看作是一个“传输总线”，将客户端连接到使用各种后端存储技术的数据集提供者。该项目专注于与气候社区相关的数据集，并关注人工智能在研究中的不断发展的作用，增强了用户体验，并为鹈鹕软件套件增加了新的后端。这满足了不断增长的需求，即将国家网络基础设施生态系统的覆盖范围扩大到新用户和更广泛的高校。这项工作还得到了国家气候发现云（NDC-C）资源的支持。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

The Pelican Software Suite provides a platform that facilitates sharing of research datasets. By federating their datasets across institutional boundaries, research endeavors ranging from single Principal Investigator laboratories to international collaborations make their local datasets accessible to remote clients for viewing, caching, or processing. The flagship Pelican federation is the Open Science Data Federation (OSDF) which has the reach of the entire open science community. Utilizing storage embedded throughout national and international networks, the OSDF facilitates, independently or in conjunction with distributed computing resources, effective access to remote datasets as part of diverse scientific workflows.Following Translational Computer Science methodology, the team from three institutions develops the Pelican Software Suite so the OSDF can carry the responsibilities of a national-scale pillar for dataset sharing. The distributed computing principles of Pelican enable dataset providers to exercise data sovereignty, access control, protection of storage and network capacity, and observability of usage. Pelican clients can be embedded in web browsers, Jupyter notebooks, or computing infrastructure. As a Pelican federation the OSDF can be viewed as a “transport bus,” connecting clients to dataset providers that use a diverse set of backend storage technologies.With a focus on datasets relevant to the climate community and attention to the evolving role of AI in research, the project enhances the user experience and adds new backends to the Pelican Software Suite. This addresses the ever-growing need to broaden the reach of the national Cyberinfrastructure ecosystem to new users and a wider spectrum of colleges and universities. This effort is also supported by National Discovery Cloud for Climate (NDC-C) resources.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.