Collaborative Proposal: Frameworks: Project Tapis: Next Generation Software for Distributed Research
Collaborative Proposal: Frameworks: Project Tapis: Next Generation Software for Distributed Research
批准号:
1931575
负责人:
Sean Cleveland
金额:
$99.72万
依托单位:
依托单位国家:
美国
项目类别:
Standard Grant
财政年份:
2019
资助国家:
美国
项目状态:
已结题
起止时间:
2019-09-01 至 2024-08-31
中文摘要
强大的网络基础设施(CI)生态系统的目标是通过促进软件框架的开发作为可持续的生产质量服务,成为发现和创新的催化剂。现代科学和工程研究越来越多地跨越多个地理分布的数据中心,并利用仪器,实验设施和国家和地区CI网络。Tapis框架将使科学家能够以一种安全、可扩展和可复制的方式完成计算和数据密集型研究,使科学家能够专注于他们的研究,而不是完成研究所需的技术。Tapis将使复杂的计算应用程序、工作流程和基础设施的实现、共享和重用变得更加容易,并使以前对研究人员来说太具挑战性的分析成为可能。该框架将最大限度地提高应用程序的可移植性,允许灵活调度地理分布的计算工作负载,提供基于Web的科学即服务,以实现多设施,分散部署,并为传感器和流数据提供生产级支持。 Tapis将影响多个科学领域,地理和代表性不足的社区,有可能解决世界上最重要的科学问题,包括天文学,气候科学,医学,自然灾害和可持续发展科学。 教育和推广将包括赞助研讨会,黑客马拉松和培训材料,涵盖该平台,并提供示例,以鼓励用户广泛采用各种技术技能,并通过沉浸式研讨会和专业发展机会瞄准下一代年轻研究人员和专业人士。Tapis将是一个新的分布式计算实验平台,利用NSF在龙舌兰,Abaco和和弦项目。Tapis软件框架将1)为传感器和流数据提供生产级支持,2)最大限度地提高应用程序的可移植性,允许跨地理分布的提供商灵活调度计算工作负载,以及3)提供基于HTTP的科学即服务的RESTful API,以实现安全和可扩展的多设施,分散部署。Tapis与一系列不同领域的研究人员一起工作,以推动现实世界的用例,Tapis将成为计算工作流程和科学网关的基础网络基础设施。Tapis将利用容器来最大限度地提高应用程序的可移植性,允许跨地理分布的提供商灵活地调度计算工作负载。 该项目将通过在整个框架中引入执行系统功能和应用程序要求来实现这种灵活性。作业服务将以分布式方式运行,以利用数据局部性,并可选择在未充分利用的系统上调度作业。Tapis将使用微服务架构部署在集中式或分布式配置中,该架构包括一个新颖的分散式安全和授权内核。这个内核可以部署在本地,以保持对机密数据的本地控制。自定义微服务可以插入安全内核以提供新功能,从而为分布式计算提供网络基础设施生态系统。为了有效地执行Tapis,来自德克萨斯州高级计算中心(TACC)、德克萨斯大学奥斯汀分校(UT)和夏威夷(UH)的团队将利用长期合作来支持计算器驱动的、地理上分布式的、数据-该奖项反映了NSF的法定使命,并通过使用基金会的知识价值和更广泛的影响进行评估,被认为值得支持审查标准。
英文摘要
The goal of a robust cyberinfrastructure (CI) ecosystem is to become a catalyst for discovery and innovation by fostering the development of software frameworks as sustainable production-quality services. Modern science and engineering research increasingly span multiple, geographically distributed data centers and leverage instruments, experimental facilities and a network of national and regional CI. The Tapis framework will enable scientists to accomplish computational and data intensive research in a secure, scalable, and reproducible way allowing scientists to focus on their research instead of the technology needed to accomplish it. Tapis will allow easier implementation, sharing and re-use of complex computational applications, workflows, and infrastructure and enable analysis previously too challenging for researchers. The framework will maximize application portability, allowing flexible scheduling of geographically distributed computational workloads, offer a web-based science-as-a-service to enable multi-facility, decentralized deployments, and provide production-grade support for sensors and streaming data. Tapis will impact multiple science domains, geographic and underrepresented communities with the potential to tackle the world's most important scientific problems spanning astronomy, climate science, medicine, natural hazards, and sustainability science. Education and outreach will include sponsored workshops, hackathons and training materials covering the platform and providing examples to encourage widespread adoption for users across a variety of technical skills and targeting the next generation of young researchers and professionals through immersive workshops and professional development opportunities.Tapis, will be a new platform for distributed computational experiments that leverages NSF's investments in the Agave, Abaco and CHORDS projects. The Tapis software framework will 1) provide production-grade support for sensors and streaming data, 2) maximize application portability, allowing flexible scheduling of computational workloads across geographically distributed providers, and 3) provide science-as-a-service HTTP-based RESTful APIs to enable multi-facility, decentralized deployments that are both secure and scalable. Working alongside a diverse set of domain researchers to drive real-world use cases, Tapis will be the underlying cyberinfrastructure for computational workflows and science gateways. Tapis will leverage containers to maximize application portability, allowing flexible scheduling of computational workloads across geographically distributed providers. The project will achieve this flexibility by introducing execution system capabilities and application requirements throughout the framework. The Jobs service will be run in a distributed manner to take advantage of data locality and, optionally, to schedule jobs on underutilized systems. Tapis will deploy in centralized or distributed configurations using a microservices architecture that includes a novel, decentralized security and authorization kernel. This kernel can be deployed on-premises to retain local control over confidential data. Custom microservices can be plugged into the security kernel to provide new capabilities, resulting in a cyberinfrastructure ecosystem for distributed computing. To effectively execute Tapis, teams from the Texas Advanced Computing Center (TACC), the University of Texas at Austin (UT), and the University of Hawaii (UH) will leverage a long-standing collaboration to support investigator-driven, geographically distributed, data-intensive research.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
期刊论文(9)
专著(0)
科研奖励(0)
会议论文
登录
查看更多内容
DOI:
10.1145/3491418.3530291
发表时间:
2022-07
期刊:
Practice and Experience in Advanced Research Computing
影响因子:
--
作者:
[S. Cleveland;Cédric Arisdakessian;Craig Nelson;Mahdi Belcaid;Kiana L Frank;G. Jacobs]
通讯作者:
S. Cleveland;Cédric Arisdakessian;Craig Nelson;Mahdi Belcaid;Kiana L Frank;G. Jacobs
The Hawai‘i Rainfall Analysis and Mapping Application (HI-RAMA): Decision Support and Data Visualization for Statewide Rainfall Dat
夏威夷降雨分析和绘图应用程序 (HI-RAMA):全州降雨数据的决策支持和数据可视化
DOI:
--
发表时间:
2020
期刊:
Practice and Experience in Advanced Research Computi
影响因子:
--
作者:
[McLean, Jared H, Cleveland, Sean B, Lucas, Matthew, Longman, Ryan, Giambelluc, Thomas W, Leigh, Jason, Jacobs, Gwen A]
通讯作者:
Jacobs, Gwen A
https://doi.org/10.5281/zenodo.7201342
https://doi.org/10.5281/zenodo.7201342
DOI:
--
发表时间:
2022
期刊:
Science Gateways 2022
影响因子:
--
作者:
[Sean Cleveland, Anagha Jamthe, Jared McLean, Smruti Padhy, Maytal Dahan, Joe Stubbs, Gwen A. Jacobs]
通讯作者:
Gwen A. Jacobs
The Hawai`i Groundwater Recharge Tool
夏威夷地下水补给工具
DOI:
10.1002/cpe.6843
发表时间:
2022
期刊:
Concurrency and Computation: Practice and Experience
影响因子:
--
作者:
[McLean, Jared, Cleveland, Sean B., Rotzoll, Kolja, Izuka, Scot K., Leigh, Jason, Jacobs, Gwen A., Theriot, Ryan]
通讯作者:
Theriot, Ryan
Experience Migrating a Pipeline for the C-MĀIKI gateway from Tapis v2 to Tapis v3
将 C-MäIKI 网关的管道从 Tapis v2 迁移到 Tapis v3 的体验
DOI:
--
发表时间:
2022
期刊:
Practice and Experience in Advanced Research Computing (2022
影响因子:
--
作者:
[Wong, Yick Ching, Cleveland, Sean B, Jacobs, Gwen A.]
通讯作者:
Jacobs, Gwen A.
共 7 条
CC* Data Storage: KoaStore: A High Performance and Flexible Research Storage Resource
-
批准号:2232862
-
项目类别:Standard Grant
-
资助金额:$50.0万
-
财政年份:2022
-
负责人:Sean Cleveland
-
依托单位:
CC* Compute: Koa - A High Performance and Flexible Research Computing Resource
-
批准号:2201428
-
项目类别:Standard Grant
-
资助金额:$40.0万
-
财政年份:2022
-
负责人:Sean Cleveland
-
依托单位:
CyberTraining: Implementation: Medium: Cyberinfrastructure Training to Advance Environmental Science
-
批准号:2118222
-
项目类别:Standard Grant
-
资助金额:$99.93万
-
财政年份:2021
-
负责人:Sean Cleveland
-
依托单位:
海外基金