Collaborative Research: Elements: Simulation-driven Evaluation of Cyberinfrastructure Systems
协作研究:要素:网络基础设施系统的仿真驱动评估
基本信息
- 批准号:2103508
- 负责人:
- 金额:$ 31.5万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Standard Grant
- 财政年份:2021
- 资助国家:美国
- 起止时间:2021-08-01 至 2025-07-31
- 项目状态:未结题
- 来源:
- 关键词:
项目摘要
Most scientific breakthroughs and discoveries are now preconditioned on performing complex processing of vast amounts of data as conveniently, reliably, and efficiently as possible. This requires high-end interconnected compute and storage resources, as well as software systems to automate the processing on these resources. An enormous amount of effort has been invested in producing such "cyberinfrastructure" software systems. And yet, developing and evolving these systems so that they are as efficient as possible, while anticipating future cyberinfrastructure opportunities and needs, is an open challenge. This project transforms the way in which these systems are evaluated, so that their capabilities can be developed and evolved judiciously. The traditional evaluation approach is to observe executions of these systems on real-world hardware resources. Although seemingly natural, this approach suffers from many shortcomings. Instead, this project focuses on simulating these executions. Simulation has tremendous, and untapped, potential for transforming the development cycle of cyberinfrastructure systems. Specifically, this project produces software elements that can be easily integrated into existing and future systems to afford them with simulation capabilities. These capabilities make it possible for developers to put their systems through the wringer and observe their behaviors for arbitrary operating conditions, including ones that go beyond current hardware platforms and scientific applications. Simply put, these capabilities will make it possible to establish a solid experimental science approach for the development of cyberinfrastructure systems that support current and future scientific endeavors that are critical to the development of our society.The cyberinfrastructure has been the object of intensive research and development, resulting in a rich set of interoperable software systems that are used to support science. A key challenge is the development of systems that can execute application workloads efficiently, while anticipating future cyberinfrastructure opportunities and needs. This project aims to transform the way in which these systems are evaluated, so that their capabilities can be evolved based on a sound, quantitative experimental science approach. The traditional evaluation approach is to use full-fledged software stacks to execute application workloads on actual cyberinfrastructure deployments. Unfortunately, this approach suffers from several shortcomings: real-world experiments are time- and labor-intensive, and they are limited to currently available hardware and software configurations. An alternative to real-world experiments that does not suffer from these shortcomings is simulation, i.e., the implementation and use of a software artifact that models the functional and performance behaviors of software and hardware stacks of interest. This project uses simulation to transform the way in which cyberinfrastructure systems are evaluated as part of their long-term development cycles. This is achieved via software elements for enhancing production cyberinfrastructure systems with simulation capabilities so as to enable quantitative evaluation of these systems for arbitrary execution scenarios. Creating these scenarios requires little labor, and executions can be simulated accurately and orders of magnitude faster than their real-world counterparts. Furthermore, simulations are perfectly reproducible and observable. While this approach is general, its effectiveness will be demonstrated by applying it to a number of production systems, namely, workflow management systems. This project capitalizes on the years of development invested in the SimGrid and WRENCH simulation frameworks.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
现在,大多数科学突破和发现都是以尽可能方便、可靠和高效地对海量数据进行复杂处理为前提的。这需要高端互连的计算和存储资源,以及自动化处理这些资源的软件系统。在生产这种“网络基础设施”软件系统方面投入了大量的精力。然而,开发和发展这些系统,使其尽可能高效,同时预测未来的网络基础设施机会和需求,这是一个开放的挑战。这个项目改变了评估这些系统的方式,从而可以明智地开发和发展它们的能力。传统的评估方法是观察这些系统在真实硬件资源上的执行情况。尽管这种方法看起来很自然,但它有很多缺点。相反,该项目侧重于模拟这些执行。模拟在改变网络基础设施系统的开发周期方面具有巨大的、尚未开发的潜力。具体地说,该项目生产的软件元素可以很容易地集成到现有和未来的系统中,为它们提供模拟能力。这些功能使开发人员能够让他们的系统经受考验,并观察他们在任意操作条件下的行为,包括超出当前硬件平台和科学应用的操作。简而言之,这些能力将使我们有可能为发展网络基础设施系统建立坚实的实验科学方法,这些系统支持当前和未来对我们社会发展至关重要的科学努力。网络基础设施一直是密集研究和开发的对象,产生了一套丰富的可互操作的软件系统,用于支持科学。一个关键挑战是开发能够高效执行应用程序工作负载的系统,同时预测未来的网络基础设施机会和需求。该项目旨在改变评估这些系统的方式,以便它们的能力可以在合理、定量的实验科学方法的基础上发展。传统的评估方法是使用成熟的软件堆栈来执行实际网络基础设施部署中的应用工作负载。不幸的是,这种方法有几个缺点:真实世界的实验是时间和劳动力密集型的,而且它们仅限于当前可用的硬件和软件配置。不存在这些缺点的真实世界实验的另一种选择是模拟,即,实现和使用模拟感兴趣的软件和硬件堆栈的功能和性能行为的软件人工产物。该项目使用模拟来改变评估网络基础设施系统的方式,将其作为长期开发周期的一部分。这是通过用于增强具有模拟能力的生产网络基础设施系统的软件元素来实现的,以便能够针对任意执行情况对这些系统进行定量评估。创建这些场景需要很少的劳动力,而且可以准确地模拟执行,并且比现实世界的同行快几个数量级。此外,模拟是完全可重现和可观察的。虽然这种方法是一般性的,但它的有效性将通过将其应用于一些生产系统来证明,即工作流管理系统。该项目利用了在SimGrid和扳手模拟框架上投资多年的开发经验。该奖项反映了NSF的法定使命,并通过使用基金会的智力优势和更广泛的影响审查标准进行评估,被认为值得支持。
项目成果
期刊论文数量(3)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Emerging Frameworks for Advancing Scientific Workflows Research, Development, and Education
推进科学工作流程研究、开发和教育的新兴框架
- DOI:10.1109/works54523.2021.00015
- 发表时间:2021
- 期刊:
- 影响因子:0
- 作者:Casanova, Henri;Deelman, Ewa;Gesing, Sandra;Hildreth, Michael;Hudson, Stephen;Koch, William;Larson, Jeffrey;McDowell, Mary Ann;Meyers, Natalie;Navarro, John-Luke
- 通讯作者:Navarro, John-Luke
WfCommons: A framework for enabling scientific workflow research and development
- DOI:10.1016/j.future.2021.09.043
- 发表时间:2021-10-13
- 期刊:
- 影响因子:7.5
- 作者:Coleman, Taina;Casanova, Henri;da Silva, Rafael Ferreira
- 通讯作者:da Silva, Rafael Ferreira
On the Feasibility of Simulation-driven Portfolio Scheduling for Cyberinfrastructure Runtime Systems
网络基础设施运行时系统仿真驱动组合调度的可行性
- DOI:
- 发表时间:2022
- 期刊:
- 影响因子:0
- 作者:Casanova. H.;Wong Y. C.;Pottier, L.;Ferreira da Silva, R.
- 通讯作者:Ferreira da Silva, R.
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Ewa Deelman其他文献
Mapping Abstract Complex Workflows onto Grid Environments
- DOI:
10.1023/a:1024000426962 - 发表时间:
2003-01-01 - 期刊:
- 影响因子:2.900
- 作者:
Ewa Deelman;James Blythe;Yolanda Gil;Carl Kesselman;Gaurang Mehta;Karan Vahi;Kent Blackburn;Albert Lazzarini;Adam Arbree;Richard Cavanaugh;Scott Koranda - 通讯作者:
Scott Koranda
Advancing Anomaly Detection in Computational Workflows with Active Learning
通过主动学习推进计算工作流程中的异常检测
- DOI:
10.48550/arxiv.2405.06133 - 发表时间:
2024 - 期刊:
- 影响因子:0
- 作者:
Krishnan Raghavan;George Papadimitriou;Hongwei Jin;A. Mandal;Mariam Kiran;Prasanna Balaprakash;Ewa Deelman - 通讯作者:
Ewa Deelman
A terminology for scientific workflow systems
科学工作流系统的术语
- DOI:
10.1016/j.future.2025.107974 - 发表时间:
2026-01-01 - 期刊:
- 影响因子:6.100
- 作者:
Frédéric Suter;Tainã Coleman;İlkay Altintaş;Rosa M. Badia;Bartosz Balis;Kyle Chard;Iacopo Colonnelli;Ewa Deelman;Paolo Di Tommaso;Thomas Fahringer;Carole Goble;Shantenu Jha;Daniel S. Katz;Johannes Köster;Ulf Leser;Kshitij Mehta;Hilary Oliver;J.-Luc Peterson;Giovanni Pizzi;Loïc Pottier;Rafael Ferreira da Silva - 通讯作者:
Rafael Ferreira da Silva
Broadening Student Engagement To Build the Next Generation of Cyberinfrastructure Professionals
扩大学生参与度,培养下一代网络基础设施专业人员
- DOI:
10.1145/3569951.3597567 - 发表时间:
2023 - 期刊:
- 影响因子:0
- 作者:
Angela Murillo;Don Brower;Sarowar Hossain;K. Kee;A. Mandal;J. Nabrzyski;Erik Scott;Nicole K. Virdone;Rodney Ewing;Ewa Deelman - 通讯作者:
Ewa Deelman
How is Artificial Intelligence Changing Science?
人工智能如何改变科学?
- DOI:
10.1109/e-science58273.2023.10254913 - 发表时间:
2023 - 期刊:
- 影响因子:0
- 作者:
Ewa Deelman - 通讯作者:
Ewa Deelman
Ewa Deelman的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Ewa Deelman', 18)}}的其他基金
Collaborative Research: CyberTraining: Implementation: Medium: CyberInfrastructure Training and Education for Synchrotron X-Ray Science (X-CITE)
合作研究:网络培训:实施:媒介:同步加速器 X 射线科学网络基础设施培训和教育 (X-CITE)
- 批准号:
2320375 - 财政年份:2023
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant
Collaborative Research: SHF: Small: Model-driven Design and Optimization of Dataflows for Scientific Applications
协作研究:SHF:小型:科学应用数据流的模型驱动设计和优化
- 批准号:
2331153 - 财政年份:2023
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant
CI CoE: CI Compass: An NSF Cyberinfrastructure (CI) Center of Excellence for Navigating the Major Facilities Data Lifecycle
CI CoE:CI Compass:用于导航主要设施数据生命周期的 NSF 网络基础设施 (CI) 卓越中心
- 批准号:
2127548 - 财政年份:2021
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant
Collaborative Research: OAC Core: Simulation-driven runtime resource management for distributed workflow applications
协作研究:OAC Core:分布式工作流应用程序的模拟驱动的运行时资源管理
- 批准号:
2106147 - 财政年份:2021
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant
Collaborative Research: EAGER: VisDict - Visual Dictionaries for Enhancing the Communication between Domain Scientists and Scientific Workflow Providers
协作研究:EAGER:VisDict - 用于增强领域科学家和科学工作流程提供商之间沟通的视觉词典
- 批准号:
2100636 - 财政年份:2021
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant
Collaborative Research: EAGER: Advancing Reproducibility in Multi-Messenger Astrophysics
合作研究:EAGER:提高多信使天体物理学的可重复性
- 批准号:
2041901 - 财政年份:2020
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant
Collaborative Research: EAGER: Leveraging Advanced Cyberinfrastructure and Developing Organizational Resilience for NSF Large Facilities in the Pandemic Era
合作研究:EAGER:在大流行时代利用先进的网络基础设施并提高 NSF 大型设施的组织弹性
- 批准号:
2042054 - 财政年份:2020
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant
Collaborative Research: PPoSS: Planning: Performance Scalability, Trust, and Reproducibility: A Community Roadmap to Robust Science in High-throughput Applications
协作研究:PPoSS:规划:性能可扩展性、信任和可重复性:高通量应用中稳健科学的社区路线图
- 批准号:
2028930 - 财政年份:2020
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant
2019 NSF Workshop on Connecting Large Facilities and Cyberinfrastructure
2019 年 NSF 连接大型设施和网络基础设施研讨会
- 批准号:
1933353 - 财政年份:2019
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant
Pilot Study for a Cyberinfrastructure Center of Excellence
网络基础设施卓越中心试点研究
- 批准号:
1842042 - 财政年份:2018
- 资助金额:
$ 31.5万 - 项目类别:
Continuing Grant
相似国自然基金
Research on Quantum Field Theory without a Lagrangian Description
- 批准号:24ZR1403900
- 批准年份:2024
- 资助金额:0.0 万元
- 项目类别:省市级项目
Cell Research
- 批准号:31224802
- 批准年份:2012
- 资助金额:24.0 万元
- 项目类别:专项基金项目
Cell Research
- 批准号:31024804
- 批准年份:2010
- 资助金额:24.0 万元
- 项目类别:专项基金项目
Cell Research (细胞研究)
- 批准号:30824808
- 批准年份:2008
- 资助金额:24.0 万元
- 项目类别:专项基金项目
Research on the Rapid Growth Mechanism of KDP Crystal
- 批准号:10774081
- 批准年份:2007
- 资助金额:45.0 万元
- 项目类别:面上项目
相似海外基金
Collaborative Research: Elements: VLCC-States: Versioned Lineage-Driven Checkpointing of Composable States
协作研究:元素:VLCC-States:可组合状态的版本化谱系驱动检查点
- 批准号:
2411387 - 财政年份:2024
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant
Collaborative Research: Elements: Linking geochemical proxy records to crustal stratigraphic context via community-interactive cyberinfrastructure
合作研究:要素:通过社区交互式网络基础设施将地球化学代理记录与地壳地层背景联系起来
- 批准号:
2311092 - 财政年份:2023
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant
Collaborative Research: Elements: Lattice QCD software for nuclear physics on heterogeneous architectures
合作研究:Elements:用于异构架构核物理的 Lattice QCD 软件
- 批准号:
2311430 - 财政年份:2023
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant
Collaborative Research: Elements: ProDM: Developing A Unified Progressive Data Management Library for Exascale Computational Science
协作研究:要素:ProDM:为百亿亿次计算科学开发统一的渐进式数据管理库
- 批准号:
2311757 - 财政年份:2023
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant
Collaborative Research: FuSe: Monolithic 3D Integration (M3D) of 2D Materials-Based CFET Logic Elements towards Advanced Microelectronics
合作研究:FuSe:面向先进微电子学的基于 2D 材料的 CFET 逻辑元件的单片 3D 集成 (M3D)
- 批准号:
2329189 - 财政年份:2023
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant
Collaborative Research: Experimental and computational constraints on the isotope fractionation of Mossbauer-inactive elements in mantle minerals
合作研究:地幔矿物中穆斯堡尔非活性元素同位素分馏的实验和计算约束
- 批准号:
2246686 - 财政年份:2023
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant
Collaborative Research: Experimental and computational constraints on the isotope fractionation of Mossbauer-inactive elements in mantle minerals
合作研究:地幔矿物中穆斯堡尔非活性元素同位素分馏的实验和计算约束
- 批准号:
2246687 - 财政年份:2023
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant
Collaborative Research: GEO-CM: The occurrences of the rare earth elements in highly weathered sedimentary rocks, Georgia kaolins.
合作研究:GEO-CM:强风化沉积岩、乔治亚高岭土中稀土元素的出现。
- 批准号:
2327660 - 财政年份:2023
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant
Collaborative Research: FuSe: Monolithic 3D Integration (M3D) of 2D Materials-Based CFET Logic Elements towards Advanced Microelectronics
合作研究:FuSe:面向先进微电子学的基于 2D 材料的 CFET 逻辑元件的单片 3D 集成 (M3D)
- 批准号:
2329192 - 财政年份:2023
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant
Collaborative Research: Elements: Linking geochemical proxy records to crustal stratigraphic context via community-interactive cyberinfrastructure
合作研究:要素:通过社区交互式网络基础设施将地球化学代理记录与地壳地层背景联系起来
- 批准号:
2311091 - 财政年份:2023
- 资助金额:
$ 31.5万 - 项目类别:
Standard Grant