Workflows Community Summit: Bringing the Scientific Workflows Community Together
Workflows Community Summit: Bringing the Scientific Workflows Community Together
复制标题
工作流程社区峰会：将科学工作流程社区聚集在一起
DOI：
--
复制
发表时间：
2021
期刊：
影响因子：
--
通讯作者：
J. Wozniak
中科院分区：
文献类型：
--
作者：
Rafael Ferreira da Silva;H. Casanova;K. Chard;D. Laney;D. Ahn;S. Jha;C. Goble;L. Ramakrishnan;L. Peterson;B. Enders;D. Thain;I. Altintas;Y. Babuji;Rosa M. Badia;Vivien R. Bonazzi;T. Coleman;M. Crusoe;E. Deelman;Frank Di Natale;Paolo Di Tommaso;T. Fahringer;Rosa Filgueira;G. Fursin;A. Ganose;Bjorn Gruning;D. Katz;O. Kuchar;A. Kupresanin;Bertram Ludäscher;K. Maheshwari;M. Mattoso;Kshitij Mehta;T. Munson;J. Ozik;T. Peterka;L. Pottier;Timothy Randles;S. Soiland;Benjamín Tovar;M. Turilli;T. Uram;K. Vahi;M. Wilde;M. Wolf;J. Wozniak
科学工作流程几乎在科学领域中普遍使用，并支持了过去几十年中一些最重要的发现。这些工作流中的许多工作流具有高计算、存储和/或通信需求，因此必须在从大型云到即将到来的百万兆级高性能计算（HPC）平台的各种大规模平台上执行。这些执行必须使用一些软件基础设施进行管理。由于工作流的流行，工作流管理系统（WMS）已被开发，以提供抽象的创建和执行工作流方便，高效，和可移植的。虽然这些努力都是值得的，但现在有数百个独立的WMS，其中许多都奄奄一息。因此，WMS景观被分割，并由于存在数百个看似相似但不兼容的系统而存在重大的进入障碍。因此，许多团队，无论大小，仍然选择构建自己的自定义工作流解决方案，而不是采用或构建现有的WMS。WMS现状对工作流用户、开发人员和研究人员产生了负面影响。“工作流社区峰会”于2021年1月13日在线举行。峰会的总体目标是发展最先进的观点，并确定工作流社区的关键研究挑战。在峰会之前，向工作流社区的利益相关者（包括WMS的开发人员和工作流的用户）发送了一份调查，帮助确定了该社区的关键挑战，这些挑战被转化为峰会的6个广泛主题，每个主题都是由社区志愿者领导的重点讨论的对象。本报告记录和整理了与会者在峰会之前、期间和之后提供的大量信息。
Scientific workflows have been used almost universally across scientific domains, and have underpinned some of the most significant discoveries of the past several decades. Many of these workflows have high computational, storage, and/or communication demands, and thus must execute on a wide range of large-scale platforms, from large clouds to upcoming exascale high-performance computing (HPC) platforms. These executions must be managed using some software infrastructure. Due to the popularity of workflows, workflow management systems (WMSs) have been developed to provide abstractions for creating and executing workflows conveniently, efficiently, and portably. While these efforts are all worthwhile, there are now hundreds of independent WMSs, many of which are moribund. As a result, the WMS landscape is segmented and presents significant barriers to entry due to the hundreds of seemingly comparable, yet incompatible, systems that exist. As a result, many teams, small and large, still elect to build their own custom workflow solution rather than adopt, or build upon, existing WMSs. This current state of the WMS landscape negatively impacts workflow users, developers, and researchers. The"Workflows Community Summit"was held online on January 13, 2021. The overarching goal of the summit was to develop a view of the state of the art and identify crucial research challenges in the workflow community. Prior to the summit, a survey sent to stakeholders in the workflow community (including both developers of WMSs and users of workflows) helped to identify key challenges in this community that were translated into 6 broad themes for the summit, each of them being the object of a focused discussion led by a volunteer member of the community. This report documents and organizes the wealth of information provided by the participants before, during, and after the summit.