Scientific workflow management and the Kepler system

Scientific workflow management and the Kepler system
复制标题

DOI:
10.1002/cpe.994
复制
发表时间:
2006-08-25
影响因子:
2
通讯作者:
Zhao, Yang
Zhao, Yang
中科院分区:
计算机科学4区
文献类型:
--
作者:
Ludascher, Bertram;Altintas, Ilkay;Zhao, Yang

文献摘要

被引文献

相似文献

许多科学学科现在是数据和信息驱动的,新的科学知识通常是通过科学家将数据分析和知识发现“管道”放在一起来获得的。一个相关的趋势是,越来越多的科学界认识到共享其数据和计算服务的好处,因此正在为分布式数据和计算社区基础设施(也称为“分布式数据和计算社区基础设施”)做出贡献。“网格”)。然而,这种基础设施只是达到目的的一种手段,理想情况下,科学家不应该太关心它的存在。我们的目标是让科学家专注于开发和使用我们所谓的科学工作流程。这些是分析步骤的网络,例如,数据库访问和查询步骤、数据分析和挖掘步骤以及许多其他步骤,包括高性能集群计算机上的计算密集型作业。在本文中,我们描述的特点和要求的科学工作流程中确定的一些我们的应用项目。然后,我们详细介绍开普勒,一个特定的科学工作流程系统,目前正在开发的一些科学数据管理项目。我们描述了开普勒和它的基础托勒密II系统的一些关键功能,计划的扩展,以及未来的研究领域。Kepler是一个社区驱动的开源项目,我们始终欢迎相关项目和新贡献者的加入。版权所有(c)2005年约翰威利父子有限公司。
Many scientific disciplines are now data and information driven, and new scientific knowledge is often gained by scientists putting together data analysis and knowledge discovery 'pipelines'. A related trend is that more and more scientific communities realize the benefits of sharing their data and computational services, and are thus contributing to a distributed data and computational community infrastructure (a.k.a. 'the Grid'). However, this infrastructure is only a means to an end and ideally scientists should not be too concerned with its existence. The goal is for scientists to focus on development and use of what we call scientific workflows. These are networks of analytical steps that may involve, e.g., database access and querying steps, data analysis and mining steps, and many other steps including computationally intensive jobs on high-performance cluster computers. In this paper we describe characteristics of and requirements for scientific workflows as identified in a number of our application projects. We then elaborate on Kepler, a particular scientific workflow system, currently under development across a number of scientific data management projects. We describe some key features of Kepler and its underlying Ptolemy II system, planned extensions, and areas of future research. Kepler is a community-driven, open source project, and we always welcome related projects and new contributors to join. Copyright (c) 2005 John Wiley & Sons, Ltd.