Poster: PanDA: Next Generation Workload Management and Analysis System for Big Data
Poster: PanDA: Next Generation Workload Management and Analysis System for Big Data
复制标题
海报：PanDA：下一代大数据工作负载管理和分析系统
DOI：
--
复制
发表时间：
2012
期刊：
影响因子：
--
通讯作者：
G. Záruba
中科院分区：
文献类型：
--
作者：
K. De;A. Klimentov;S. Panitkin;M. Titov;A. Vaniachine;T. Wenaus;D. Yu;G. Záruba
在真实的世界中，任何大型科学项目都意味着使用复杂的数据库管理系统（WMS）来处理大量高度分布式的数据，这些数据通常由大型协作访问。生产和分布式分析系统（PanDA）是一个高性能的WMS，旨在满足数据驱动的工作负载管理系统的生产和分析要求，该系统能够在大型强子对撞机数据处理规模下运行。PanDA为广泛的实验应用程序提供执行环境，自动化集中的数据生产和处理，支持物理组的分析活动，支持单个物理学家的自定义工作流程，提供分布式全球资源的统一视图，通过集成的监控系统呈现工作流程的状态和历史，归档和管理所有工作流程。PanDA现在正在被推广和打包，作为一个已经在极端规模上得到证明的WMS，以供大数据社区更广泛地使用。
In real world any big science project implies to use a sophisticated Workload Management System (WMS) that deals with a huge amount of highly distributed data, which is often accessed by large collaborations. The Production and Distributed Analysis System (PanDA) is a high-performance WMS that is aimed to meet production and analysis requirements for a data-driven workload management system capable of operating at the Large Hadron Collider data processing scale. PanDA provides execution environments for a wide range of experimental applications, automates centralized data production and processing, enables analysis activity of physics groups, supports custom workflow of individual physicists, provides a unified view of distributed worldwide resources, presents status and history of workflow through an integrated monitoring system, archives and curates all workflow. PanDA is now being generalized and packaged, as a WMS already proven at extreme scales, for the wider use of the Big Data community.