Abstract: PanDA: Next Generation Workload Management and Analysis System for Big Data
Abstract: PanDA: Next Generation Workload Management and Analysis System for Big Data
复制标题
摘要：PanDA：下一代大数据工作负载管理和分析系统
DOI：
--
复制
发表时间：
2012
期刊：
影响因子：
--
通讯作者：
M. Titov
中科院分区：
文献类型：
--
作者：
A. Klimentov;A. Vaniachine;K. De;T. Wenaus;S. Panitkin;Dantong Yu;G. Záruba;M. Titov
在现实世界中，任何大型科学项目都意味着使用复杂的工作负载管理系统（WMS）来处理大量高度分布式的数据，这些数据通常由大型协作访问。生产和分布式分析系统 (PanDA) 是一种高性能 WMS，旨在满足能够在大型强子对撞机数据处理规模上运行的数据驱动工作负载管理系统的生产和分析要求。 PanDA为广泛的实验应用程序提供执行环境，自动化集中数据生产和处理，支持物理小组的分析活动，支持单个物理学家的自定义工作流程，提供分布式全球资源的统一视图，通过集成监控系统呈现工作流程的状态和历史，存档和管理所有工作流程。 PanDA 现在正在被推广和打包，作为已经在极端规模上得到验证的 WMS，以供大数据社区更广泛地使用。
In real world any big science project implies to use a sophisticated Workload Management System (WMS) that deals with a huge amount of highly distributed data, which is often accessed by large collaborations. The Production and Distributed Analysis System (PanDA) is a high-performance WMS that is aimed to meet production and analysis requirements for a data-driven workload management system capable of operating at the Large Hadron Collider data processing scale. PanDA provides execution environments for a wide range of experimental applications, automates centralized data production and processing, enables analysis activity of physics groups, supports custom workflow of individual physicists, provides a unified view of distributed worldwide resources, presents status and history of workflow through an integrated monitoring system, archives and curates all workflow. PanDA is now being generalized and packaged, as a WMS already proven at extreme scales, for the wider use of the Big Data community.