DIRAC data management: consistency, integrity and coherence of data
DIRAC data management: consistency, integrity and coherence of data
复制标题
DIRAC 数据管理：数据的一致性、完整性和连贯性
DOI：
--
复制
发表时间：
2008
期刊：
影响因子：
--
通讯作者：
Andrew C. Smith
中科院分区：
文献类型：
--
作者：
M. Bargiotti;Andrew C. Smith
DIRAC数据管理系统（DMS）依赖于WLCG（全球LHC计算网格项目）数据管理服务（LCG文件目录，存储资源管理器和文件传输系统（FTS））和LHCb特定组件（簿记数据库）。目的地管理系统的复杂性及其与水资源管理小组众多组成部分的相互作用，以及有关设施的不稳定性，经常在数据移动和/或数据登记方面变成意想不到的问题，妨碍了数据集的连贯性。LHCb的一些发展是为了避免数据损坏、缺失数据不一致以及目录和物理存储之间的不一致，这两种情况都是通过数据管理级别的安全措施（故障转移机制、校验和、回滚机制）和广泛的背景检查来实现的。在本文中，所有开发的工具，用于检查数据的完整性和一致性，以及存储使用代理，其目的是产生一个最新的会计所有LHCb存储使用LFC镜像数据库。这项活动的目标是开发一套通用工具，能够对影响管理系统的各种不同问题进行分类、分析和系统地解决，以便对主要目录（簿记和LFC）和存储要素保持一致的了解。
The DIRAC Data Management System (DMS) relies on both WLCG (Worldwide LHC Computing Grid Project) Data Management services (LCG File Catalogues, Storage Resource Managers and File Transfer System (FTS)) and LHCb specific components (Bookkeeping database). The complexity of both the DMS and its interactions with numerous WLCG components as well as the instability of facilities concerned, has frequently turned into unexpected problems in data moving and/or data registration, preventing a coherent picture of datasets. Several developments in LHCb have been made in order to avoid data corruptions, missing data incoherence and inconsistences among Catalogues and physical storage both through safety measures at data management level (failover mechanism, check sums, roll back mechanism) and extensive background checks. In this paper all the tools developed for checking data integrity and consistency will be presented as well as a Storage Usage agent, whose aim is to produce an up-to-date accounting of all LHCb storage usage using the LFC mirror database. The goal of this activity is the development of a generic tool suite able to categorize, analyze and systematically cure the disparate problems affecting the DMS in order to maintain a consistent picture of the main catalogues (Bookkeeping and LFC) and the Storage Elements.