MICE data handling on the Grid
MICE data handling on the Grid
复制标题
网格上的 MICE 数据处理
DOI：
10.1088/1742-6596/513/3/032063
复制
发表时间：
2014
期刊：
影响因子：
--
通讯作者：
J. Martyniak
中科院分区：
文献类型：
--
作者：
J. Martyniak
国际μ子电离冷却实验（MICE）旨在首次演示μ子电离冷却原理，以应用于未来的中微子工厂或μ子对撞机。该实验目前正在英国卢瑟福阿普尔顿实验室 (RAL) 的 ISIS 同步加速器中进行建设。在本文中，我们提出了一个系统——原始数据移动器，它允许我们存储和分发 MICE 原始数据——以及一个用于离线重建和数据管理的框架。原始数据移动器的目的是在数据被 DAQ 系统写出并标记为准备上传后立即将原始数据文件上传到安全的磁带存储中。文件的内部完整性经过验证，并将它们上传到 RAL Tier-1 Castor 存储元件 (SE) 并放置在两个磁带上以实现冗余。我们还在这个阶段在一个单独的基于磁盘的 SE 上制作了另一个副本，以便用户更轻松地快速访问数据。两个副本都经过校验和，并且副本均注册到 LCG 文件目录 (LFC) 的实例中。成功后，带有基本文件属性的记录将添加到 MICE 元数据数据库中。重建过程由上述移动系统填充的新原始数据记录触发。新原始文件的离线重建作业将提交至 RAL Tier-1，并将输出存储在磁带上。批量重新处理是在多个启用 MICE 的网格站点上完成的，并且使用自定义文件传输控制器将输出文件发送到 RAL 的中央磁带或磁盘存储。
The international Muon Ionisation Cooling Experiment (MICE) is designed to demonstrate the principle of muon ionisation cooling for the first time, for application to a future Neutrino factory or Muon Collider. The experiment is currently under construction at the ISIS synchrotron at the Rutherford Appleton Laboratory (RAL), UK. In this paper we present a system – the Raw Data Mover, which allows us to store and distribute MICE raw data – and a framework for offline reconstruction and data management. The aim of the Raw Data Mover is to upload raw data files onto a safe tape storage as soon as the data have been written out by the DAQ system and marked as ready to be uploaded. Internal integrity of the files is verified and they are uploaded to the RAL Tier-1 Castor Storage Element (SE) and placed on two tapes for redundancy. We also make another copy at a separate disk-based SE at this stage to make it easier for users to access data quickly. Both copies are check-summed and the replicas are registered with an instance of the LCG File Catalog (LFC). On success a record with basic file properties is added to the MICE Metadata DB. The reconstruction process is triggered by new raw data records filled in by the mover system described above. Off-line reconstruction jobs for new raw files are submitted to RAL Tier-1 and the output is stored on tape. Batch reprocessing is done at multiple MICE enabled Grid sites and output files are shipped to central tape or disk storage at RAL using a custom File Transfer Controller.