APEL: An implementation of Grid accounting using R-GMA

APEL: An implementation of Grid accounting using R-GMA
复制标题

APEL:使用 R-GMA 的网格会计实现

DOI:
--
复制
发表时间:
2005
期刊:
影响因子:
--
通讯作者:
A. Wilsona
A. Wilsona
中科院分区:
--
文献类型:
--
作者:
Rob Byroma;Roney Cordenonsi;Linda Cornwalla;Martin Craiga;Abdeslem Djaouia;Alastair Duncana;Steve Fishera;J. Gordona;S. Hicksa;Dave Kanta;J. Leake;Robin Middletona;M. Thorpea;J. Walka;A. Wilsona

文献摘要

被引文献

相似文献

本文描述了大型强子对撞机计算网格(LCG)中计费工具的实现:LCG是一个由100多个资源中心和10,000多个CPU组成的分布式计算网格项目。APEL(事件日志记账处理器)分析站点生成的批处理、系统和网守日志,并建立记账记录,根据CPU时间、挂钟时间、内存和网格用户DN等属性提供所消耗资源的摘要。会计数据被发布到R-GMA信息和监测系统,并存档,以供会计网络工具使用的图形前端处理。1.LCG核算概述在LCG[1]网格环境中,属于虚拟组织(VO)的计算资源、应用数据和网格用户是分布式的。这些用户提交的作业可以被发送到本地存储数据的计算资源,或者可以发送到有可用作业槽以减少排队时间的远程资源。必须正确计算在LCG资源上运行的作业,以便能够确定作为时间函数的VO消耗的资源和站点(资源中心)提供的资源。在本文中,我们区分了两种类型的网格记账:“网格作业记账”和“实时网格记账”,“网格作业记账”是指作业使用记录提供了对资源消耗的完整描述,而“实时网格记账”是基于作业执行时对资源价值的增量确定。在前者中,计算成本是基于所做的工作(在作业执行之后)确定的,而在后者中,数据被输入到定价模型中,根据该定价模型实时确定消费成本。在EGEE[4]网格计算项目的gLite[3]中间件框架内,正在开发实时记账的实现(DGA[2])。下面我们总结一个基于Web的工作核算工具的实现,该工具使用R-GMA[5]从分布式资源收集使用记录到中心点,并合并信息以便在Web上呈现。2.数据收集机制和
This article describes the implementation of an accounting tool in the LHC Computing Grid (LCG): a distributed computing grid project consisting of over 100 resource centres and more than 10,000 CPUs. APEL (Accounting Processor for Event Logs) parses batch, system and gatekeeper logs generated by a site and builds accounting records, which provide a summary of the resources consumed based on attributes such as CPU time, Wall Clock Time, Memory and grid user DN. The accounting data is published into the R-GMA information and monitoring system, and archived for processing by a graphical front-end utilised by the accounting web tool. 1. LCG Accounting Overview In the LCG [1] grid environment, the computing resources, the application data and the grid users belonging to Virtual Organisations (VO) are distributed. Jobs submitted by these users may be sent to computing resources where the data is stored locally, or may go to remote resources where there are available job slots to reduce queue times. Jobs that run on LCG resources must be properly accounted for, so that the resources consumed by VOs and the resources provided by sites (resource centres), as a function of time can be determined. In this paper we distinguish between two flavours of grid accounting; “Grid Job accounting” in which a job usage record provides a complete description of resource consumption and, “Real-time Grid accounting”, which is based on an incremental determination of resource value while the job is being executed. In the former, the cost of computing is determined on the basis of what was done (after job execution), whilst in the latter, data feeds into a pricing model on which a cost for consumption is determined in real time. An implementation of real-time accounting (DGAS [2]) is under development within the gLite [3] middleware framework of the EGEE [4] grid-computing project. Below we summarise the implementation of a web-based job accounting tool that collects usage records from distributed resources using R-GMA [5] to a central point, and consolidates the information for presentation on the web. 2. Data Collection Mechanism and