Open AccessDIRAC pilot framework and the DIRAC Workload Management System
Author(s) -
A Casajus Ramo,
R. Graciani,
S. K. Paterson,
A. Tsaregorodtsev
Publication year - 2010
Publication title -
journal of physics. conference series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.21
H-Index - 85
eISSN - 1742-6596
pISSN - 1742-6588
DOI - 10.1088/1742-6596/219/6/062049
Subject(s) - workload , grid , moment (physics) , homogeneous , scheduling (production processes) , dirac (video compression format) , interface (matter) , computer science , grid computing , set (abstract data type) , distributed computing , engineering , operations management , mathematics , physics , operating system , combinatorics , particle physics , quantum mechanics , geometry , bubble , maximum bubble pressure method , neutrino , programming language
DIRAC Collaboration ; 6 p.International audienceDIRAC, the LHCb community Grid solution, has pioneered the use of pilot jobs in the Grid. Pilot Jobs provide a homogeneous interface to an heterogeneous set of computing resources. At the same time, Pilot Jobs allow to delay the scheduling decision to the last moment, thus taking into account the precise running conditions at the resource and last moment requests to the system. The DIRAC Workload Management System provides one single scheduling mechanism for jobs with very different profiles. To achieve an overall optimisation, it organizes pending jobs in task queues, both for individual users and production activities. Task queues are created with jobs having similar requirements. Following the VO policy a priority is assigned to each task queue. Pilot submission and subsequent job matching are based on these priorities following a statistical approach