.. _cs-site: Resources / Sites - Subsections =============================== In this section each DIRAC site available for the users is described. The convention to name the sites consist of 3 strings: - Grid site name, expressed in uppercase, for example: LCG, EELA - Institution acronym in uppercase, for example: CPPM - Country: country where the site is located, expressed in lowercase, for example fr The three strings are concatenated with "." to produce the name of the sites. +------------------------------------+-----------------------------------------------+-----------------------------------+ | **Name** | **Description** | **Example** | +------------------------------------+-----------------------------------------------+-----------------------------------+ | ** | Subsection named with the site name | LCG.CPPM.fr | +------------------------------------+-----------------------------------------------+-----------------------------------+ | */Name* | Site name gave by the site administrator | Name = in2p3 | | | e.g.: the name of the site in GOCDB (optional)| | +------------------------------------+-----------------------------------------------+-----------------------------------+ | */CE* | List of CEs using CE FQN | CE = ce01.in2p3.fr | | | These CEs are updated by the BDII2CSAgent | CE += ce02.in2p3.fr | | | in the CEs section | | +------------------------------------+-----------------------------------------------+-----------------------------------+ | */MoUTierLevel* | Tier Level (optional) | MoUTierLevel = 1 | +------------------------------------+-----------------------------------------------+-----------------------------------+ | */CEs/* | Subsection used to describe each CE available | CEs | +------------------------------------+-----------------------------------------------+-----------------------------------+ | */Coordinates* | Site geographical coordinates (optional) | Coordinates = -8.637979:41.152461 | +------------------------------------+-----------------------------------------------+-----------------------------------+ | */Mail* | Mail address site responsable (optional) | Mail = atsareg@in2p3.fr | +------------------------------------+-----------------------------------------------+-----------------------------------+ | */SE* | Closest SE respect to the CE (optional) | SE = se01.in2p3.fr | +------------------------------------+-----------------------------------------------+-----------------------------------+ CEs sub-subsection ------------------- This sub-subsection specifies the attributes of each particular CE of the site. For each DIRAC site there can be more than one CE. +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | **Name** | **Description** | **Example** | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | ** | Subsection named as the CE fully qualified name | ce01.in2p3.fr | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */architecture* | CE architecture | architecture = x86_64 | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */CEType* | Type of CE, can take values as LCG or CREAM | CEType = ARC | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */LocalCEType* | Type of 'Inner' CE, normally empty. Default = "InProcess". | LocalCEType = Pool | | | Possibilities: potentially all CE types, but in practice | | | | the most valid would be: InProcess, Sudo, Singularity, Pool.| | | | Pool CE in turn uses InProcess (Default) | | | | or Sudo or Singularity. To specify, use Pool/ce_type. | LocalCEType = Pool/Singularity | | | This option can also go at the Queue level. | | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */OS* | CE operating system in a DIRAC format | OS = ScientificLinux_Boron_5.3 | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */Pilot* | Boolean attributes than indicates if the site accept pilots | Pilot = True | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */SubmissionMode* | If the CE is a cream CE the mode of submission | SubmissionMode = Direct | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */wnTmpDir* | Worker node temporal directory | wnTmpDir = /tmp | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */NumberOfProcessors* | Number of available processors on worker nodes | NumberOfProcessors = 12 | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */NumberOfNodes* | Number of available worker nodes per allocation. | NumberOfNodes = 2 | | | Values can be a number (e.g. 2 nodes) or a range of values | | | | (e.g. from 2 to 4 nodes) which lets the choice to the batch | NumberOfNodes = 2 or 2-4 | | | system. | | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */WholeNode* | CE allows *whole node* jobs | WholeNode = True | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */Tag* | List of tags specific for the CE | Tag = GPU,96RAM | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */RequiredTag* | List of required tags that a job to be eligible must have | RequiredTag = GPU,96RAM | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */Queues* | Subsection. Queues available for this VO in the CE | Queues | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */Queues/* | Name of the queue exactly how is published | jobmanager-pbs-formation | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */Queues//CEQueueName* | Name of the queue in the corresponding CE if not the same | | | | as the name of the queue section | CEQueueName = pbs-grid | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */Queues//maxCPUTime* | Maximum time allowed to jobs to run in the queue | maxCPUTime = 1440 | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */Queues//MaxTotalJobs* | If the CE is a CREAM CE the maximum number of jobs in all | MaxTotalJobs =200 | | | the status | | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */Queues//MaxWaitingJobs* | If the CE is a CREAM CE the maximum number of jobs in | MaxWaitingJobs = 70 | | | waiting status | | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */Queues//OutputURL* | If the CE is a CREAM CE the URL where to find the outputs | OutputURL = gsiftp://localhost | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */Queues//SI00* | CE CPU Scaling Reference | SI00 = 2130 | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */Queues//NumberOfProcessors* | overrides */NumberOfProcessors* at queue level | NumberOfProcessors = 12 | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */Queues//NumberOfNodes* | overrides */NumberOfNodes* | NumberOfNodes = 2 | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */Queues//WholeNode* | overrides */WholeNode* at queue level | WholeNode = True | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */Queues//Tag* | List of tags specific for the Queue | Tag = GPU,96RAM | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */Queues//RequiredTag* | List of required tags that a job to be eligible must have | RequiredTag = GPU,96RAM | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ | */Queues//LocalCEType* | Same as */LocalCEType* (see above) but per queue. | LocalCEType = Pool/Singularity | +----------------------------------------------------+-------------------------------------------------------------+--------------------------------+ An example for this session follows:: Sites { LCG { LCG.CERN.cern { SE = CERN-RAW SE += CERN-RDST SE += CERN-USER CE = ce503.cern.ch CE += ce504.cern.ch Name = CERN-PROD Coordinates = 06.0458:46.2325 Mail = grid-cern-prod-admins@cern.ch MoUTierLevel = 0 Description = CERN European Organization for Nuclear Research CEs { ce503.cern.ch { wnTmpDir = . architecture = x86_64 OS = ScientificCERNSLC_Carbon_6.4 SI00 = 0 Pilot = False CEType = HTCondorCE SubmissionMode = Direct Queues { ce503.cern.ch-condor { VO = lhcb VO += LHCb SI00 = 3100 MaxTotalJobs = 5000 MaxWaitingJobs = 200 maxCPUTime = 7776 LocalCEType = Pool/Singularity Tag = MultiProcessor } } VO = lhcb MaxRAM = 0 UseLocalSchedd = False DaysToKeepLogs = 1 } ce504.cern.ch { wnTmpDir = . architecture = x86_64 OS = ScientificCERNSLC_Carbon_6.4 SI00 = 0 Pilot = False CEType = HTCondorCE LocalCEType = Pool SubmissionMode = Direct Queues { ce504.cern.ch-condor { VO = lhcb VO += LHCb SI00 = 3100 MaxTotalJobs = 5000 MaxWaitingJobs = 200 maxCPUTime = 7776 } } } } } } DIRAC { DIRAC.HLTFarm.lhcb { Name = LHCb-HLTFARM CE = OnlineCE.lhcb CEs { OnlineCE.lhcb { CEType = CREAM Queues { OnlineQueue { maxCPUTime = 2880 } } } } AssociatedSEs { Tier1-RDST = CERN-RDST Tier1_MC-DST = CERN_MC-DST-EOS Tier1-Buffer = CERN-BUFFER Tier1-Failover = CERN-EOS-FAILOVER Tier1-BUFFER = CERN-BUFFER Tier1-USER = CERN-USER SE-USER = CERN-USER } } } VAC { VAC.Manchester.uk { Name = UKI-NORTHGRID-MAN-HEP CE = vac01.blackett.manchester.ac.uk CE += vac02.blackett.manchester.ac.uk Coordinates = -2.2302:53.4669 Mail = ops@NOSPAMtier2.hep.manchester.ac.uk CEs { vac01.blackett.manchester.ac.uk { CEType = Vac architecture = x86_64 OS = ScientificSL_Carbon_6.4 wnTmpDir = /scratch SI00 = 2200 MaxCPUTime = 1000 Queues { default { maxCPUTime = 1000 } } } vac02.blackett.manchester.ac.uk { CEType = Vac architecture = x86_64 OS = ScientificSL_Carbon_6.4 wnTmpDir = /scratch SI00 = 2200 MaxCPUTime = 1000 Queues { default { maxCPUTime = 1000 } } } } } } }