C2PAP Batch system

From Etp
Jump to: navigation, search

C2PAP uses the IBM LoadLeveler Batch System (as SuperMuc) which is specially suited for many kinds of parallel applications. But it also supports simple serial jobs. Detailed examples are given at C2PAP Wiki and LRZ LoadLeveler Doku.

A simple serial job example including Cvmfs/Root setup:

#!/bin/bash
#
#@ job_name = RootStress-$(jobid)
#@ group=pr58be
#@ wall_clock_limit=15:55:50
#@ job_type = serial
#@ class = serial
#@ node_usage = shared
#@ resources = ConsumableCpus(1)
#@ notification = error
#@ notify_user = <your-mail>@lmu.de
#@ output =  $(home)/log/$(jobid).out
#@ error  =  $(home)/log/$(jobid).err
#@ initialdir = $(home)
#@ queue
# local profiles
. /etc/profile
. /etc/profile.d/modules.sh
# setup frontier, libcrypto, etc
source /gpfs/work/pr58be/arc/runtime/APPS/HEP/ATLAS-SITE
# CVMFS
export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase
source ${ATLAS_LOCAL_ROOT_BASE}/user/atlasLocalSetup.sh
# cvmfs root setup
localSetupROOT 
# build & run Root stress test
tmpdir=`mktemp -d`
cd $tmpdir
cp -a $ROOTSYS/test/* .
make stress
./stress -b 
cd
rm -rf $tmpdir

Lines starting with #@ are directives for LoadLeveler

  • put in your email address after #@ notify_user =
  • adjust output and error logfile names
  • starting directory (#@ initialdir =)
  • wall-clock time limit
  • ... see LRZ LoadLeveler Doku.

Submit job script via

llsubmit runRootstress.job

Check running jobs:

# all jobs
llq 
# specific job, in detail
llq -l -j xcat.5296518