Submitting an Auger Job

To submit a job to the farm you need to create a configuration script that describes your job(s). There are two different formats that this configuration file can be in. The first is a flat file format which has been supported for years. The second format is a new XML based format, which allows some additional description.

If you are using the traditional file format you submit your job the way that it has always been done with jsub

ifarml1> jsub <config file>

If you are using the XML file format you also use jsub to submit your job but you need to use the -xml flag.

ifarml1> jsub -xml <XML config file>
  • Simplest Job Submission

This is the simplest configuration file for submitting to Auger.

PROJECT: MyProject
TRACK: MyTrack
JOBNAME: MyJob
COMMAND: ls

The XML version of this script looks like:

<Request>
  <Email email="user@jlab.org" request="false" job="true"/>
  <Project name="MyProject"/>
  <Track name="MyTrack"/>
  <Name name="MyJob"/>
  <Command><![CDATA[
   ls
  ]]></Command>

  <Job>
  </Job>

</Request>
  • Command with Options

This specifies options to the command.

PROJECT: MyProject
TRACK: MyTrack
JOBNAME: MyJob
COMMAND: ls -alF

This could also be written as:

PROJECT: MyProject
TRACK: MyTrack
JOBNAME: MyJob
COMMAND: ls
OPTIONS: -alF

The XML version of this script looks like:

<Request>
  <Email email="user@jlab.org" request="false" job="true"/>
  <Project name="MyProject"/>
  <Track name="MyTrack"/>
  <Name name="MyJob"/>
  <Command><![CDATA[
   ls -alF
  ]]></Command>

  <Job>
  </Job>

</Request>
  • Multiple Commands in Single Job

With the old configuration file format you can only specify a single command. If you want multiple commands you need to put them in a shell script and then execute this shell script.

#!/bin/tcsh
whoami
ls -alF

If the above is named /home/user/multipleCommands.sh the following configuration file will run it.

PROJECT: MyProject
TRACK: MyTrack
JOBNAME: MyJob
COMMAND: multipleCommands.sh
OTHER_FILES: /home/user/multipleCommands.sh

In the XML version, you can just specify the commands directly in your configuration file.

<Request>
  <Email email="user@jlab.org" request="false" job="true"/>
  <Project name="MyProject"/>
  <Track name="MyTrack"/>
  <Name name="MyJob"/>
  <Command><![CDATA[
   whoami
   ls -alF
  ]]></Command>

  <Job>
  </Job>

</Request>
  • Creating Multiple Identical Jobs

This example shows how to submit multiple identical jobs. Note that this will only work if you have 0 or 1 INPUT_FILES specified.

PROJECT: MyProject
TRACK: MyTrack
JOBNAME: MyJob
COMMAND: ls
MULTI_JOBS:6

The XML version of this script looks like this. There is no limitation on files specified in the XML version.

<Request>
  <Email email="user@jlab.org" request="false" job="true"/>
  <Project name="MyProject"/>
  <Track name="MyTrack"/>
  <Name name="MyJob"/>
  <Command><![CDATA[
   ls
  ]]></Command>

  <Job/>   <!-- job 1 -->
  <Job/>   <!-- job 2 -->
  <Job/>   <!-- job 3 -->
  <Job/>   <!-- job 4 -->
  <Job/>   <!-- job 5 -->
  <Job/>   <!-- job 6 -->

</Request>