Using the Jefferson Lab Knights Landing Cluster

Wed, 08/31/2016 - 10:06 — bjoo



Using the Jefferson Lab Knights Landing Cluster

This page describes the Jefferson Lab Knights Landing Cluster

    Tape Scheduling

    Mon, 05/02/2016 - 10:25 — larrieu


    Workflow - Swif - will be decommissioned on March 1st

    Fri, 04/03/2015 - 13:18 — larrieu

    What is Swif?

    Swif, the" scientific workflow indefatigable factotum", is a system that aims to simplify the use of Jefferson Lab's batch system.  As the name implies, it will work tirelessly on your behalf so that that you need not expend unnecessary effort to make good use of the compute farm.

    The goal of this initial release is to provide some features that are lacking in Auger.  While future versions of Swif may bypass Auger entirely, the current version functions as a middleman between you and Auger, providing the following enhanced capabilities:

    jcache

    Thu, 04/02/2015 - 15:19 — ychen

    Name

    jcache - manage files and directories on the write-through cache area

     

    FAQ

    Thu, 04/02/2015 - 14:04 — ychen

    What changes are needed  to a jsub script when the job stages files to the write-through cache system?

    Best Practices

    Fri, 02/20/2015 - 13:56 — ychen
    1. Try to submit multi-threaded jobs when possible. Using a multi-threaded job can save memory foot-print of the job and may increase the performance of the job.
    2. Let Auger manage the input and output files. Do not call jget/jput from the farm job. If jget/jput is called inside one's job, the time period which the job waits for the tape I/O to finish is counted toward the wall time of this job. Note: jget and jput inside Auger will be disabled in the near future.

    DAQ Support: Writing Raw Data to Tape

    Mon, 12/15/2014 - 10:57 — watson
    All raw data from the experimental physics detectors goes through a number of steps to reach permanent storage on tape:
    1. The DAQ system assembles events and writes them into a raw data file on a local staging area.  This area is large enough to hold a minimum of 24 hours of high rate running.

    jobinfo

    Thu, 10/02/2014 - 11:57 — ychen

    Name
        jobinfo - displays     detailed information about a job (including completed jobs).
      
    Syntax
        jobinfo auger-job-index

    Description
           Display a full status of a farm job. The result is obtained from batch system if job is in pending or active state, or finished within few days. Otherwise display the job information retrieved from auger database.


    Access to Remote Git Repositories

    Mon, 03/10/2014 - 11:16 — bjoo

    Access to Remote Git Repositories

    We allow interactive access to off-site Git repositories. Since these can come in as either SSH traffic or HTTPS traffic,
    we allow them only on an as needed basis. We currently allow:

    SSH Based Access

    SSH access to both these repositories should proceed as normal. There is no need for tunneling.

    To enable pushing via https to github you have to modify the remote url with the following after cloning:

    Pages

    Powered by Drupal