Jobsub servers upgrade to jobsub 1.3 and SL7 starting Friday, Oct. 11

Dear Jobsub users,

WHAT ARE WE DOING?
Computing will be upgrading the production jobsub servers (fifebatch.fnal.gov) to jobsub 1.3.  During this upgrade, we will be adding a third jobsub server (jobsub03.fnal.gov), upgrading all three servers to Scientific Linux 7 (SL7), and then marking jobsub_client 1.3 as “current” in UPS (Unix Product Support).

This upgrade will be done in two phases.  During the first phase, jobsub03 will be added to the cluster. During the second phase, jobsub01 and jobsub02 will each be drained, upgraded, and added back to the cluster.  At the end of the upgrade, jobsub_client 1.3 will be marked as “current” in UPS; when that happens, a separate email will be sent to notify users of that change.

Users can view the release notes of jobsub 1.3 at: https://cdcvs.fnal.gov/redmine/projects/jobsub/repository/revisions/v1.3/entry/doc/release.notes

WHEN WILL THIS OCCUR?
The upgrade will start on Friday, Oct. 11, 2019 and will take about 1.5 to 2 weeks to complete.

WHAT IS THE IMPACT TO YOU?
• The jobsub_client marked current now, namely jobsub 1.2.10, will work with jobsub server 1.3 (this has been extensively tested).  As such, we anticipate no issues regarding different client/server versions during the upgrade process.
• During the upgrade, we expect all jobs currently running on any draining jobsub server to finish without issues.  New job submission requests will be redirected to the other two servers.
• New features will be available after all servers are upgraded and jobsub_client 1.3 is set to “current” in UPS.  These new features will be highlighted in a separate message to users.

WHAT DO YOU NEED TO DO?
We highly encourage all Jobsub users to test their workflows against jobsub 1.3. To do so, users will need to submit jobs to jobsubdevgpvm01.fnal.gov using the following commands:
source /cvmfs/fermilab.opensciencegrid.org/products/common/etc/setups.sh
setup -t jobsub_client
jobsub_submit -G <experiment> <args> –jobsub-server=jobsubdevgpvm01.fnal.gov file:///path/to/script <script_args>

If you encounter any issues, please contact the Service Desk.