The CLIP lab's cluster compute nodes will be gradually folded into UMIACS' new Nexus cluster beginning on Monday, July 25th, 2022 at 9am in order to further the goal of consolidating all compute nodes in UMIACS onto one common SLURM scheduler.
The Nexus cluster already has a large pool of compute resources made possible through leftover funding for the Brendan Iribe Center. Details on common nodes already in the cluster (Tron partition) can be found here.
As part of the transition, compute nodes will be reinstalled with Red Hat Enterprise Linux 8 (RHEL8) as their operating system. The nodes are currently installed with Red Hat Enterprise Linux 7 (RHEL7) as is. Their names will also change to be just
clip## for consistency with Nexus' naming scheme.
Data stored on the local scratch drives of compute nodes (/scratch0, /scratch1, etc.) will not persist through the reinstalls. Please secure all data in these local scratch drives to a network attached storage location prior to each nodes' move date as listed below.
You may need to re-compile or re-link your applications due to the changes to the underlying operating system libraries. We have tried to maintain a similar set of software in our GNU Modules software trees for both operating systems. However, you may need to let us know if there is something missing after the upgrades.
In addition, the general purpose nodes
context01.umiacs.umd.edu will be retired on Monday, September 5th, 2022 at 9am. Please use
clipsub01.umiacs.umd.edu (or the
nexusclip submission nodes) for any general purpose CLIP compute needs after this time.
Lastly, /cliphomes directories will be deprecated sometime in the coming year. The Nexus cluster uses /nfshomes directories for home directory storage space. There will be a future announcement about this deprecation that includes a concrete date after the cluster node moves are done or nearly done.
Please see the Timeline section below for concrete dates in chronological order.
Please contact staff with any questions or concerns.
As compute nodes are folded into the Nexus cluster, CLIP users (exclusively) will be able to schedule non-interruptible jobs on the moved nodes by including the
--account=clip submission arguments.
The Quality of Service (QoS) options present on the CLIP SLURM scheduler will not be migrated into the Nexus SLURM scheduler by default. The
huge-long QoS can be used to request resources beyond those available in the universal Nexus QoSes listed here. If you are interested in migrating a QoS from the CLIP scheduler to the Nexus scheduler, please contact staff and we will evaluate the request.
All events are liable to begin as early as 9am US Eastern time on the dates indicated. Each event will be completed by no later than 5pm on the same date.
- July 25th 2022:
clipgpu01are moved into Nexus as
- August 1st 2022:
clipgpu03are moved into Nexus as
- August 8th 2022:
clipgpu05are moved into Nexus as
- August 15th 2022:
materialgpu00are moved into Nexus as
- August 22nd 2022:
materialgpu02are moved into Nexus as
- September 5th 2022:
context01are taken offline
- September 2022: Announcement is made about remaining compute nodes moving into Nexus
- Fall 2022: Announcement is made about the deprecation of