The CLIP lab's cluster compute nodes will be gradually folded into UMIACS' new Nexus cluster beginning on Monday, July 25th, 2022 at 9am in order to further the goal of consolidating all compute nodes in UMIACS onto one common SLURM scheduler.
The Nexus cluster already has a large pool of compute resources made possible through leftover funding for the Brendan Iribe Center. Details on common nodes already in the cluster (Tron partition) can be found here.
As part of the transition, compute nodes will be reinstalled with Red Hat Enterprise Linux 8 (RHEL8) as their operating system. The nodes are currently installed with Red Hat Enterprise Linux 7 (RHEL7) as is. GPU compute nodes' names will also change to be just
clip## for consistency with Nexus' naming scheme. CPU-only compute nodes will fold into the legacy partition and will thus be named
Data stored on the local scratch drives of compute nodes (/scratch0, /scratch1, etc.) will not persist through the reinstalls. Please secure all data in these local scratch drives to a network attached storage location prior to each nodes' move date as listed below.
You may need to re-compile or re-link your applications due to the changes to the underlying operating system libraries. We have tried to maintain a similar set of software in our GNU Modules software trees for both operating systems. However, you may need to let us know if there is something missing after the upgrades.
In addition, the general purpose nodes
context01.umiacs.umd.edu were retired on Tuesday, September 6th, 2022 at 9am. Please use
clipsub01.umiacs.umd.edu (or the
nexusclip submission nodes) for any general purpose CLIP compute needs.
Lastly, /cliphomes directories will be deprecated sometime in the coming year. The Nexus cluster uses /nfshomes directories for home directory storage space. There will be a future announcement about this deprecation that includes a concrete date after the cluster node moves are done or nearly done. /cliphomes will be made read-only once the cluster node moves are done.
Please see the Timeline section below for concrete dates in chronological order.
Please contact staff with any questions or concerns.
The Nexus cluster submission nodes that are allocated to CLIP are
nexusclip01.umiacs.umd.edu. You will need to log onto one of these submission nodes to use the moved compute nodes. Submission from
clipsub01.umiacs.umd.edu will not work.
CLIP users (exclusively) can schedule non-interruptible jobs on the moved GPU-capable nodes by including the
--account=clip submission arguments. To use the moved CPU-only nodes, use the
--partition=legacy submission argument instead (
--account argument optional).
The Quality of Service (QoS) options present on the CLIP SLURM scheduler will not be migrated into the Nexus SLURM scheduler by default. The
huge-long QoS can be used to request resources beyond those available in the universal Nexus QoSes listed here. If you are interested in migrating a QoS from the CLIP scheduler to the Nexus scheduler, please contact staff and we will evaluate the request.
All events are liable to begin as early as 9am US Eastern time on the dates indicated. Each event will be completed within the business week (i.e. Fridays at 5pm).
|July 25th 2022|
|August 1st 2022|
|August 8th 2022|
|August 15th 2022|
|August 22nd 2022|
|September 6th 2022|
|Ongoing||CPU-only compute nodes are moved into Nexus as |
|Fall 2022||Announcement is made about the deprecation of |