Revision as of 18:43, 11 July 2022 by Derek (talk | contribs)
Jump to navigation Jump to search

The GAMMA lab has a partition of GPU nodes available in the Nexus which are only available to GAMMA lab members.

Quality of Service

The following QoS are available to this partition. Please run the show_qos command to show the limits for these QoS.

  • default
  • medium
  • high
  • huge-long


Nodenames Type Quantity CPUs Memory GPUs
gammagpu[01-03] A5000 GPU Node 3 32 256GB 8
Total 3 96 768GB 24


Other than the default Nexus storage allocation(s) Gamma has elected to have a 20TB NVMe scratch file system on the host as /scratch1. To utilize this space users will need to copy data from/to this over SSH from a compute node. This file system is not available over NFS.


From you can run the following example to submit job(s).

$ srun --pty --gres=gpu:8 --account=gamma --partition=gamma --qos=huge-long bash
$ hostname
$ nvidia-smi -L
GPU 0: NVIDIA RTX A5000 (UUID: GPU-cdfb2e0c-d69f-354b-02f4-15161dc7fa66)
GPU 1: NVIDIA RTX A5000 (UUID: GPU-be53e7a1-b8fd-7089-3cac-7a2fbf4ec7dd)
GPU 2: NVIDIA RTX A5000 (UUID: GPU-774efbb1-d7ec-a0bb-e992-da9d1fa6b193)
GPU 3: NVIDIA RTX A5000 (UUID: GPU-d1692181-c7de-e273-5f95-53ad381614c3)
GPU 4: NVIDIA RTX A5000 (UUID: GPU-ba51fd6c-37bf-1b95-5f68-987c18a6292a)
GPU 5: NVIDIA RTX A5000 (UUID: GPU-c1224a2a-4a3b-ff16-0308-4f36205b9859)
GPU 6: NVIDIA RTX A5000 (UUID: GPU-8d20d6cd-abf5-2630-ab88-6bba438c55fe)
GPU 7: NVIDIA RTX A5000 (UUID: GPU-93170910-5d94-6da5-8a24-f561d7da1e2d)