Apptainer - Revision history

Mbaney at 20:50, 5 March 2026

2026-03-05T20:50:44Z

← Older revision		Revision as of 20:50, 5 March 2026
Line 133:		Line 133:

	<pre>		<pre>
	$ apptainer pull pytorch_docker.sif docker://registry.umiacs.umd.edu/~~dyarnell~~/pytorch_docker		$ apptainer pull pytorch_docker.sif docker://registry.umiacs.umd.edu/derek/pytorch_docker
	INFO: Converting OCI blobs to SIF format		INFO: Converting OCI blobs to SIF format
	INFO: Starting build...		INFO: Starting build...

Mbaney at 13:14, 8 October 2025

2025-10-08T13:14:17Z

← Older revision		Revision as of 13:14, 8 October 2025
Line 1:		Line 1:
	[https://apptainer.org Apptainer] is a container platform that doesn't elevate the privileges of a user running the container. This is important as UMIACS runs many multi-tenant hosts (such as [[Nexus]]) and doesn't provide administrative control to users on them. While [https://www.docker.com Docker] is popular, the most typical setups require a daemon that has administrative level privileges that makes it not tenable.		[https://apptainer.org Apptainer] is a container platform that doesn't elevate the privileges of a user running the container. This is important as UMIACS runs many multi-tenant hosts (such as [[Nexus]]) and doesn't provide administrative control to users on them. While [https://www.docker.com Docker] is popular, the most typical setups require a daemon that has administrative level privileges that makes it not tenable.

	'''Apptainer was previously branded as Singularity. You should still be able to run commands on the system with <code>singularity</code>, however please begin using the <code>apptainer</code> command ~~when~~ possible. We are not sure when use of the <code>singularity</code> command will be removed.'''		'''Apptainer was previously branded as Singularity. You should still be able to run commands on the system with <code>singularity</code>, however please begin using the <code>apptainer</code> command where possible. We are not sure when use of the <code>singularity</code> command will be removed.'''

	==Overview==		==Overview==

Mbaney at 13:14, 8 October 2025

2025-10-08T13:14:06Z

← Older revision		Revision as of 13:14, 8 October 2025
Line 1:		Line 1:
	[https://apptainer.org Apptainer] is a container platform that doesn't elevate the privileges of a user running the container. This is important as UMIACS runs many multi-tenant hosts (such as [[Nexus]]) and doesn't provide administrative control to users on them. While [https://www.docker.com Docker] is popular, the most typical setups require a daemon that has administrative level privileges that makes it not tenable.		[https://apptainer.org Apptainer] is a container platform that doesn't elevate the privileges of a user running the container. This is important as UMIACS runs many multi-tenant hosts (such as [[Nexus]]) and doesn't provide administrative control to users on them. While [https://www.docker.com Docker] is popular, the most typical setups require a daemon that has administrative level privileges that makes it not tenable.

	'''Apptainer was previously branded as Singularity. You should still be able to run commands on the system with <code>singularity</code>, however ~~you should start migrating to~~ using the <code>apptainer</code> command.'''		'''Apptainer was previously branded as Singularity. You should still be able to run commands on the system with <code>singularity</code>, however please begin using the <code>apptainer</code> command when possible. We are not sure when use of the <code>singularity</code> command will be removed.'''

	==Overview==		==Overview==

Mbaney at 17:53, 31 March 2025

2025-03-31T17:53:16Z

← Older revision		Revision as of 17:53, 31 March 2025
Line 73:		Line 73:

	==Nexus Containers==		==Nexus Containers==
	In our [[Nexus]] environment we have some example containers based on our [https://gitlab.umiacs.umd.edu/~~derek~~/pytorch_docker pytorch_docker] project. These can be found in <code>/fs/nexus-containers/pytorch</code>.		In our [[Nexus]] environment we have some example containers based on our [https://gitlab.umiacs.umd.edu/dyarnell/pytorch_docker pytorch_docker] project. These can be found in <code>/fs/nexus-containers/pytorch</code>.

	You can just run one of the example images by doing the following (you should have already allocated a interactive job with a GPU in [[Nexus]]). It will use the default [https://gitlab.umiacs.umd.edu/~~derek~~/pytorch_docker/-/blob/master/tensor.py script] found at <code>/srv/tensor.py</code> within the image.		You can just run one of the example images by doing the following (you should have already allocated a interactive job with a GPU in [[Nexus]]). It will use the default [https://gitlab.umiacs.umd.edu/dyarnell/pytorch_docker/-/blob/master/tensor.py script] found at <code>/srv/tensor.py</code> within the image.

	<pre>		<pre>
Line 126:		Line 126:

	==Docker Workflow Example==		==Docker Workflow Example==
	We have a [https://gitlab.umiacs.umd.edu/~~derek~~/pytorch_docker pytorch_docker] example workflow using our [[GitLab]] as a Docker registry. You can clone the repository and further customize this to your needs. The workflow is:		We have a [https://gitlab.umiacs.umd.edu/dyarnell/pytorch_docker pytorch_docker] example workflow using our [[GitLab]] as a Docker registry. You can clone the repository and further customize this to your needs. The workflow is:

	# Run Docker on a laptop or personal desktop on to create the image, or use [[Podman]] on a UMIACS-supported system.		# Run Docker on a laptop or personal desktop on to create the image, or use [[Podman]] on a UMIACS-supported system.
Line 133:		Line 133:

	<pre>		<pre>
	$ apptainer pull pytorch_docker.sif docker://registry.umiacs.umd.edu/~~derek~~/pytorch_docker		$ apptainer pull pytorch_docker.sif docker://registry.umiacs.umd.edu/dyarnell/pytorch_docker
	INFO: Converting OCI blobs to SIF format		INFO: Converting OCI blobs to SIF format
	INFO: Starting build...		INFO: Starting build...

Mbaney: /* Docker Workflow Example */

2024-08-13T17:51:47Z

Docker Workflow Example

← Older revision		Revision as of 17:51, 13 August 2024
Line 128:		Line 128:
	We have a [https://gitlab.umiacs.umd.edu/derek/pytorch_docker pytorch_docker] example workflow using our [[GitLab]] as a Docker registry. You can clone the repository and further customize this to your needs. The workflow is:		We have a [https://gitlab.umiacs.umd.edu/derek/pytorch_docker pytorch_docker] example workflow using our [[GitLab]] as a Docker registry. You can clone the repository and further customize this to your needs. The workflow is:

	# Run Docker on a laptop or personal desktop on to create the image.		# Run Docker on a laptop or personal desktop on to create the image, or use [[Podman]] on a UMIACS-supported system.
	# Tag the image and and push it to your repository (this can be any docker registry)		# Tag the image and and push it to your repository (this can be any docker registry)
	# Pull the image down onto one of our workstations/clusters and run it with your data.		# Pull the image down onto one of our workstations/clusters and run it with your data.

Mbaney: /* Bind Mounts */

2024-08-13T17:51:03Z

Bind Mounts

← Older revision		Revision as of 17:51, 13 August 2024
Line 112:		Line 112:
	<code>--bind /fs/nexus-scratch/<USERNAME>/<PROJECTNAME>:/mnt</code>		<code>--bind /fs/nexus-scratch/<USERNAME>/<PROJECTNAME>:/mnt</code>

	In this example we will exec an interactive session binding our [[Nexus]] scratch directory which allows us to specify the command we want to run inside the container.		In this example, we will exec an interactive session with GPUs and binding our [[Nexus]] scratch directory which allows us to specify the command we want to run inside the container.

	<pre>		<pre>
Line 121:		Line 121:

	<span id="Sif_anchor"></span>		<span id="Sif_anchor"></span>

	===Shared Containers===		===Shared Containers===
	Portable images called '''Singularity Image Format''' or .sif files can be copied and shared. Nexus maintains some shared containers in <code>/fs/nexus-containers</code>. These are arranged by the application(s) that are installed.		Portable images called '''Singularity Image Format''' or .sif files can be copied and shared. Nexus maintains some shared containers in <code>/fs/nexus-containers</code>. These are arranged by the application(s) that are installed.

Mbaney at 17:49, 13 August 2024

2024-08-13T17:49:34Z

← Older revision		Revision as of 17:49, 13 August 2024
Line 1:		Line 1:
	[https://apptainer.org Apptainer] is a container platform that doesn't elevate the privileges of a user running the container. This is important as UMIACS runs many multi-tenant hosts (such as [[Nexus]]) and doesn't provide administrative control to users on them. While Docker is popular, the most typical setups require a daemon that has administrative level privileges that makes it not tenable.		[https://apptainer.org Apptainer] is a container platform that doesn't elevate the privileges of a user running the container. This is important as UMIACS runs many multi-tenant hosts (such as [[Nexus]]) and doesn't provide administrative control to users on them. While [https://www.docker.com Docker] is popular, the most typical setups require a daemon that has administrative level privileges that makes it not tenable.

	'''Apptainer was previously branded as Singularity. You should still be able to run commands on the system with <code>singularity</code>, however you should start migrating to using the <code>apptainer</code> command.'''		'''Apptainer was previously branded as Singularity. You should still be able to run commands on the system with <code>singularity</code>, however you should start migrating to using the <code>apptainer</code> command.'''

Mbaney at 17:47, 13 August 2024

2024-08-13T17:47:30Z

← Older revision		Revision as of 17:47, 13 August 2024
Line 1:		Line 1:
	[https://apptainer.org Apptainer] is a container platform that doesn't elevate the privileges of a user running the container. This is important as UMIACS runs many multi-tenant hosts (such as [[Nexus]]) and doesn't provide administrative control to users on them.		[https://apptainer.org Apptainer] is a container platform that doesn't elevate the privileges of a user running the container. This is important as UMIACS runs many multi-tenant hosts (such as [[Nexus]]) and doesn't provide administrative control to users on them. While Docker is popular, the most typical setups require a daemon that has administrative level privileges that makes it not tenable.

	'''Apptainer was previously branded as Singularity. You should still be able to run commands on the system with <code>singularity</code>, however you should start migrating to using the <code>apptainer</code> command.'''		'''Apptainer was previously branded as Singularity. You should still be able to run commands on the system with <code>singularity</code>, however you should start migrating to using the <code>apptainer</code> command.'''

Chrissor at 14:28, 26 June 2024

2024-06-26T14:28:00Z

← Older revision		Revision as of 14:28, 26 June 2024
Line 23:		Line 23:


	We do suggest you pull images down into an intermediate file ('''~~[[Apptainer#Sif_anchor \|~~ SIF]]''' file) as you then do not have to worry about re-caching the image.		We do suggest you pull images down into an intermediate file ('''SIF''' file) as you then do not have to worry about re-caching the image.
	<pre>		<pre>
	$ apptainer pull cuda12.2.2.sif docker://nvidia/cuda:12.2.2-base-ubi8		$ apptainer pull cuda12.2.2.sif docker://nvidia/cuda:12.2.2-base-ubi8

Chrissor at 14:26, 26 June 2024

2024-06-26T14:26:48Z

← Older revision		Revision as of 14:26, 26 June 2024
Line 120:		Line 120:
	You can now write/run your own pytorch python code interactively within the container or just make a python script that you can call directly from the apptainer exec command for batch processing.		You can now write/run your own pytorch python code interactively within the container or just make a python script that you can call directly from the apptainer exec command for batch processing.

			<span id="Sif_anchor"></span>
	===Shared Containers===		===Shared Containers===
	~~<span id="Sif_anchor"></span>~~
	Portable images called '''Singularity Image Format''' or .sif files can be copied and shared. Nexus maintains some shared containers in <code>/fs/nexus-containers</code>. These are arranged by the application(s) that are installed.		Portable images called '''Singularity Image Format''' or .sif files can be copied and shared. Nexus maintains some shared containers in <code>/fs/nexus-containers</code>. These are arranged by the application(s) that are installed.