OBJ - Revision history

Mbaney at 21:41, 11 December 2025

2025-12-11T21:41:24Z

← Older revision		Revision as of 21:41, 11 December 2025
Line 34:		Line 34:

	= Access Key and Secret Key =		= Access Key and Secret Key =
	You have one or more pairs of Access Keys and Secret Keys that are used as credentials to not expose your ~~password~~ when using the Object Store. These can be obtained by clicking on your [https://obj.umiacs.umd.edu/obj/user/ username] in the upper right-hand corner. You'll use these to identify and authenticate yourself to the Object Store.		You have one or more pairs of Access Keys and Secret Keys that are used as credentials to not expose your UMD passphrase when using the Object Store. These can be obtained by clicking on your [https://obj.umiacs.umd.edu/obj/user/ username] in the upper right-hand corner. You'll use these to identify and authenticate yourself to the Object Store.

	'''Please treat your Secret Key(s) with the same confidentiality as a ~~password~~ and do not plaintext it over email or otherwise or share it with any other individuals.'''		'''Please treat your Secret Key(s) with the same confidentiality as a passphrase and do not plaintext it over email or otherwise or share it with any other individuals.'''

	When using the [https://gitlab.umiacs.umd.edu/staff/umobj/blob/master/README.md#umobj umobj] utilities, you will need to make sure you have added these credentials in your local shell initialization files. There are links to files that have these automatically generated for the 3 most popular UNIX shell families (bash/sh, csh/tcsh, and zsh). Please make sure that whatever file(s) you copy these credentials into can not be read by other users (eg. chmod 600 filename).		When using the [https://gitlab.umiacs.umd.edu/staff/umobj/blob/master/README.md#umobj umobj] utilities, you will need to make sure you have added these credentials in your local shell initialization files. There are links to files that have these automatically generated for the 3 most popular UNIX shell families (bash/sh, csh/tcsh, and zsh). Please make sure that whatever file(s) you copy these credentials into can not be read by other users (eg. chmod 600 filename).

Mbaney at 16:12, 23 September 2025

2025-09-23T16:12:30Z

← Older revision		Revision as of 16:12, 23 September 2025
Line 1:		Line 1:
	= UMIACS Object Store =		= UMIACS Object Store =
	An object store is a web-based storage solution focused on reliability, scalability, and security. It is best suited for public content storage/distribution, archiving data, or secure data sharing between users. Our Object Store can be used through the [https://obj.umiacs.umd.edu/obj web interface], the command line [[UMobj]] utilities, third-party graphical [[S3Clients \| clients]], and even programmatically using many popular programming languages. We support a subset of the Amazon Simple Storage Services [http://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html (S3) API], built around a technology called [http://ceph.com/ Ceph].		An object store is a web-based storage solution focused on reliability, scalability, and security. It is best suited for public content storage/distribution, archiving data, or secure data sharing between users. Our Object Store can be used through the [https://obj.umiacs.umd.edu/obj web interface], the command line [[UMobj]] utilities, third-party graphical [[S3Clients \| clients]], and even programmatically using many popular programming languages. We support a subset of the Amazon Simple Storage Services [http://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html (S3) API], built around a technology called [http://ceph.com/ Ceph].

	All data in our Object Store is stored on hard drives located in a datacenter managed by [[HelpDesk \| UMIACS Staff]].		All data in our Object Store is stored on hard drives located in a datacenter managed by [[HelpDesk \| UMIACS Staff]].
Line 7:		Line 7:
	S3-like storage thinks in terms of buckets and keys. Keys are analogous to files. A bucket is simply a container to a set of keys. There is no actual hierarchy inside of a bucket, but the standard UNIX path separator, a forward slash (/) at the end of a Key name, is interpreted by many clients (including this web site and our UMobj utilities) as being a directory delimiter. This allows you to copy data from your local filesystems to your buckets through umobj or third-party clients. You may specify who has what types of access to your buckets via Access Control Lists (ACLs) at the bucket level or the individual key level.		S3-like storage thinks in terms of buckets and keys. Keys are analogous to files. A bucket is simply a container to a set of keys. There is no actual hierarchy inside of a bucket, but the standard UNIX path separator, a forward slash (/) at the end of a Key name, is interpreted by many clients (including this web site and our UMobj utilities) as being a directory delimiter. This allows you to copy data from your local filesystems to your buckets through umobj or third-party clients. You may specify who has what types of access to your buckets via Access Control Lists (ACLs) at the bucket level or the individual key level.

	Your data is protected from individual machine failure via replication within the cluster. All data is checksummed in accordance with the Amazon S3 protocol to ensure that data in transit is valid before it is accepted by the cluster. However, there are no backups or snapshots of this data in the cluster, so '''if ~~a user deletes~~ a key or bucket in the Object Store, there is no way to restore that information'''.		Your data is protected from individual machine failure via replication within the cluster. All data is checksummed in accordance with the Amazon S3 protocol to ensure that data in transit is valid before it is accepted by the cluster. However, there are no backups or snapshots of this data in the cluster, so '''if you delete a key or bucket in the Object Store, there is no way to restore that information'''.

	= Getting Started =		= Getting Started =
	UMIACS ~~users~~ are allocated 50GB of storage~~. Faculty~~ are allocated 10TB. To get started, [https://obj.umiacs.umd.edu/obj log in] and you will be redirected to the initial help page. You can also find the link from our https://intranet.umiacs.umd.edu site as "OBJbox Object Store".		Non-faculty UMIACS user accounts are allocated 50GB of storage, and faculty accounts are allocated 10TB. To get started, [https://obj.umiacs.umd.edu/obj log in] and you will be redirected to the initial help page. You can also find the link from our https://intranet.umiacs.umd.edu site as "OBJbox Object Store".

	= Buckets =		= Buckets =
Line 34:		Line 34:

	= Access Key and Secret Key =		= Access Key and Secret Key =
	~~Each user has~~ one or more pairs of Access Keys and Secret Keys that are used as ~~a credential~~ to not expose your password when using the Object Store. These can be obtained by clicking on your [https://obj.umiacs.umd.edu/obj/user/ username] in the upper right-hand corner. You'll use these to identify and authenticate yourself to the Object Store.		You have one or more pairs of Access Keys and Secret Keys that are used as credentials to not expose your password when using the Object Store. These can be obtained by clicking on your [https://obj.umiacs.umd.edu/obj/user/ username] in the upper right-hand corner. You'll use these to identify and authenticate yourself to the Object Store.

	'''Please treat your Secret Key(s) with the same confidentiality as a password and do not plaintext it over email or otherwise or share it with any other individuals.'''		'''Please treat your Secret Key(s) with the same confidentiality as a password and do not plaintext it over email or otherwise or share it with any other individuals.'''
Line 43:		Line 43:

	= LabGroups =		= LabGroups =
	LabGroups allow a group of users to share data while avoiding the need for complex ACLs by maintaining group ownership. Designated LabGroup managers can grant granular access (read, write, full control, manager) to buckets owned by the LabGroup. All objects owned by a LabGroup count against the group quota. LabGroups can be navigated using the menu with username in the top right corner of the page. '''Note:''' this will only appear if you are a member of at least one LabGroup. At this point, you can browse the Object Store as the LabGroup and obtain your unique Access Key and Secret Key pair using the instructions above. To switch to another LabGroup or back to your own buckets, click the menu again and select ~~another user~~ or ~~group~~.		LabGroups allow a group of users to share data while avoiding the need for complex ACLs by maintaining group ownership. Designated LabGroup managers can grant granular access (read, write, full control, manager) to buckets owned by the LabGroup. All objects owned by a LabGroup count against the group's quota rather than an individual's. LabGroups can be navigated using the menu with your username in the top right corner of the page. '''Note:''' this will only appear if you are a member of at least one LabGroup. At this point, you can browse the Object Store as the LabGroup and obtain your unique Access Key and Secret Key pair using the instructions above. To switch to another LabGroup or back to your own buckets, click the menu again and select the other group or your username.

	= Managing LabGroups =		= Managing LabGroups =

Mbaney at 20:22, 20 December 2024

2024-12-20T20:22:23Z

← Older revision		Revision as of 20:22, 20 December 2024
Line 1:		Line 1:
	= UMIACS Object Store =		= UMIACS Object Store =
	An object store is a web-based storage solution focused on reliability, scalability, and security. It is best suited for public content storage/distribution, archiving data or secure data sharing between users. Our Object Store can be used through the [https://obj.umiacs.umd.edu/obj web interface], the command line [[UMobj]] utilities, third-party graphical [[S3Clients \| clients]], and even programmatically using many popular programming languages. We support a subset of the Amazon Simple Storage Services [http://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html (S3) API], built around a technology called [http://ceph.com/ Ceph].		An object store is a web-based storage solution focused on reliability, scalability, and security. It is best suited for public content storage/distribution, archiving data, or secure data sharing between users. Our Object Store can be used through the [https://obj.umiacs.umd.edu/obj web interface], the command line [[UMobj]] utilities, third-party graphical [[S3Clients \| clients]], and even programmatically using many popular programming languages. We support a subset of the Amazon Simple Storage Services [http://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html (S3) API], built around a technology called [http://ceph.com/ Ceph].

	All data in our Object Store is stored on hard drives located in a datacenter managed by [[HelpDesk \| UMIACS Staff]].		All data in our Object Store is stored on hard drives located in a datacenter managed by [[HelpDesk \| UMIACS Staff]].

Mbaney at 20:21, 20 December 2024

2024-12-20T20:21:43Z

← Older revision		Revision as of 20:21, 20 December 2024
Line 1:		Line 1:
	= UMIACS Object Store =		= UMIACS Object Store =
	An object store is a web-based storage solution focused on reliability, scalability and security. It is best suited for public content storage/distribution, archiving data or secure data sharing between users. Our Object Store can be used through the [https://obj.umiacs.umd.edu/obj web interface], the command line [[UMobj]] utilities, third-party graphical [[S3Clients \| clients]], and even programmatically using many popular programming languages. We support a subset of the Amazon Simple Storage Services [http://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html (S3) API], built around a technology called [http://ceph.com/ Ceph].		An object store is a web-based storage solution focused on reliability, scalability, and security. It is best suited for public content storage/distribution, archiving data or secure data sharing between users. Our Object Store can be used through the [https://obj.umiacs.umd.edu/obj web interface], the command line [[UMobj]] utilities, third-party graphical [[S3Clients \| clients]], and even programmatically using many popular programming languages. We support a subset of the Amazon Simple Storage Services [http://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html (S3) API], built around a technology called [http://ceph.com/ Ceph].

	All data in our Object Store is stored on hard drives located in a datacenter managed by [[HelpDesk \| UMIACS Staff]].		All data in our Object Store is stored on hard drives located in a datacenter managed by [[HelpDesk \| UMIACS Staff]].

Mbaney at 17:08, 18 October 2024

2024-10-18T17:08:34Z

← Older revision		Revision as of 17:08, 18 October 2024
Line 36:		Line 36:
	Each user has one or more pairs of Access Keys and Secret Keys that are used as a credential to not expose your password when using the Object Store. These can be obtained by clicking on your [https://obj.umiacs.umd.edu/obj/user/ username] in the upper right-hand corner. You'll use these to identify and authenticate yourself to the Object Store.		Each user has one or more pairs of Access Keys and Secret Keys that are used as a credential to not expose your password when using the Object Store. These can be obtained by clicking on your [https://obj.umiacs.umd.edu/obj/user/ username] in the upper right-hand corner. You'll use these to identify and authenticate yourself to the Object Store.

	'''Please treat your Secret Key(s) the same as a password and do not plaintext it over email/otherwise or share it with any other individuals.'''		'''Please treat your Secret Key(s) with the same confidentiality as a password and do not plaintext it over email or otherwise or share it with any other individuals.'''

	When using the [https://gitlab.umiacs.umd.edu/staff/umobj/blob/master/README.md#umobj umobj] utilities, you will need to make sure you have added these credentials in your local shell initialization files. There are links to files that have these automatically generated for the 3 most popular UNIX shell families (bash/sh, csh/tcsh, and zsh). Please make sure that whatever file(s) you copy these credentials into can not be read by other users (eg. chmod 600 filename).		When using the [https://gitlab.umiacs.umd.edu/staff/umobj/blob/master/README.md#umobj umobj] utilities, you will need to make sure you have added these credentials in your local shell initialization files. There are links to files that have these automatically generated for the 3 most popular UNIX shell families (bash/sh, csh/tcsh, and zsh). Please make sure that whatever file(s) you copy these credentials into can not be read by other users (eg. chmod 600 filename).

Mbaney at 16:36, 18 October 2024

2024-10-18T16:36:34Z

← Older revision		Revision as of 16:36, 18 October 2024
Line 2:		Line 2:
	An object store is a web-based storage solution focused on reliability, scalability and security. It is best suited for public content storage/distribution, archiving data or secure data sharing between users. Our Object Store can be used through the [https://obj.umiacs.umd.edu/obj web interface], the command line [[UMobj]] utilities, third-party graphical [[S3Clients \| clients]], and even programmatically using many popular programming languages. We support a subset of the Amazon Simple Storage Services [http://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html (S3) API], built around a technology called [http://ceph.com/ Ceph].		An object store is a web-based storage solution focused on reliability, scalability and security. It is best suited for public content storage/distribution, archiving data or secure data sharing between users. Our Object Store can be used through the [https://obj.umiacs.umd.edu/obj web interface], the command line [[UMobj]] utilities, third-party graphical [[S3Clients \| clients]], and even programmatically using many popular programming languages. We support a subset of the Amazon Simple Storage Services [http://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html (S3) API], built around a technology called [http://ceph.com/ Ceph].

	All data is stored on hard drives located in a datacenter managed by [[HelpDesk \| UMIACS Staff]].		All data in our Object Store is stored on hard drives located in a datacenter managed by [[HelpDesk \| UMIACS Staff]].

	= Terminology =		= Terminology =

Mbaney at 16:30, 18 October 2024

2024-10-18T16:30:03Z

← Older revision		Revision as of 16:30, 18 October 2024
Line 1:		Line 1:
	= UMIACS Object Store =		= UMIACS Object Store =
	An object store is a web-based storage solution focused on reliability, scalability and security. It is best suited for public content storage/distribution, archiving data or secure data sharing between users. Our Object Store can be used through the [https://obj.umiacs.umd.edu/obj web interface], the command line [[UMobj]] utilities, third-party graphical [[S3Clients \| clients]], and even programmatically using many popular programming languages. We support a subset of the Amazon Simple Storage Services [http://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html (S3) API], built around a technology called [http://ceph.com/ Ceph].		An object store is a web-based storage solution focused on reliability, scalability and security. It is best suited for public content storage/distribution, archiving data or secure data sharing between users. Our Object Store can be used through the [https://obj.umiacs.umd.edu/obj web interface], the command line [[UMobj]] utilities, third-party graphical [[S3Clients \| clients]], and even programmatically using many popular programming languages. We support a subset of the Amazon Simple Storage Services [http://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html (S3) API], built around a technology called [http://ceph.com/ Ceph].

			All data is stored on hard drives located in a datacenter managed by [[HelpDesk \| UMIACS Staff]].

	= Terminology =		= Terminology =

Mbaney: /* Clients */

2024-05-10T16:03:20Z

Clients

← Older revision		Revision as of 16:03, 10 May 2024
Line 29:		Line 29:

	= Clients =		= Clients =
	There are several clients that can be used (sometimes with a limited set of features) on your desktop to gain access to the Object Store. All supported UMIACS systems running RHEL8 have a copy of our [https://gitlab.umiacs.umd.edu/staff/umobj/blob/master/README.md#umobj UMobj] utilities which provide command line access to the Object Store. We also have an article in our wiki on [[S3Clients \| third party clients]] that lists and explains the details. These clients need to be configured with your Access and Secret Keys as described below.		There are several clients that can be used (sometimes with a limited set of features) on your desktop to gain access to the Object Store. All supported UMIACS systems running RHEL8 have a copy of our [https://gitlab.umiacs.umd.edu/staff/umobj/blob/master/README.md#umobj UMobj] utilities preinstalled which provide command line access to the Object Store. We also have an article in our wiki on [[S3Clients \| third party clients]] that lists and explains the details. These clients need to be configured with your Access and Secret Keys as described below.

	= Access Key and Secret Key =		= Access Key and Secret Key =

Mbaney at 16:02, 10 May 2024

2024-05-10T16:02:54Z

← Older revision		Revision as of 16:02, 10 May 2024
Line 1:		Line 1:
	= UMIACS Object Store =		= UMIACS Object Store =
	An object store is a web-based storage solution focused on reliability, scalability and security. It is best suited for public content storage/distribution, archiving data or secure data sharing between users. Our Object ~~Storage~~ can be used through the [https://obj.umiacs.umd.edu/obj web interface], the command line [[UMobj]] utilities, third-party graphical [[S3Clients \| clients]], and even programmatically using many popular programming languages. We support a subset of the Amazon Simple Storage Services [http://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html (S3) API], built around a technology called [http://ceph.com/ Ceph].		An object store is a web-based storage solution focused on reliability, scalability and security. It is best suited for public content storage/distribution, archiving data or secure data sharing between users. Our Object Store can be used through the [https://obj.umiacs.umd.edu/obj web interface], the command line [[UMobj]] utilities, third-party graphical [[S3Clients \| clients]], and even programmatically using many popular programming languages. We support a subset of the Amazon Simple Storage Services [http://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html (S3) API], built around a technology called [http://ceph.com/ Ceph].

	= Terminology =		= Terminology =
	S3-like storage thinks in terms of buckets and keys. Keys are analogous to files. A bucket is simply a container to a set of keys. There is no actual hierarchy inside of a bucket, but the standard UNIX path separator, a forward slash (/) at the end of a Key name, is interpreted by many clients (including this web site and our ~~umobj~~ utilities) as being a directory delimiter. This allows you to copy data from your local filesystems to your buckets through umobj or third-party clients. You may specify who has what types of access to your buckets via Access Control Lists (ACLs) at the bucket level or the individual key level.		S3-like storage thinks in terms of buckets and keys. Keys are analogous to files. A bucket is simply a container to a set of keys. There is no actual hierarchy inside of a bucket, but the standard UNIX path separator, a forward slash (/) at the end of a Key name, is interpreted by many clients (including this web site and our UMobj utilities) as being a directory delimiter. This allows you to copy data from your local filesystems to your buckets through umobj or third-party clients. You may specify who has what types of access to your buckets via Access Control Lists (ACLs) at the bucket level or the individual key level.

	Your data is protected from individual machine failure via replication within the cluster. All data is checksummed in accordance with the Amazon S3 protocol to ensure that data in transit is valid before it is accepted by the cluster. However, there are no backups or snapshots of this data in the cluster, so '''if a user deletes a key or bucket in the ~~object store~~, there is no way to restore that information'''.		Your data is protected from individual machine failure via replication within the cluster. All data is checksummed in accordance with the Amazon S3 protocol to ensure that data in transit is valid before it is accepted by the cluster. However, there are no backups or snapshots of this data in the cluster, so '''if a user deletes a key or bucket in the Object Store, there is no way to restore that information'''.

	= Getting Started =		= Getting Started =
Line 18:		Line 18:
	After selecting a bucket, you will be able to create folders and upload files within that bucket. Listed files can be downloaded, deleted, or assigned a specific ACL by the key owner/creator.		After selecting a bucket, you will be able to create folders and upload files within that bucket. Listed files can be downloaded, deleted, or assigned a specific ACL by the key owner/creator.

	'''Please note: Local file system ownership and permissions, and special files (such as symlinks) can not be represented in the ~~object store~~. We highly suggest that if you are securing data into the ~~object store~~ and need these to be faithfully maintained that you use a local archive tool (tar, zip, etc..) to collect the data and then upload the resulting archive file(s).'''		'''Please note: Local file system ownership and permissions, and special files (such as symlinks) can not be represented in the Object Store. We highly suggest that if you are securing data into the Object Store and need these to be faithfully maintained that you use a local archive tool (tar, zip, etc..) to collect the data and then upload the resulting archive file(s).'''

	= Hosting a Website in your Bucket =		= Hosting a Website in your Bucket =
Line 26:		Line 26:
	Within the web interface you can delete files one-by-one. If you want to remove a bunch of files, you will need to use a different client as described below.		Within the web interface you can delete files one-by-one. If you want to remove a bunch of files, you will need to use a different client as described below.

	'''This is dangerous as there are no backups of files in the ~~object store~~. Be careful to only delete the data you intend to delete.'''		'''This is dangerous as there are no backups of files in the Object Store. Be careful to only delete the data you intend to delete.'''

	= Clients =		= Clients =
	There are several clients that can be used (sometimes with a limited set of features) on your desktop to gain access to the Object Store. All supported UMIACS systems have a copy of our [https://gitlab.umiacs.umd.edu/staff/umobj/blob/master/README.md#umobj ~~umobj~~] utilities which provide command line access to the ~~object store~~. We also have an article in our wiki on [[S3Clients \| ~~3rd~~ party clients]] that lists and explains the details. These clients need to be configured with your Access and Secret Keys as described below.		There are several clients that can be used (sometimes with a limited set of features) on your desktop to gain access to the Object Store. All supported UMIACS systems running RHEL8 have a copy of our [https://gitlab.umiacs.umd.edu/staff/umobj/blob/master/README.md#umobj UMobj] utilities which provide command line access to the Object Store. We also have an article in our wiki on [[S3Clients \| third party clients]] that lists and explains the details. These clients need to be configured with your Access and Secret Keys as described below.

	= Access Key and Secret Key =		= Access Key and Secret Key =

Mbaney: /* Access Key and Secret Key */

2024-05-10T15:45:56Z

Access Key and Secret Key

← Older revision		Revision as of 15:45, 10 May 2024
Line 32:		Line 32:

	= Access Key and Secret Key =		= Access Key and Secret Key =
	Each user has one or more pairs of Access Keys and Secret Keys that are used as a credential to not expose your password when using the ~~object store~~. These can be obtained by clicking on your [https://obj.umiacs.umd.edu/obj/user/ username] in the upper right-hand corner. You'll use these to identify and authenticate yourself to the Object Store.		Each user has one or more pairs of Access Keys and Secret Keys that are used as a credential to not expose your password when using the Object Store. These can be obtained by clicking on your [https://obj.umiacs.umd.edu/obj/user/ username] in the upper right-hand corner. You'll use these to identify and authenticate yourself to the Object Store.

			'''Please treat your Secret Key(s) the same as a password and do not plaintext it over email/otherwise or share it with any other individuals.'''

	When using the [https://gitlab.umiacs.umd.edu/staff/umobj/blob/master/README.md#umobj umobj] utilities, you will need to make sure you have added these credentials in your local shell initialization files. There are links to files that have these automatically generated for the 3 most popular UNIX shell families (bash/sh, csh/tcsh, and zsh). Please make sure that whatever file(s) you copy these credentials into can not be read by other users (eg. chmod 600 filename).		When using the [https://gitlab.umiacs.umd.edu/staff/umobj/blob/master/README.md#umobj umobj] utilities, you will need to make sure you have added these credentials in your local shell initialization files. There are links to files that have these automatically generated for the 3 most popular UNIX shell families (bash/sh, csh/tcsh, and zsh). Please make sure that whatever file(s) you copy these credentials into can not be read by other users (eg. chmod 600 filename).