Data Storage

This is a landing page for all topics related to data storage that are available at UMIACS. It is under active development.

Where can I store my data?

Before choosing where to store your data, consider how you need to interact with that data in the short-term and in the long-term, and who you might need to share the data with.

• Local data storage is best suited for data that you are actively working on. Some examples are code that you are using to run computational jobs in SLURM with, results from computational jobs that have already run but have not yet been published in a paper, or unpublished papers that you are frequently editing.

  Data on local storage can be moved between different UMIACS-supported hosts and shared with other UMIACS account holders using common methods such as cp, File Explorer, Finder, and more.

• UMIACS' Object Store is best suited for data that is going to remain static, but needs to remain accessible for very long periods of time, such as data referenced by published papers, or specific versions of data being transferred in and out of UMIACS.

  Data can be moved in and out of the Object Store via its web interface or one of many compatible clients. Data can be shared via simple download links or static websites that can visualize the data in a more accessible way. UMIACS account holders can sponsor Collaborator accounts for external collaborators that may need to upload and download new versions of data without needing direct access to UMIACS-supported hosts.

• CloudDataStorage

How can I transfer my data?

• Rclone
• SCP
• FTP
• Data Transfer

How is my data retained?

• Snapshots
• NightlyBackups
• Archives

What are some data storage best practices?

• Publishing Data