Main Page: Difference between revisions

From Cbcb
Jump to navigation Jump to search
(14 intermediate revisions by 7 users not shown)
Line 1: Line 1:
== CBCB Private Wiki ==
'''You have to be on the UMIACS VPN to view the private wiki if you are not on campus!'''
*[https://wiki.umiacs.umd.edu/cbcb-private/index.php/Main_Page CBCB private wiki]
In addition to this wiki there is also the CBCB private wiki. It contains information internal to CBCB, such as information about how to use the cluster.
== IMPORTANT (Read First) ==
<span style="color: green; font-size: medium; font-weight: bold;">NEW!&nbsp;</span><span style="font-weight: bold">Read about the [[CBCB Software Modules]]</span>
The CBCB computational infrastructure is a shared resource and we all need to pitch in in order to make sure it works well for all of us.  Most importantly, we need to ensure that our disk space and computational resources are used responsibly.  The disk space, in particular, is a valuable commodity and thus it is important to pay attention to the following:
* There are three types of disk space available (a full list of volumes is available at [https://wiki.umiacs.umd.edu/cbcb-private/index.php/Storage CBCB Storage]) :
** Local harddrives (usually mounted as /scratch on the machines that have this resource).  These are not backed up, are quite fast (they live physically close to the processor), but can only be 'seen' by the machine where they are mounted and, thus, require data staging in/out (which can take a while)
** Shared 3Par storage (/fs/szasmg*, /fs/szdata/*, etc.).  This is very fast and very expensive disk and thus a limited resource. Please only use this space to store data temporarily, while you are running some analyses on it.  As a rule of thumb, if a file or collection of files of any considerable size have lived on this space for more than 1-2 weeks, they should probably be moved to the attic space (see below)
** Attic storage (/fs/szattic*).  This is cheaper and ample, but slow and brittle storage.  Your data-sets should primarily live here.  Due to it's brittleness, the IT department do not recommend you run any analyses directly in this volume, rather you copy the files over to a local harddrive or the 3Par instead, and copy the results back when done.
* You should remove any temporary results you don't need in the long term as soon as you've generated them, and compress all of the large files.  Bzip2 works better than gzip but either should dramatically improve the space requirements, especially for text files such as fasta or fastq.
* You should ensure that your files are owned by the cbcb group and that they have group write permissions for any file stored on the 3Par, especially for all those in /fs/szscratch.  This will allow your colleagues to remove files in case the disk runs out of space and you are, for example, on vacation (in which case you shouldn't have any major files sitting around on the 3Par).
For more information on the CBCB resources see [[Getting Started in CBCB]].
== Seminars ==
== Seminars ==
* [http://www.cbcb.umd.edu/seminars Regular CBCB seminars (during academic year)] <br>
* [http://www.cbcb.umd.edu/seminars Regular CBCB seminars (during academic year)] <br>
Line 7: Line 27:


* [[Project:Pop-Lab|Pop-Lab]]
* [[Project:Pop-Lab|Pop-Lab]]
* [[Project:Kingsford-Group|Kingsford Group]]
* [[Project:Hcbravo-lab|HCBravo Lab]]
* [[Project:Cloud-Computing|Cloud Computing]]
* [[Project:Cloud-Computing|Cloud Computing]]
* [[Project:SummerInternships|Summer Internship Projects]]
* [[Project:SummerInternships|Summer Internship Projects]]
* [[Metagenomics Reading Group (Wed 2pm)]]


== People ==
== People ==
Line 15: Line 36:
* [[User:ayres|Daniel Ayres]]
* [[User:ayres|Daniel Ayres]]
* [[User:pknut777|Adam Bazinet]]  
* [[User:pknut777|Adam Bazinet]]  
* [[User:amp|Adam M Phillipy]]
* [[User:irina|Irina Astrovskaya]]  
* [[User:adelcher|Arthur L. Delcher]]
* [[User:carlk|Carl Kinsford]] 
* [[User:dpuiu|Daniela Puiu]]
* [[User:dsommer|Dan Sommer]]
* [[User:gpertea|Geo Pertea]]
* [[User:jeallen|Jonathan Edward All]]
* [[User:ayanbule|Kunmi Ayanbule]]
* [[User:mschatz|Michael Schatz]]
* [[User:jpaulson|Joseph Paulson]]   
* [[User:jpaulson|Joseph Paulson]]   
* [[User:mpertea|Mihaela Pertea]]
* [[User:mpop|Mihai Pop]]  
* [[User:mpop|Mihai Pop]]  
* [[User:nelsayed|Najib El-Sayed]]
* [[User:nelsayed|Najib El-Sayed]]
* [[User:nedwards|Nathan Edwards]]
* [[User:niranjan|Niranjan Nagarajan]]
* [[User:saket|Saket Navlakha]]
* [[User:angiuoli|Samuel V Angluoli]]
* [[User:salzberg|Steven Salzberg]]
* [[User:tgibbons | Ted Gibbons]]
* [[User:whitej|James Robert White]]


== Getting started ==
== Getting started ==
If you have just received a new umiacs account through CBCB, follow the instructions on this page to get the basic information you'll need to start working:<br>
If you have just received a new umiacs account through CBCB, follow the instructions on this page to get the basic information you'll need to start working:<br>
*[[Getting Started in CBCB]]
*[[Getting Started in CBCB]]
*[[CBCB Software Modules]]
*[https://wiki.umiacs.umd.edu/cbcb-private/index.php/Slurm Slurm]
*[https://wiki.umiacs.umd.edu/cbcb-private/index.php/Storage CBCB Storage]
*[https://wiki.umiacs.umd.edu/cbcb-private/index.php/Storage CBCB Storage]
*[https://wiki.umiacs.umd.edu/cbcb-private/index.php/Compute CBCB Computers]
*[https://wiki.umiacs.umd.edu/cbcb-private/index.php/Compute CBCB Computers]
*[[Communal Software]]
*[[Communal Software]]

Revision as of 15:09, 29 August 2019

CBCB Private Wiki

You have to be on the UMIACS VPN to view the private wiki if you are not on campus!

In addition to this wiki there is also the CBCB private wiki. It contains information internal to CBCB, such as information about how to use the cluster.

IMPORTANT (Read First)

NEW! Read about the CBCB Software Modules

The CBCB computational infrastructure is a shared resource and we all need to pitch in in order to make sure it works well for all of us. Most importantly, we need to ensure that our disk space and computational resources are used responsibly. The disk space, in particular, is a valuable commodity and thus it is important to pay attention to the following:

  • There are three types of disk space available (a full list of volumes is available at CBCB Storage) :
    • Local harddrives (usually mounted as /scratch on the machines that have this resource). These are not backed up, are quite fast (they live physically close to the processor), but can only be 'seen' by the machine where they are mounted and, thus, require data staging in/out (which can take a while)
    • Shared 3Par storage (/fs/szasmg*, /fs/szdata/*, etc.). This is very fast and very expensive disk and thus a limited resource. Please only use this space to store data temporarily, while you are running some analyses on it. As a rule of thumb, if a file or collection of files of any considerable size have lived on this space for more than 1-2 weeks, they should probably be moved to the attic space (see below)
    • Attic storage (/fs/szattic*). This is cheaper and ample, but slow and brittle storage. Your data-sets should primarily live here. Due to it's brittleness, the IT department do not recommend you run any analyses directly in this volume, rather you copy the files over to a local harddrive or the 3Par instead, and copy the results back when done.
  • You should remove any temporary results you don't need in the long term as soon as you've generated them, and compress all of the large files. Bzip2 works better than gzip but either should dramatically improve the space requirements, especially for text files such as fasta or fastq.
  • You should ensure that your files are owned by the cbcb group and that they have group write permissions for any file stored on the 3Par, especially for all those in /fs/szscratch. This will allow your colleagues to remove files in case the disk runs out of space and you are, for example, on vacation (in which case you shouldn't have any major files sitting around on the 3Par).

For more information on the CBCB resources see Getting Started in CBCB.


Seminars

Projects

People

Getting started

If you have just received a new umiacs account through CBCB, follow the instructions on this page to get the basic information you'll need to start working: