New pages

Jump to navigation Jump to search
New pages
Hide registered users | Hide bots | Show redirects
  • 15:54, 10 May 2024SLURM/Preemption (hist | edit) ‎[2,811 bytes]Seide (talk | contribs) (Created page with "If you are submitting to a partition which is eligible for preemption (e.g. scavenger), you are responsible for making sure that your job can be interrupted/restarted gracefully. Here we are documenting some Slurm behaviors that you can use to determine if your job has been cancelled or preempted. You should be able to take different code paths during startup/shutdown of your jobs based on this information. =Flowchart for job cancellation/preemption= ==Cancellation==...")
  • 15:02, 21 February 2024WebCrawling (hist | edit) ‎[1,545 bytes]Derek (talk | contribs) (Created page with "Web crawling, scraping or otherwise downloading large sets of publicly available information on the Internet should be handled with care. You should always understand if any data you are planning on scraping is publicly available but is still encumbered. Some things that are publicly accessible are still under copyright and are important to understand what restrictions on any data that you crawl from remotely accessible sites. There are a number of different sites tha...")