[an error occurred while processing this directive]

Getting Started

 

Getting Started
Access to the LI-red cluster login node using the command-line from any modern workstation is available using secure shell (SSH). In Linux or MacOSX, simply ssh to the Handy login node by issuing the command:

ssh -X username@handy.iacs.stonybrook.edu

If you are using Windows, you will need to use a utility such as PuTTY.

The login node provides an external interface to the Handy compute cluster. The login node is for developing and compiling source code, preparing submission scripts for the batch queue, submitting and monitoring jobs in the batch queue, analyzing results, and moving data. It is NOT appropriate for running computational jobs - to do this use the batch queue. If necessary, interactive batch session can be requested via the "qsub -I" command. 

Storage
On the Handy cluster, data storage is a finite resource. Anticipating that people in the future will need space for their data, we will allot storage space as the demand arises, when requests for storage beyond the default amount are submitted through the OSTicket system: https://iacs.supportsystem.com.

Home Directory
Each user is given 20 GB of disk space for their home directory, which is only accessible by them. This space is backed up. The home directory for user jsmith is /gpfs/home/jsmith.

Scratch
In addition to the home directory, users have access to a scratch file space. This scratch file space is intended to be used when users need to run jobs that produce a large amount of temporary data. However, it is not intended for long-term data storage. For this reason, files older than 30 days will be automatically deleted. The scratch space for the user jsmith is /gpfs/scratch/jsmith. The limit is 20TB/user.

Project space
In addition to the user home space, projects can also request persistent storage which can be shared by all members of the project. Project space for the “Smith Project” can be found in /gpfs/projects/smith.

The default project space is 100GB. A project can ask for up to 5TB of space by submitting a request describing:

  • The size of the data
  • How it will be used/processed (e.g., software, how often it is accessed, bandwidth requirements, etc.)
  • The duration of storage (the high-performance disk on the cluster is expensive and it is a waste of resources for it to be used as an archive)
  • Confirmation that the user understands that this data is not backed up and therefore backing up data and the integrity of the data is the sole responsibility of the user

 Requests for more than 5TB will require more detail and if granted will likely only be satisfied for a specific period of time. 

HIPAA Policy
Handy has not been approved for HIPAA data or any data associated with privacy or liability concerns. Consequently, use of this system to process ePHI or other data that falls under the purview of HIPAA and privacy guidelines is in violation of the act.

Software environment

https://it.stonybrook.edu/help/kb/understanding-li-red-modules

Batch Queue System

https://it.stonybrook.edu/services/high-performance-computing#faq-section-related-9916

 

Queues

Queue Max run time Max # nodes
     
hn-debug 1 hour 4
hn-short 4 hours 8
hn-long 24 hours 8
hn-medium 12 hours 16
hn-large 6 hours 24