Project Management

Starting in May 2015, all cluster resources on Pegasus will be assigned on a project basis instead of a group basis as we have done previously. This method allows us to better support interaction between teams (including data sharing) at the University regardless of what group, school or campus they reside on. Project-based resource allocation also gives researchers the ability to request resources for short-term work as we have removed the Linux user dependencies. A project is defined as a special user group created on the Pegasus cluster for a specific research project, grant, or goal. Cluster resources, including CPU hours and scratch space are then assigned to projects.

If you previously have not had a project on Pegasus, you will start with the shared default project. This default project is assigned limited cluster resources (initially 1,000 cores). While the default project has more than adequate resources for casual use, we strongly recommend that all PIs and faculty members create a project (or projects) for their own use in order to use their allocations fully.

Using your project in computing jobs

In order to run jobs with your project, submit job with your assigned project id using the –P argument to bsub. For example, if you were assigned the project id “abc”, a batch submission from the command line would look like:

$ bsub -P abc < JOB_SCRIPT_NAME

and an interactive submission from the command line would look like:

$ bsub -P abc –Is –XF command

When your job has been submitted successfully, the project and queue information will be printed on the screen.

Job is submitted to <abc> project.

Job <11234> is submitted to default queue <general>.

If that project id does not exist, or the user is not a member of a project, the job will be submitted to the ‘default’ project.

Job is submitted to <default> project.

Job <11234> is submitted to default queue <general>.

Using project scratch space

Project scratch space is located under /projects/scratch/PROJECT_NAME. Project members have read and write access to this space. All user data under project space share a common quota assigned to project. Projects typically have larger quotas than individual requests.

Create new project

Any PI or faculty member can create a new project by clicking the ‘Projects‘ link on your HPC portal page located at http://portal.ccs.miami.edu/portal. Some basic information about the new project is required, including research project scientific justification, and research usage estimate. All project requests that are under normal HPC quota requirements are automatically approved. The CCS allocations committee will review any requests in excess of the standard quota. Once your project has been approved and created you will be sent an email with your new project id and your resource specifics.

Converting a Linux group to a new project

All group leaders can convert an existing group to a project by clicking on the ‘Convert’ link associated with a group in the ‘My Pegasus‘ section on your HPC portal page. Similar to creating a project from scratch, if a project exceeds the standard quota (100,000 CPU hours) the CCS allocations committee will review the request. By converting an existing group to a project, group members become project members automatically.

Update existing project

If you need more resources for your project than you originally thought, the project leader can update the resource requirements on the ‘Update’ link associated with a project located in ‘My Pegasus‘. Once submitted the new cpu hour and/or scratch space size request will be sent to the CCS allocation committee for disposition. Once a decision has been made made, the requestor will receive an email notification with the update.

Please be aware that only a project leader may request more resources. Project members should ask their project leaders to make requests for more resources.

Joining an existing project

Users can click on ‘List‘ under ‘Projects’ on the Forms and Access section of the HPC portal site to review the full list of projects currently registered on the Pegasus cluster. If you are able to locate an appropriate project to join, you should contact the project leader via email to request membership. Both the project leader’s user id and contact email are displayed on List page. The HPC team is not able to approve project membership due to system security.

Update project members

The project leader manages all project membership. Project leaders can manage their projects on the ‘Projects‘ page under ‘My Pegasus’ tab on HPC portal. On this page, members can be added or removed from a project.

Important Notes — Project members must belong to at least one group. If a project member needs to be removed from all projects (in case of graduation, separation, etc.), please contact the HPC helpdesk at hpc@ccs.miami.edu for assistance. The easiest way to submit help requests to HPC helpdesk is by using the contact form at the bottom left of any page on this portal site.

An inactive user cannot be added to project. User has to request HPC administrator to activate account first.