/project Storage

Overview

The /project file system provides users with a collaborative space for data storage and sharing. Members in the same group have access to a shared directory created by the team lead or PI. Group membership can be defined and managed through ITS MyGroups system. /project storage is mounted on the Rivanna HPC cluster and runs on a new scale-out NAS file system.

How to request space in /project

/project storage is available by request (via CADRE User Support page) for $90/TB/YR. When filling out the form, the PI can specify the size of the /project directory and the name of an existing or new MyGroup that can access this space. We recommend choosing a MyGroup name specific to your group or collaboration for the /project directory. This will reduce confusion in the future if you manage multiple MyGroups and directories on other storage systems.

Once the request has been submitted, the PI will receive a notification that the /project space has been provisioned within 24 hours. Once the space becomes available, the PI can grant access to lab members by adding them to the MyGroup. Users in the MyGroup will see the directory (~/project/MyGroup_name) after logging into Rivanna. Addition and removal of users is managed by the PI of the group.

Data transfer to & from /project

Secure Copy (scp)

scp uses secure shell (SSH) protocol to transfer files between your local machine and a remote host. scp can be used with the following syntax:

scp SourceFile mst3k@rivanna.hpc.virginia.edu:/project/MyGroup_name

Detailed instructions and examples for using scp are listed here.

Secure File Transfer Protocol (sftp)

sftp is a network protocol for secure file management. Instructions and examples for using sftp are located here.

Filezilla & Cyberduck

Filezilla and Cyberduck are open source FTP client software for file management through an interactive graphical user interface. Instructions for using these FTP clients can be found here.

Globus Connect (Large Data Transfer)

Globus provides access to data on local machines and Rivanna file systems, as well as external institutions and facilities. Globus is well suited for transferring both small files and large amounts of data. More information on Globus data transfer can be found here).

File manipulation and navigation with /project

/project storage is based on a Linux file system just like other storage spaces on the Rivanna cluster, including /home and /scratch. Users can invoke generic Linux commands to manage files and directories (mv, cp, mkdir), manage permissions (chmod, chown) and navigate the file system (cd, ls, pwd). If you or your collaborators are unfamiliar with some of these commands, we encourage you to take time to review some of the material below:

For more help, please feel free to contact SOMRC to set up a consultation or visit us during office hours. We also provide in-person training opportunities around basic command line skills and more through the CADRE Academy portal.