Last modified:April 10, 2024

File sharing

Attention

Do not store personally identifiable research data (PID) on the Neuro cluster. The Committee for Protection of Human Subjects (CPHS) requires that PID be secured with encryption, strong passwords, audits, etc. If you accidentally upload PID to the Neuro cluster, remove it immediately and contact support-neuro@berkeley.edu to remove the data from online backups. For more information, see: CPHS Data Security Requirements.

lab members

1. If the data set is small (less than ~10GB), feel free to copy files from another user’s home directory to your home directory/project folder.

2. If the data set is large (more than ~10GB) and temporary, then please create a folder called NotBackedUp anywhere you have write access, and copy the data to that folder. Remember to delete it when you’re finished testing. As the name implies, this data is not backed up. It is considered a temporary storage solution.

3. If you’re sharing a long-term large data set, then please request a project folder. The group who owns the project folder has write/delete access to all files in the project folder. This increases the risk of data loss, so I recommend limiting group membership to people who need regular write access. (If someone rarely adds data, then consider copying files from their home directory). To request a project folder email support-neuro@berkeley.edu. Include the following information:

   • Project name (no spaces, up to 14 characters long). The project name must reflect the type of data or project goals - not a person.
   • List of people who will have permission to modify (and delete) any file in the project folder.

external collaborators

I can create an ftp account to share data with your collaborator(s).

Your collaborator can upload data, or download data that you place in their ftp account.

• Send the preferred login username to support-neuro@berkeley.edu. One ftp account may be shared among many people.

• Collaborators log in with a sftp client to ‘upload.neuro.berkeley.edu’.

• After login, collaborators have write access to a directory called ‘upload’ in their home directory.

  For example, from the command line:

  $ sftp username@upload.neuro.berkeley.edu
  sftp> cd upload
  sftp> put filename

• Uploaded data is located in the /ftp directory on the Neuro cluster. Uploaded data is deleted after 30 days, so copy data to your home directory (or project directory) for long-term storage.