UMIACS Servers: Difference between revisions

UMIACS Servers (view source)

166 bytes removed , 15 June 2023

5,336

edits

@@ Line 231: / Line 231: @@
 ==Copying Files==
-There are 3 ways that I copy files to the scratch drives:
+There are 3 ways that I use to copy files:
-* For small files, you can copy to your home directory under <code>/nfshomes/</code> via SFTP to mbrcsub00. I rarely do this because the home directory is only a few gigs.
+* For small files, you can copy to your home directory under <code>/nfshomes/</code> via SFTP to the submission node. I rarely do this because the home directory is only a few gigs.
-* For large files, I typically use [[rclone]] to copy to my terpmail Google Drive and then copy back to the scratch drives with a cpu-only job. Do not do this with thousands of small files; it will take forever since Google Drive has a limit on files per second. Also note that Google Drive has a daily limit of 750GB in transfers.
+* For large files and folder, I typically use [[rclone]] to copy to the cloud and then copy back to the scratch drives with a cpu-only job.
-* For mounting, I have a convoluted system where I start SSHD in a job and port forward the SSH port to my local PC. See above for more details.
+** You can store project files on Google Drive or the UMIACS object storage.
+** Note that Google Drive has a limit on files per second and a daily limit of 750GB in transfers.