5,337
edits
UMIACS Servers: Difference between revisions
→Copying Files
No edit summary |
|||
| Line 193: | Line 193: | ||
There are 3 ways that I copy files to the scratch drives: | There are 3 ways that I copy files to the scratch drives: | ||
* For small files, you can copy to your home directory under <code>/nfshomes/</code> via SFTP to mbrcsub00. I rarely do this because the home directory is only a few gigs. | * For small files, you can copy to your home directory under <code>/nfshomes/</code> via SFTP to mbrcsub00. I rarely do this because the home directory is only a few gigs. | ||
* For large files, I typically use | * For large files, I typically use [[rclone]] to copy to my terpmail Google Drive and then copy back to the scratch drives with a cpu-only job. Do not do this with thousands of small files; it will take forever since Google Drive has a limit on files per second. Also note that Google Drive has a daily limit of 750GB in transfers. | ||
* For mounting, I have a convoluted system where I start SSHD in a job and port forward the SSH port to my local PC | * For mounting, I have a convoluted system where I start SSHD in a job and port forward the SSH port to my local PC. See above for more details. | ||