HPC FAQ - Long Term Storage
Supercomputer documentation is always a work in progress! Please email questions, corrections, or suggestions to the HPC support team at email@example.com as usual. Thanks!
Frequently Asked Questions
- 1. How do I archive my files that are on the cluster?
- 2. Why should I store my files somewhere else?
- 3. Are my files backed up?
You may copy your files any place they will be safe, including your desktop computer, a departmental disk store, or some other research facility. Copies are usually made with the sftp or scp commands.
However, you may want to use our Hierarchical Storage System (HSM), a fast near-line mass storage system available at hsm.uky.edu. Files transferred to HSM are moved off onto a tape robot where they can be recalled in just a few seconds. To set up an HSM account, please contact the IT Service Desk by calling 859-218-HELP (859-218-4357) or emailing firstname.lastname@example.org. For more information on HSM see Data Storage Information.
Note: You are responsible for the safety and integrity of your own files, wherever they are.
There are many reasons, but here are a few:
- You might want to keep the files after you leave the University.
- The quota on your home directory will not let you keep everything there. Large files that won't be used for a while can be moved somewhere else.
- Your scratch directory not backed up. Make a copy of any scratch file that can't be easily recreated.
- Scratch files may be purged after 30 days. (There is no such limit on your home directory.)
- Moving inactive files off the cluster will keep them available, but make it unlikely they will be accidentally altered or destroyed by your current work.
Your home directory is backed up nightly. Your scratch directory is not. We strongly recommend that you make copies of any important files in your scratch directory and keep them elsewhere.