BeeGFS Scratch File System
BeeGFS is a fast parallel file system. “BeeGFS works with lightly weighted, high performant service daemon(s) in the user space over the arbitrated filesystem, such as ext4, xfs, zfs, Hadoop. This allows users to release maximum bandwidths, the higher performance of the hardware realm and delivers network wires speed to the applications.”[1]
Picotte
The BeeGFS scratch filesystem is mounted on all nodes (login, compute) at:
/scratch
This is a symbolic link to /beegfs/scratch
Per-Job Automatically Created BeeGFS TMP Directory
Slurm automatically creates a directory on BeeGFS for every job that runs. That directory is named:
/scratch/$SLURM_JOB_ID
That path is also available in the evironment variable:
$BEEGFS_TMPDIR
At the end of a job, this directory and all its contents is automatically deleted with no possibility of recovery.
Personal Directory
You can create your own directory for short term use (but longer than just single jobs):
[juser@picotte001 ~]$ mkdir /scratch/juser
WARNING
Files in /scratch
are automatically deleted once they are about 45
days old. DO NOT store any data that you intend to retain for the long
term in /scratch
.
References
[1] BeeGFS website