Skip to content

BeeGFS Scratch File System

BeeGFS is a fast parallel file system. “BeeGFS works with lightly weighted, high performant service daemon(s) in the user space over the arbitrated filesystem, such as ext4, xfs, zfs, Hadoop. This allows users to release maximum bandwidths, the higher performance of the hardware realm and delivers network wires speed to the applications.”[1]

Picotte

The BeeGFS scratch filesystem is mounted on all nodes (login, compute) at:

/scratch

This is a symbolic link to /beegfs/scratch

Per-Job Automatically Created BeeGFS TMP Directory

Slurm automatically creates a directory on BeeGFS for every job that runs. That directory is named:

/scratch/$SLURM_JOB_ID

That path is also available in the evironment variable:

$BEEGFS_TMPDIR

At the end of a job, this directory and all its contents is automatically deleted with no possibility of recovery.

Personal Directory

You can create your own directory for short term use (but longer than just single jobs):

[juser@picotte001 ~]$ mkdir /scratch/juser

WARNING

Files in /scratch are automatically deleted once they are about 45 days old. DO NOT store any data that you intend to retain for the long term in /scratch.

References

[1] BeeGFS website