How to make a compressed archive of simulation data#

Nek5000 simulations can generate a lot of data files. To reduce the strain in your HPC facility, it is often recommended:

  1. To limit the number of files

  2. Reduce the disk usage

We can achieve both without erasing any data by using Snek5000 and efficient compression tools namely zstandard and preferably bsdtar (usually faster) if not GNU tar. If unavailable some of these can be installed using conda / mamba:

conda install -c conda-forge zstandard tar

Once a simulation is done, you can create the archive using

cd path/to/sim
snek-make archive

The module which does the archiving is described here.