Skip to content

Question about Temporary directory

The run /sps/ztf/users/colley/ppho/run04 directory contents a direction '$TMPDIR' almost empty.

 cca015:run04>ll
total 269K
drwxr-sr-x  8 colley ztf  287 Mar 24 23:19  ..
-rw-r--r--  1 colley ztf 4.1K Mar 24 23:19  field_600_100exp.pruned.txt
-rw-r--r--  1 colley ztf 4.2K Mar 24 23:19  field_600_100exp.txt
-rwxr-xr-x  1 colley ztf  252 Mar 24 23:19  run.sh
-rw-r--r--  1 colley ztf 2.2K Mar 24 23:20  config.yaml
drwxr-sr-x  3 colley ztf   20 Mar 24 23:21 '$TMPDIR'
drwxr-sr-x  5 colley ztf  214 Mar 24 23:24  .
drwxr-sr-x  4 colley ztf   48 Mar 24 23:24  results
drwxr-sr-x 12 colley ztf  262 Mar 24 23:30  .snakemake

creates by snakemake pipeline with profile $ZTFPIX/profiles/ccin2p3 so with SLURM scheduler. The pipeline has the status failed see #14 (closed)

In ztfpix package I can see '$TMPDIR' string https://gitlab.in2p3.fr/mbernard/ztfpix/-/blob/master/profiles/ccin2p3/config.yaml?ref_type=heads#L21 to define keyword 'local-storage-prefix'

but '$TMPDIR' is well know to be set in worker env https://doc.cc.in2p3.fr/fr/Data-storage/storage-areas.html#espaces-de-travail in interactive node (local) TMPDIR isn't set.

1 ) Seems to be typo in profiles/ccin2p3/config.yaml ?

  1. Now something strange, with the same profile but with a pipeline with a status OK, the run directory doesn't content '$TMPDIR'

/sps/ztf/users/colley/ppho/run00

3 ) I think it's possible to define a default value for 'local-storage-prefix'

Thank you for the explanations