Skip to content

Corrupted HDF5 auxfiles

The auxfiles/*.h5 seem to be corrupted. I can't open them with any of three different tools --- h5py, h5ls, and the vscode hdf5 viewer. The tools do work with other .h5 files. Git cloning again didn't help. In particular, this makes pytest fail on my laptop.

>>> h5py.File("mbhb_true.h5")
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/ssousa/miniforge3/envs/globalfit/lib/python3.11/site-packages/h5py/_hl/files.py", line 566, in __init__
    fid = make_fid(name, mode, userblock_size, fapl, fcpl, swmr=swmr)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ssousa/miniforge3/envs/globalfit/lib/python3.11/site-packages/h5py/_hl/files.py", line 241, in make_fid
    fid = h5f.open(name, flags, fapl=fapl)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
  File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
  File "h5py/h5f.pyx", line 104, in h5py.h5f.open
OSError: Unable to synchronously open file (file signature not found)
$ h5ls --version
h5ls: Version 1.10.10
$ h5ls -e auxfiles/mbhb_true.h5
auxfiles/mbhb_true.h5: unable to open file
H5tools-DIAG: Error detected in HDF5:tools (1.10.10) thread 1:
  #000: ../../../../tools/lib/h5tools.c line 603 in h5tools_get_fapl(): failed to set VFD on FAPL
    major: Failure in tools library
    minor: error in function
  #001: ../../../../tools/lib/h5tools.c line 560 in h5tools_set_fapl_vfd(): The HDFS VFD is not enabled
    major: Failure in tools library
    minor: error in function
  #002: ../../../../tools/lib/h5tools.c line 603 in h5tools_get_fapl(): failed to set VFD on FAPL
    major: Failure in tools library
    minor: error in function
  #003: ../../../../tools/lib/h5tools.c line 546 in h5tools_set_fapl_vfd(): Read-only S3 VFD info is invalid
    major: Failure in tools library
    minor: error in function
  #004: ../../../../tools/lib/h5tools.c line 603 in h5tools_get_fapl(): failed to set VFD on FAPL
    major: Failure in tools library
    minor: error in function
  #005: ../../../../tools/lib/h5tools.c line 540 in h5tools_set_fapl_vfd(): MPI-I/O VFD is not enabled
    major: Failure in tools library
    minor: error in function
  #006: ../../../../tools/lib/h5tools.c line 770 in h5tools_fopen(): failed to open file using specified FAPL
    major: Failure in tools library
    minor: error in function
  #007: ../../../../tools/lib/h5tools.c line 770 in h5tools_fopen(): failed to open file using specified FAPL
    major: Failure in tools library
    minor: error in function
  #008: ../../../../tools/lib/h5tools.c line 770 in h5tools_fopen(): failed to open file using specified FAPL
    major: Failure in tools library
    minor: error in function
  #009: ../../../../tools/lib/h5tools.c line 770 in h5tools_fopen(): failed to open file using specified FAPL
    major: Failure in tools library
    minor: error in function
  #010: ../../../../tools/lib/h5tools.c line 770 in h5tools_fopen(): 

... (many more lines of pain)