Skip to content

TODO before running the scenemodeling pipeline on minipatch SNs

To fix after the run

  • write some test
  • save logs/poloka and logs/smphot_stars (maybe as zipped file)
  • [INFO] [scenemodeling] pipeline took 3.1e+03s fix that
  • fix that
    [ERROR] [scenemodeling] Traceback (most recent call last):
    [ERROR] [scenemodeling]   File "/sps/ztf/users/mbernard/ztfpix/src/ztfpix/pipelines/scenemodeling/pipeline.py", line 75, in process
    [ERROR] [scenemodeling]     result = self._process(sn)
    [ERROR] [scenemodeling]              ^^^^^^^^^^^^^^^^^
    [ERROR] [scenemodeling]   File "/sps/ztf/users/mbernard/ztfpix/src/ztfpix/pipelines/scenemodeling/pipeline.py", line 107, in _process
    [ERROR] [scenemodeling]     quadrants_df, quadrants_res = self._process_quadrants(sn, tempdir)
    [ERROR] [scenemodeling]                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    [ERROR] [scenemodeling]   File "/sps/ztf/users/mbernard/ztfpix/src/ztfpix/pipelines/scenemodeling/ pipeline.py", line 246, in _process_quadrants
    [ERROR] [scenemodeling]     results = {QuadrantFilename(q): f.result() for q, f in future.items()}
    [ERROR] [scenemodeling]                                     ^^^^^^^^^^
    [ERROR] [scenemodeling]   File "/sps/ztf/users/mbernard/ztfpix/.pixi/envs/default/lib/python3.12/concurrent/futures/_base.py", line 449, in result
    [ERROR] [scenemodeling]     return self.__get_result()
    [ERROR] [scenemodeling]            ^^^^^^^^^^^^^^^^^^^
    [ERROR] [scenemodeling]   File "/sps/ztf/users/mbernard/ztfpix/.pixi/envs/default/lib/python3.12/concurrent/futures/_base.py", line 401, in __get_result
    [ERROR] [scenemodeling]     raise self._exception
    [ERROR] [scenemodeling] concurrent.futures.process.BrokenProcessPool: A process in the process pool was terminated abruptly while the future was running or pending.
  • add the amount of memory (RSS) consumed by makepsf in the output status (quadrants.csv)
  • something else?
Edited by Mathieu Bernard