Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pipeline run breaks when no forced fits are required? #703

Open
ddobie opened this issue Feb 6, 2024 · 0 comments
Open

Pipeline run breaks when no forced fits are required? #703

ddobie opened this issue Feb 6, 2024 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@ddobie
Copy link
Contributor

ddobie commented Feb 6, 2024

https://dev.pipeline.vast-survey.org/piperuns/68/

2024-02-05 23:18:44,445 forced_extraction INFO Starting force extraction step.
2024-02-05 23:18:44,879 forced_extraction DEBUG Min forced sigma dropped 366849 sources
2024-02-05 23:18:45,013 runpipeline ERROR Processing error:
can't multiply sequence by non-int of type 'NoneType'
Traceback (most recent call last):
  File "/usr/src/vast-pipeline/vast-pipeline-add-further-debug-logging/vast_pipeline/management/commands/runpipeline.py", line 340, in run_pipe
    pipeline.process_pipeline(p_run)
  File "/usr/src/vast-pipeline/vast-pipeline-add-further-debug-logging/vast_pipeline/pipeline/main.py", line 277, in process_pipeline
    ) = forced_extraction(
  File "/usr/src/vast-pipeline/vast-pipeline-add-further-debug-logging/vast_pipeline/pipeline/forced_extraction.py", line 608, in forced_extraction
    extr_df = parallel_extraction(
  File "/usr/src/vast-pipeline/vast-pipeline-add-further-debug-logging/vast_pipeline/pipeline/forced_extraction.py", line 373, in parallel_extraction
    db.from_sequence(
  File "/usr/src/vast-pipeline/.venv/vast-pipeline-B4hVHlAK-py3.8/lib/python3.8/site-packages/dask/bag/core.py", line 1774, in from_sequence
    parts = list(partition_all(partition_size, seq))
  File "/usr/src/vast-pipeline/.venv/vast-pipeline-B4hVHlAK-py3.8/lib/python3.8/site-packages/toolz/itertoolz.py", line 723, in partition_all
    args = [iter(seq)] * n
TypeError: can't multiply sequence by non-int of type 'NoneType'

I need to properly investigate, but I suspect the problem is that all of the sources are dropped. This is an edge case that likely originates from a problem with the post-processed data (which is exactly what this run is testing). However, the pipeline should handle it nicely (i.e. check if there's no forced fits required and skip that step).

@ddobie ddobie added the bug Something isn't working label Feb 6, 2024
@ddobie ddobie self-assigned this Feb 6, 2024
@github-actions github-actions bot added this to To do in Pipeline Backlog Feb 6, 2024
@github-actions github-actions bot added this to To do in Nimbus Production Feb 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Development

No branches or pull requests

1 participant