Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

skip empty groups in new sources groupby-apply #632

Merged
merged 2 commits into from
Feb 23, 2022

Conversation

marxide
Copy link
Contributor

@marxide marxide commented Feb 23, 2022

Fixes #631

@marxide marxide self-assigned this Feb 23, 2022
@github-actions github-actions bot added this to In progress in Pipeline Backlog Feb 23, 2022
@marxide marxide marked this pull request as ready for review February 23, 2022 20:38
@marxide marxide force-pushed the iss-631-groupby-apply-indexerror branch from 7b7b8f4 to cfb7fab Compare February 23, 2022 22:30
@marxide
Copy link
Contributor Author

marxide commented Feb 23, 2022

Will rebase this on dev once #634 is merged. For now, this PR includes the commits from #634 so the tests can run.

@marxide marxide added bug Something isn't working python Pull requests that update Python code labels Feb 23, 2022
@github-actions github-actions bot added this to In progress in Nimbus Production Feb 23, 2022
@@ -79,6 +79,9 @@ def get_image_rms_measurements(
The group dataframe with the 'img_diff_true_rms' column added. The
column will contain 'NaN' entires for sources that fail.
"""
if len(group) == 0:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does group have a .empty flag like the dataframes?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, they appear to be Pandas DataFrames within that function. As far as I can tell, len(df) == 0 and df.empty are equivalent in this case.

Pipeline Backlog automation moved this from In progress to Reviewer approved Feb 23, 2022
Nimbus Production automation moved this from In progress to Reviewer approved Feb 23, 2022
@marxide marxide force-pushed the iss-631-groupby-apply-indexerror branch from cfb7fab to ba02eb8 Compare February 23, 2022 23:06
@marxide marxide merged commit 89678b9 into dev Feb 23, 2022
Pipeline Backlog automation moved this from Reviewer approved to Done Feb 23, 2022
@marxide marxide deleted the iss-631-groupby-apply-indexerror branch February 23, 2022 23:42
Nimbus Production automation moved this from Reviewer approved to Done Feb 23, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working python Pull requests that update Python code
Projects
Development

Successfully merging this pull request may close these issues.

Dask/Pandas regression: IndexError raised during new source analysis
2 participants