Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

More explicit index concat checking #15650

Draft
wants to merge 22 commits into
base: branch-24.06
Choose a base branch
from

Conversation

er-eis
Copy link
Contributor

@er-eis er-eis commented May 4, 2024

Description

Closes #15649

We allow concatenating indexes whilst pandas does not. Currently, this PR would more explicitly raise issues that already exist with axis=1 index concatenation to users. We would also expose a deprecation warning for the eventual removal of index concatenation for pandas parity.

Checklist

@er-eis er-eis requested a review from a team as a code owner May 4, 2024 04:37
Copy link

copy-pr-bot bot commented May 4, 2024

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@github-actions github-actions bot added the cuDF (Python) Affects Python cuDF API. label May 4, 2024
@er-eis
Copy link
Contributor Author

er-eis commented May 4, 2024

@wence- for visibility

@er-eis er-eis mentioned this pull request May 4, 2024
3 tasks
@wence-
Copy link
Contributor

wence- commented May 7, 2024

/ok to test

@wence- wence- added the breaking Breaking change label May 7, 2024
@wence-
Copy link
Contributor

wence- commented May 7, 2024

I would suggest that we introduce this change in behaviour by adding an appropriate deprecation, we can then fix up any internal usages and remove in a subsequent release.

python/cudf/cudf/core/reshape.py Show resolved Hide resolved
python/cudf/cudf/tests/test_concat.py Outdated Show resolved Hide resolved
python/cudf/cudf/tests/test_concat.py Outdated Show resolved Hide resolved
python/cudf/cudf/tests/test_concat.py Outdated Show resolved Hide resolved
@wence- wence- added the improvement Improvement / enhancement to an existing function label May 7, 2024
@er-eis
Copy link
Contributor Author

er-eis commented May 7, 2024

@wence-

I would suggest that we introduce this change in behaviour by adding an appropriate deprecation

this isn't a change in behavior. this is how the library already behaves. the difference here is we more explicitly raise the issue to the user instead of providing them with a more ambiguous error message

@wence-
Copy link
Contributor

wence- commented May 7, 2024

@wence-

I would suggest that we introduce this change in behaviour by adding an appropriate deprecation

this isn't a change in behavior. this is how the library already behaves. the difference here is we more explicitly raise the issue to the user instead of providing them with a more ambiguous error message

Ah, I misread, sorry.

WDYT about the idea as well as deprecating all concat-with-index usages, which seems to be what pandas does?

@er-eis
Copy link
Contributor Author

er-eis commented May 7, 2024

@wence-

I would suggest that we introduce this change in behaviour by adding an appropriate deprecation

this isn't a change in behavior. this is how the library already behaves. the difference here is we more explicitly raise the issue to the user instead of providing them with a more ambiguous error message

Ah, I misread, sorry.

WDYT about the idea as well as deprecating all concat-with-index usages, which seems to be what pandas does?

@wence- that seems reasonable to me and i'll proceed with that, thanks!

@er-eis
Copy link
Contributor Author

er-eis commented May 7, 2024

@wence- also, i don't think the 'breaking' tag is appropriate for this PR? WDYT?

@er-eis er-eis requested a review from wence- May 7, 2024 19:58
@vyasr
Copy link
Contributor

vyasr commented May 7, 2024

/ok to test

@vyasr
Copy link
Contributor

vyasr commented May 7, 2024

Cross-linking for info: #15649 (comment)

@er-eis er-eis requested a review from a team as a code owner May 8, 2024 01:28
@wence- wence- added non-breaking Non-breaking change and removed breaking Breaking change labels May 8, 2024
@er-eis
Copy link
Contributor Author

er-eis commented May 9, 2024

draft mode until i can work through 2, 3, 4, & 5 listed here: #15649 (comment)

@er-eis er-eis marked this pull request as draft May 9, 2024 03:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cuDF (Python) Affects Python cuDF API. improvement Improvement / enhancement to an existing function non-breaking Non-breaking change
Projects
Status: In Progress
Development

Successfully merging this pull request may close these issues.

[BUG] Concat Index behavior diverts from pandas
3 participants