Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-43873][PS] Enabling FrameDescribeTests #42319

Closed
wants to merge 1 commit into from

Conversation

itholic
Copy link
Contributor

@itholic itholic commented Aug 3, 2023

What changes were proposed in this pull request?

This PR proposes to enable the test FrameDescribeTests.

Why are the changes needed?

To increate test coverage for pandas API on Spark with pandas 2.0.0 and above.

Does this PR introduce any user-facing change?

No, it's test-only.

How was this patch tested?

Enabling the existing test.

@itholic
Copy link
Contributor Author

itholic commented Aug 3, 2023

FYI: the parameter datetime_is_numeric is removed from pandas 2.0.0. See pandas-dev/pandas#34798 for more detail.

@HyukjinKwon
Copy link
Member

HyukjinKwon commented Aug 4, 2023

Merged to master.

@itholic itholic deleted the pandas_describe branch November 20, 2023 01:35
ragnarok56 pushed a commit to ragnarok56/spark that referenced this pull request Mar 2, 2024
### What changes were proposed in this pull request?

This PR proposes to enable the test `FrameDescribeTests`.

### Why are the changes needed?

To increate test coverage for pandas API on Spark with pandas 2.0.0 and above.

### Does this PR introduce _any_ user-facing change?

No, it's test-only.

### How was this patch tested?

Enabling the existing test.

Closes apache#42319 from itholic/pandas_describe.

Authored-by: itholic <haejoon.lee@databricks.com>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants