Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Conflicts between dask and pyspark GPU tests. #8134

Closed
trivialfis opened this issue Aug 3, 2022 · 0 comments
Closed

Conflicts between dask and pyspark GPU tests. #8134

trivialfis opened this issue Aug 3, 2022 · 0 comments
Projects
PySpark Support

Comments

@trivialfis
Copy link
Member

#8117 rearranges the order of dask and pyspark GPU tests so that dask tests are run after pyspark tests. Without the changes, cuDF would allocate data on random devices resulting in non-deterministic errors like each column in a dataframe is allocated on a different device.

This issue tracks the current status of those tests.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
PySpark Support
Done
Milestone
No milestone
Development

No branches or pull requests
1 participant
@trivialfis