Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support categorical data for dask functional interface and DQM. #7043

Merged
merged 2 commits into from Jun 18, 2021

Conversation

trivialfis
Copy link
Member

Depends on #7042 .

  • Implement cat support in GPU sketch merge.
  • Add support for DeviceQuantileDMatrix.
  • Add support for dask.
  • Add support for data iterator.

@trivialfis trivialfis mentioned this pull request Jun 16, 2021
67 tasks
@trivialfis trivialfis changed the title [WIP] Support categorical data for dask and device DMatrix. Support categorical data for dask functional interface and DQM. Jun 16, 2021
@trivialfis
Copy link
Member Author

trivialfis commented Jun 16, 2021

I think there is stalled cache in mgpu worker.

@hcho3
Copy link
Collaborator

hcho3 commented Jun 16, 2021

@trivialfis I just cleared the cache.

* Implement categorical data support for GPU GK-merge.
* Add support for dask functional interface.
* Add support for DQM.
};
struct SketchUnique {
XGBOOST_DEVICE bool operator()(SketchEntry const& a, SketchEntry const& b) const {
return a.value - b.value == 0;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What is this comparator doing?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See if they are equal.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why not a.value == b.value?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If memory is correct, I think that is not guaranteed to work: https://docs.oracle.com/cd/E19957-01/806-3568/ncg_goldberg.html

@trivialfis trivialfis merged commit 86715e4 into dmlc:master Jun 18, 2021
@trivialfis trivialfis deleted the cat-dask branch June 18, 2021 05:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants