Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ci] [dask] fix test on "only one worker has data" training #5537

Closed
jameslamb opened this issue Oct 12, 2022 · 1 comment · Fixed by #5544
Closed

[ci] [dask] fix test on "only one worker has data" training #5537

jameslamb opened this issue Oct 12, 2022 · 1 comment · Fixed by #5544

Comments

@jameslamb
Copy link
Collaborator

Description

In #5510, we observed that the Dask tests were getting stuck and timing out after 60 minutes.

Narrowed that down to a single unit test, which is currently skipped.

def test_training_succeeds_even_if_some_workers_do_not_have_any_data(task, output, cluster):
pytest.skip("skipping due to timeout issues discussed in https://github.com/microsoft/LightGBM/pull/5510")

The testing work from #5510 should be continued.... that test should be re-enabled and its underlying cause should be identified and fixed.

Reproducible example

Uncomment the test linked above and push a commit to a pull request in LightGBM.

Environment info

Latest version of LightGBM (0c0eb2a).

Additional Comments

Especially see this comment describing a possible root cause of timeout issues: #5510 (comment).

@github-actions
Copy link

This issue has been automatically locked since there has not been any recent activity since it was closed.
To start a new related discussion, open a new issue at https://github.com/microsoft/LightGBM/issues
including a reference to this.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Aug 15, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant