Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test(artifacts): skip instead of xfail for test test_artifact_metadata_save #4550

Merged
merged 2 commits into from Nov 30, 2022

Conversation

speezepearson
Copy link
Contributor

Follow-up to #4463 . This test is consistently failing CI on #4539, despite being marked xfail, so I'm reluctantly upgrading it to skip. :(

@moredatarequired moredatarequired merged commit 962eb8b into main Nov 30, 2022
@moredatarequired moredatarequired deleted the spencerpearson/flake branch November 30, 2022 17:48
@gtarpenning
Copy link
Contributor

Also could consider the xfail(strict=false) which allows pass or fail (?) I'm tracking this ticket because I'm pretty sure I get a similar error causing flake upon Artifact Creation, I guess it could be different but looks suspiciously similar. @speezepearson

Screen Shot 2022-11-30 at 11 16 03 AM

@speezepearson
Copy link
Contributor Author

Also could consider the xfail(strict=false) which allows pass or fail (?)

Judging from the docs, strict=False is the default! I'm quite confused why it was still causing the test suite to fail. Maybe flakiness forces a failure even if xfail is set? Dunno.

@kptkin kptkin changed the title test(artifacts): skip mysteriously flaky test test(artifacts): skip mysteriously flaky test, test_artifact_metadata_save Dec 6, 2022
@github-actions github-actions bot added cc-test and removed cc-test labels Dec 6, 2022
@kptkin kptkin changed the title test(artifacts): skip mysteriously flaky test, test_artifact_metadata_save test(artifacts): skip instead of xfail for test test_artifact_metadata_save Dec 6, 2022
@github-actions github-actions bot added cc-test and removed cc-test labels Dec 6, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants