Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: Test with -race flag #307

Merged
merged 1 commit into from Jun 10, 2022
Merged

ci: Test with -race flag #307

merged 1 commit into from Jun 10, 2022

Conversation

radeksimko
Copy link
Member

This ensures that we don't reintroduce race conditions, which were recently addressed in #299

go test -race tends to take longer than without the flag, so I also pre-emptively increased the timeout for the E2E test run.

@radeksimko radeksimko added the ci label May 20, 2022
@radeksimko radeksimko requested a review from kmoe May 20, 2022 07:54
Copy link
Member

@kmoe kmoe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sounds good. 30 minutes of tests...!

@radeksimko
Copy link
Member Author

30 minutes of tests...!

I think in reality they'd more likely finish much faster, especially with the default count=1, but I reached ~15min mark with count=5 locally.

Looking at the CI now:

  • Windows: 8mins vs 11mins
  • macOS: 8mins vs 9mins
  • Linux: 3mins vs 8mins

I'm happy to dial it down, but I also think that unless they take significantly longer to finish I'd much rather interpret this as a data point, than a hard/loud failure. I mean - the most likely correction we'd apply should this happen is bumping the timeout.

If performance is what we're trying to measure here, then benchmarking seems like a much better tool than our existing tests.

@radeksimko radeksimko merged commit e8dfc80 into main Jun 10, 2022
@radeksimko radeksimko deleted the ci-add-race branch June 10, 2022 06:32
rstandt pushed a commit to rstandt/terraform-exec that referenced this pull request Jun 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants