Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix install test and uncap kaleido #4423

Merged
merged 31 commits into from
May 22, 2024
Merged

Fix install test and uncap kaleido #4423

merged 31 commits into from
May 22, 2024

Conversation

MichaelFu512
Copy link
Contributor

@MichaelFu512 MichaelFu512 commented May 16, 2024

Pull Request Description

Closes #4420 and Closes #4394

After creating the pull request: in order to pass the release_notes_updated check you will need to update the "Future Release" section of docs/source/release_notes.rst to include this pull request by adding :pr:123.

Copy link

codecov bot commented May 16, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 99.7%. Comparing base (80ccb4d) to head (2b11a69).

Additional details and impacted files
@@           Coverage Diff           @@
##            main   #4423     +/-   ##
=======================================
+ Coverage   99.7%   99.7%   +0.1%     
=======================================
  Files        352     352             
  Lines      39805   39804      -1     
=======================================
+ Hits       39682   39683      +1     
+ Misses       123     121      -2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

"--single-process",
"--headless",
"--disable-gpu",
)
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Originally these were only meant for mac m1 tests to pass, but windows tests also needs these settings for testing, else some tests hang forever, causing workers to fail.

@MichaelFu512 MichaelFu512 changed the title Fix install test Fix install test and uncap kaleido May 21, 2024
- name: Install evalml from sdist (using cache)
if: steps.cache.outputs.cache-hit == 'true'
run: |
python -m pip install "unpacked_sdist/." --no-deps
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Whenever the install_tests would use cache, the test would fail.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interesting, do you think it's noticably slower since we're not using the cache? If so, by how much?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interestingly the time it takes varies.

The latest commit (2b11a69) has the time that ubuntu takes for this step to be 8 seconds. For MacOS it takes 40 seconds for python3.9 and 3 minutes for python3.11.

Conversely, the second latest commit (cd3f4f8) has the time that ubuntu takes hover around 1 minute. MacOS hovers at around 40 seconds.

I can't say for sure how much slower it is without cache because it didn't work with cache enabled. I can go test to see if I can get cache working (hopefully it doesn't erase the approvals).

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FWIW, I was having trouble with caches in other OS repos recently and ended up removing them because they were failing too often.

@MichaelFu512 MichaelFu512 changed the title Fix install test and uncap kaleido Fix install test and uncap kaleido + various others May 21, 2024
pyproject.toml Outdated Show resolved Hide resolved
@MichaelFu512 MichaelFu512 marked this pull request as ready for review May 21, 2024 22:32
evalml/tests/utils_tests/test_gen_utils.py Outdated Show resolved Hide resolved
.github/workflows/install_test.yaml Show resolved Hide resolved
.github/workflows/install_test.yaml Outdated Show resolved Hide resolved
Copy link
Contributor

@christopherbunn christopherbunn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Single (non-blocking) question, LGTM

- name: Install evalml from sdist (using cache)
if: steps.cache.outputs.cache-hit == 'true'
run: |
python -m pip install "unpacked_sdist/." --no-deps
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interesting, do you think it's noticably slower since we're not using the cache? If so, by how much?

@MichaelFu512 MichaelFu512 merged commit d7e6e72 into main May 22, 2024
33 checks passed
@MichaelFu512 MichaelFu512 deleted the install_test_fix branch May 22, 2024 20:43
@MichaelFu512 MichaelFu512 changed the title Fix install test and uncap kaleido + various others Fix install test and uncap kaleido May 22, 2024
This was referenced Jun 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Fix install tests Bump up minimum kaleido version to 0.2.1
4 participants