Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Re-evaluate pandas and Python versions #4314

Open
eccabay opened this issue Sep 19, 2023 · 4 comments
Open

Re-evaluate pandas and Python versions #4314

eccabay opened this issue Sep 19, 2023 · 4 comments

Comments

@eccabay
Copy link
Contributor

eccabay commented Sep 19, 2023

With Pandas version 2.1.0 released on August 30th, the package no longer supports Python versions below 3.9.

We missed this for a long time because the majority of our testing (including all tests that run for PRs, as well as the latest dependency checker) only runs on Python 3.8. This was only discovered now because the pandas upgrade happened on our nightly 3.9 tests after sktime upgraded to version 0.23.0.

Our current plan is to pin pandas under version 2.1.0, but this is not a good long term solution. This issue tracks the discussion around what to do with our Python and pandas versioning in the longer term, as this will only become more of a problem as time goes on and Python 3.8 becomes more out of date.

@eccabay
Copy link
Contributor Author

eccabay commented Oct 23, 2023

The same issue has come up with the networkx package bumping their minimum version to Python 3.9, with the version bumping again to 3.10 in the next release. We have pinned networkx in the meantime, see #4350

@eccabay
Copy link
Contributor Author

eccabay commented Jan 22, 2024

Scipy has not supported < Python 3.9 since v1.10, their newest release of v1.12 has breaking changes with evalml.

@eccabay
Copy link
Contributor Author

eccabay commented Jan 29, 2024

Dependencies which have dropped support for Python 3.8 at this point (3/22/24) are:

  • pandas (dropped 2.1.0, currently on 2.2.1)
  • networkx (dropped 3.2.0, currently on 3.2.1)
  • scipy (dropped 1.11.0, currently on 1.12.0)
  • scikit-learn (dropped 1.4.0, currently on 1.4.1.post1)
  • numpy (dropped 1.25.0, currently on 1.26.4)
  • dask (dropped 2023.5.1, currently on 2024.3.1)
  • distributed (dropped 2023.5.1, currently on 2024.3.1)
  • matplotlib (dropped 3.8.0, currently on 3.8.3)
  • shap (dropped 0.45.0, currently on 0.45.0)
  • featuretools (dropped 1.29.0, currently on 1.30.0)
  • woodwork (dropped 0.28.8, currently on 0.29.0)

@eccabay
Copy link
Contributor Author

eccabay commented May 20, 2024

After the merge of #4414, we have unpinned a number of the dependencies above. Those that remain pinned are:

  • pandas
  • scipy
  • shap

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant