New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Loosen azureml-dataprep requirements to cloudpickle<=2.0.0 #1637
Comments
@harneetvirk Hello Harneet, could you please review the PR and see if we can merge it? Thanks. |
@thomasfrederikhoeck - Thank you for your feedback here and also sending us an email! I am part of the team maintaining azureml-dataprep. We included version upper bounds to the packages we depend on to avoid automatically taking in new major versions that might have breaking changes. We will look into loosening the upper bound of cloudpickle and get back to you about this. |
That makes a lot of sense and is probably a good default behavior @yikei . I will be looking forward to it :-) |
@thomasfrederikhoeck Hello Thomas, is that possible for you to accept the answer in Q&A forum since this issue has been good handle here by yikei? Thanks a lot! |
@YutongTie-MSFT done :-) |
@thomasfrederikhoeck Quick update - we are targeting to loosen the upper bound of cloudpickle and have the change shipped by mid January. It should be released as azureml-dataprep 2.26, which will be used by AzureML SDK 1.38. Thanks! |
@yikei wonderful! Many thanks. |
To give an update, we released azureml-dataprep 2.26 already. Once azureml sdk 1.38 releases (scheduled for 1/24/2022), it will start picking up azureml-dataprep 2.26. (If you use compute instances, it may take a few extra days for the image to get updated to use the newest versions.) |
@yikei sounds good! I will close the ticket as it relates to azureml-dataprep. Thank you for fixing. As site-note: when I went to https://pypi.org/project/azureml-dataprep/2.26.0/ to see the new package it appears that the Homepage url (under Project Links) is broken - just to let you know. |
@thomasfrederikhoeck Appreciate the heads up! We used to have extensive public facing documentation for azureml-dataprep but that has been removed (as we no longer recommend directly using dataprep). We will get that old link removed. Thanks! |
azureml-dataprep
(which is a depedency forazureml-dataset-runtime
) has requirementcloudpickle<2.0.0 and >=1.1.0
. However there is to my knowledage no breaking features going fromcloudpickle==1.6.0
tocloudpickle==2.0.0
.cloudpickle==2.0.0
introduces some very effective tools for serializing helper scripts which is very helful when working with azureml. Soazureml-dataprep
should allowcloudpickle==2.0.0
Intro to new cloudpickle:
https://github.com/cloudpipe/cloudpickle#overriding-pickles-serialization-mechanism-for-importable-constructs
PR:
cloudpipe/cloudpickle#417
Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.
The text was updated successfully, but these errors were encountered: