Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update alias for field_mask in Google Memmcache #16975

Merged
merged 1 commit into from Jul 13, 2021

Conversation

potiuk
Copy link
Member

@potiuk potiuk commented Jul 13, 2021

The July 12 2021 release of google-memcache library removed
field_mask alias from the library which broke our typechecking
and made google provider unimportable. This PR fixes the import
to use the actual import.


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.

@potiuk potiuk requested a review from turbaszek as a code owner July 13, 2021 16:55
@boring-cyborg boring-cyborg bot added area:providers provider:google Google (including GCP) related issues labels Jul 13, 2021
@potiuk potiuk requested review from ashb, kaxil and mik-laj July 13, 2021 16:55
@potiuk
Copy link
Member Author

potiuk commented Jul 13, 2021

Needs merging otherwise any PR where setup.py is changed will break (for example #16974) due to release of new google memcache library

@github-actions
Copy link

The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not modify the core of Airflow. If the committers decide that the full tests matrix is needed, they will add the label 'full tests needed'. Then you should rebase to the latest main or amend the last commit of the PR, and push it with --force-with-lease.

@github-actions github-actions bot added the okay to merge It's ok to merge this PR as it does not require more tests label Jul 13, 2021
@potiuk potiuk force-pushed the limit-google-cloud-memcache branch from 969a0bb to f75742e Compare July 13, 2021 17:35
@potiuk
Copy link
Member Author

potiuk commented Jul 13, 2021

seems it might be difficult-ish to make it works (I could do some conditional import) with pre and post change - but since it was non-breaking release and library used only in the memcache operators, I simply added lower bound to 1.1.0 version.

The July 12 2021 release of google-memcache library removed
field_mask alias from the library which broke our typechecking
and made google provider unimportable. This PR fixes the import
to use the actual import.
@potiuk potiuk force-pushed the limit-google-cloud-memcache branch from f75742e to bcb4eb3 Compare July 13, 2021 18:15
@potiuk
Copy link
Member Author

potiuk commented Jul 13, 2021

It's a bit worse :(, We have to

  1. limit to < 1.1.0 now (so that currently released provider can install)
  2. import it directly from where memcache is importing it
  3. when we release the next provider for google we will be able to remove the limitation

That's all because of backwards-incompatible import :(

'google-cloud-memcache>=0.2.0',
# 1.1.0 removed field_mask and broke import for released providers
# We can remove the <1.1.0 limitation after we release new Google Provider
'google-cloud-memcache>=0.2.0,<1.1.0',
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are you sure google-cloud-memcache v1.1.0 is compatible? These two versions were released within a short period of time.

1.1.0 (2021-06-30)
1.0.0 (2021-05-28)

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The new version may have some compatibility, but not enough for the operator to be successfully executed.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pretty sure 1.1.0 was released yesterday (from pypi):

Screenshot 2021-07-13 20 42 53

@github-actions github-actions bot added the full tests needed We need to run full set of tests for this PR to merge label Jul 13, 2021
@github-actions
Copy link

The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and take the risk. If they don't merge it quickly - please rebase it to the latest main at your convenience, or amend the last commit of the PR, and push it with --force-with-lease.

@potiuk potiuk merged commit a3f5c93 into apache:main Jul 13, 2021
@potiuk potiuk deleted the limit-google-cloud-memcache branch July 13, 2021 18:54
josh-fell pushed a commit to josh-fell/airflow that referenced this pull request Jul 19, 2021
The July 12 2021 release of google-memcache library removed
field_mask alias from the library which broke our typechecking
and made google provider unimportable. This PR fixes the import
to use the actual import.
potiuk added a commit to potiuk/airflow that referenced this pull request Aug 2, 2021
The July 12 2021 release of google-memcache library removed
field_mask alias from the library which broke our typechecking
and made google provider unimportable. This PR fixes the import
to use the actual import.

(cherry picked from commit a3f5c93)
potiuk added a commit to potiuk/airflow that referenced this pull request Aug 5, 2021
The July 12 2021 release of google-memcache library removed
field_mask alias from the library which broke our typechecking
and made google provider unimportable. This PR fixes the import
to use the actual import.

(cherry picked from commit a3f5c93)
kaxil pushed a commit that referenced this pull request Aug 17, 2021
The July 12 2021 release of google-memcache library removed
field_mask alias from the library which broke our typechecking
and made google provider unimportable. This PR fixes the import
to use the actual import.

(cherry picked from commit a3f5c93)
jhtimmins pushed a commit that referenced this pull request Aug 17, 2021
The July 12 2021 release of google-memcache library removed
field_mask alias from the library which broke our typechecking
and made google provider unimportable. This PR fixes the import
to use the actual import.

(cherry picked from commit a3f5c93)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:providers full tests needed We need to run full set of tests for this PR to merge okay to merge It's ok to merge this PR as it does not require more tests provider:google Google (including GCP) related issues
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants