Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Expose use_emulator option for GCS #2628

Closed
wants to merge 1 commit into from
Closed

Conversation

roeap
Copy link
Contributor

@roeap roeap commented Sep 1, 2022

Which issue does this PR close?

Closes #2627

Rationale for this change

Currently a test-only option is exposed, to configure an unsafe client. To avoid exposing third party types in the public API, I moved the same logic as used in test behind a use_emulator option.

Also after some trials around copy-if-not exists, it seemed to me fake-gcs so far does not support this. fsouza/fake-gcs-server#909.

What changes are included in this PR?

New builder option for GCS object sore.

Are there any user-facing changes?

yes

@github-actions github-actions bot added the object-store Object Store Interface label Sep 1, 2022
@tustvold
Copy link
Contributor

tustvold commented Sep 2, 2022

I wonder if we should instead be configuring fake-gcs to use HTTP, we could then provide an with_allow_http like the we do for S3 🤔

I'll have a quick play later today

@roeap
Copy link
Contributor Author

roeap commented Sep 2, 2022

This is likely much better - consistent and infallible 😀.

@tustvold
Copy link
Contributor

tustvold commented Sep 2, 2022

I switched away from using insecure TLS in #2632 PTAL and let me know what you think / how you would like to proceed

@roeap
Copy link
Contributor Author

roeap commented Sep 2, 2022

From my perspective, your approach using http is superior, so going that way makes more sense. Given the need is only to do integration test "somehow"...

@tustvold
Copy link
Contributor

tustvold commented Sep 2, 2022

Ok let's move forward with that then

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
object-store Object Store Interface
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Expose option to use GCS object store in integration tests
2 participants