Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix s3zip not returning data #13442

Merged
merged 2 commits into from Oct 14, 2021
Merged

Conversation

klauspost
Copy link
Contributor

@klauspost klauspost commented Oct 14, 2021

Description

We do not reliably know the length of compressed data, including headers.

Request until the end-of-stream. Results will still be properly truncated.

Fixes #13441

zipindex upgrade fixes CRC errors being written (not returned to users though).

How to test this PR?

Mint test: minio/minio-go#1570

Types of changes

  • Bug fix (non-breaking change which fixes an issue)

We do not reliably know the length of compressed data, including headers.

Request until the end-of-stream. Results will still be properly truncated.

Fixes minio#13441
@minio-trusted
Copy link
Contributor

Mint Automation

Test Result
mint-large-bucket.sh ✔️
mint-fs.sh ✔️
mint-gateway-s3.sh ✔️
mint-erasure.sh ✔️
mint-dist-erasure.sh ✔️
mint-zoned.sh ✔️
mint-gateway-nas.sh ✔️
mint-compress-encrypt-dist-erasure.sh ✔️
Deleting image on docker hub
Deleting image locally

klauspost added a commit to klauspost/minio-go that referenced this pull request Oct 14, 2021
@harshavardhana harshavardhana merged commit 76239fa into minio:master Oct 14, 2021
@klauspost klauspost deleted the fix-s3zip-file-end branch October 15, 2021 08:02
rluetzner pushed a commit to iternity-dotcom/minio that referenced this pull request Jun 8, 2022
We do not reliably know the length of compressed data, including headers.

Request until the end-of-stream. Results will still be properly truncated.

Fixes minio#13441

(cherry picked from commit 76239fa)
rluetzner pushed a commit to iternity-dotcom/minio that referenced this pull request Jun 8, 2022
We do not reliably know the length of compressed data, including headers.

Request until the end-of-stream. Results will still be properly truncated.

Fixes minio#13441

(cherry picked from commit 76239fa)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Get object inside a ZIP archive got EOF
3 participants