Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

S3 scanner improvements #938

Merged
merged 1 commit into from Nov 22, 2022
Merged

S3 scanner improvements #938

merged 1 commit into from Nov 22, 2022

Conversation

dustin-decker
Copy link
Contributor

  • use new logger
  • increase max filesize to 250MB
  • skip incompatible file extensions
  • skip irretrievable/expensive Glacier storage classes
  • log when skipping files

@dustin-decker
S3 scanner improvements
65a8b2a 
- use new logger
- increase max filesize to 250MB
- skip incompatible file extensions
- skip irretrievable/expensive Glacier storage classes
- log when skipping files
@dustin-decker dustin-decker requested review from a team as code owners November 22, 2022 01:38
@dustin-decker dustin-decker merged commit 28dd25b into main Nov 22, 2022
@dustin-decker dustin-decker deleted the s3-improvements branch November 22, 2022 03:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ahrav ahrav ahrav approved these changes

Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
2 participants
@dustin-decker @ahrav