Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

scrubber: add scan-metadata and hook into integration tests #5176

Merged
merged 25 commits into from Sep 6, 2023
Merged

scrubber: add scan-metadata and hook into integration tests #5176

Show file tree
Hide file tree
Changes from 6 commits
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
8951c57
s3_scrubber: remote atty dependency
jcsp Sep 1, 2023
87421aa
scrubber: add scan-metadata command
jcsp Aug 18, 2023
f544cdc
tests: enable scrubbing at end of test
jcsp Sep 1, 2023
0f0cd9c
scrubber: make SSO_ACCOUNT_ID optional
jcsp Sep 1, 2023
5cdecb5
scrubber: respect AWS_ENDPOINT_URL
jcsp Sep 1, 2023
f9836ad
tests: enable remote storage & scrub in pageserver restart & chaos tests
jcsp Sep 1, 2023
bc68568
Update s3_scrubber/src/scan_metadata.rs
jcsp Sep 1, 2023
f51d888
Wait for custom extensions build before deploy (#5170)
bayandin Sep 1, 2023
06053dd
remote_timeline_client: tests: run upload ops on the tokio::test runt…
problame Sep 1, 2023
94ad504
rfc: Crash-Consistent Layer Map Updates By Leveraging index_part.json…
problame Sep 1, 2023
6455f0d
FileBlockReader<File> is never used (#5181)
problame Sep 1, 2023
9b91c07
pageserver: run all Rust tests with remote storage enabled (#5164)
problame Sep 1, 2023
3112aa9
proxy: error typo (#5187)
conradludgate Sep 1, 2023
b7f3ca6
tests: get test name automatically for remote storage (#5184)
jcsp Sep 1, 2023
80c942f
drop vestigial test_name arguments
jcsp Sep 1, 2023
826aafb
pageserver: define "/tenants/" in a constant
jcsp Sep 4, 2023
da440bf
Make all referencves to "tenants" and "timelines" use constants
jcsp Sep 4, 2023
40a809f
test: stash test_output_dir on NeonEnvBuilder
jcsp Sep 4, 2023
25ceb87
tests: improve subprocess_capture
jcsp Sep 4, 2023
177645c
s3_scrubber: remove main.rs span
jcsp Sep 4, 2023
f8622e5
Merge remote-tracking branch 'upstream/main' into jcsp/scrubber-scan-…
jcsp Sep 4, 2023
21c489d
clippy
jcsp Sep 4, 2023
36c57b5
Fix a doc string with angle brackes outside ``
jcsp Sep 4, 2023
a6fef13
typos
jcsp Sep 6, 2023
8ac049b
Tolerate non-unicode postgres log output
jcsp Sep 6, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
36 changes: 15 additions & 21 deletions Cargo.lock
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

10 changes: 6 additions & 4 deletions s3_scrubber/Cargo.toml
View file
Open in desktop
Expand Up @@ -22,6 +22,10 @@ serde_json.workspace = true
serde_with.workspace = true
workspace_hack.workspace = true
utils.workspace = true
async-stream.workspace = true
tokio-stream.workspace = true
futures-util.workspace = true
itertools.workspace = true

tokio = { workspace = true, features = ["macros", "rt-multi-thread"] }
chrono = { workspace = true, default-features = false, features = ["clock", "serde"] }
Expand All @@ -30,10 +34,8 @@ aws-config = { workspace = true, default-features = false, features = ["rustls",

pageserver = {path="../pageserver"}


tracing.workspace = true
tracing-subscriber.workspace = true
clap.workspace = true

atty = "0.2"
tracing-appender = "0.2"
tracing-appender = "0.2"
jcsp marked this conversation as resolved.
Show resolved Hide resolved
histogram = "0.7"