Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Align tenant pruning according to wall clock #7299

Merged
merged 2 commits into from May 13, 2024
Merged

Align tenant pruning according to wall clock #7299

merged 2 commits into from May 13, 2024

Commits on May 13, 2024

  1. Align tenant pruning according to wall clock. 

    Pruning a tenant currently acquires a lock on the tenant's TSDB,
which blocks reads from incoming queries. We have noticed spikes in
query latency when tenants get decomissioned since each receiver will
prune the tenant at a different time.

To reduce the window where queries get degraded, this commit makes sure that
pruning happens at predictable intervals by aligning it to the wall clock, similar
to how head compaction is aligned.

The commit also changes the tenant deletion condition to look at the duration
from the min time of the tenant, rather than from the last append time.

Signed-off-by: Filip Petkovski <filip.petkovsky@gmail.com>
    @fpetkovski
    fpetkovski committed May 13, 2024
    Configuration menu
    Copy the full SHA
    b0964cc View commit details
    Browse the repository at this point in the history

  2. Improve tests 

    Signed-off-by: Filip Petkovski <filip.petkovsky@gmail.com>
    @fpetkovski
    fpetkovski committed May 13, 2024
    Configuration menu
    Copy the full SHA
    f4df57f View commit details
    Browse the repository at this point in the history