Thanos Compactor seems to be running in circles #7272
-
|
I have a Thanos Compactor tracing an S3 bucket where no new blocks are uploaded from Sidecars. What I am observing is that the number of
The Compactor is not halted. I check the The bucket has a very large quantity of level-1 blocks, a few (20-ish) level-2 blocks, and no level-3 or level-4 blocks. Is that a normal behavior? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
|
It will not always go down because the compactor/planner isn't so smart in Thanos. It first compacts small blocks into bigger ones and then after a few compactions like this, it generates another plan to generate those bigger blocks into even bigger ones, and so on. A smarter algorithm would just compact a lot of small blocks into one big block. That's when you would see the backlog only go down. Alas, that's not the case. At least that's how I understand it |
Beta Was this translation helpful? Give feedback.
-
|
I see. Glad to know that behavior is expected. Thanks 👍 |
Beta Was this translation helpful? Give feedback.
It will not always go down because the compactor/planner isn't so smart in Thanos. It first compacts small blocks into bigger ones and then after a few compactions like this, it generates another plan to generate those bigger blocks into even bigger ones, and so on. A smarter algorithm would just compact a lot of small blocks into one big block. That's when you would see the backlog only go down. Alas, that's not the case. At least that's how I understand it