Re: Question regards sudden drop of compactionQueueLength metric

2024-05-20 Thread Rural Hunter
"Once these long compassions are finished, the queued ones are processed very quickly." I don't think that's the case as I described there was no additional compaction completion log at that time. There was one item of compaction completion log every several minutes, the same as when the queue was

Re: Question regards sudden drop of compactionQueueLength metric

2024-05-20 Thread Wellington Chevreuil
By the description, it seems compaction of a specific subset of regions is taking a long time to complete, filling all the compaction threads whilst all other compaction requests are queued waiting for these long ones to complete. Once these long compassions are finished, the queued ones are proces

Question regards sudden drop of compactionQueueLength metric

2024-05-19 Thread Rural Hunter
Hi, We are experiencing periodic slow response issue. We investigated the issue and found it's related to hfile compaction. The slow down happens when there are many compaction activities in log. So we tuned some compaction parameters and also started to monitor the metric: compactionQueueLength.