Re: Cassandra Compaction Metrics - CompletedTasks vs TotalCompactionCompleted

2018-08-10 Thread Chris Lohfink
If its occurring that often you can monitor nodetool compactionstats to see whats running > On Aug 10, 2018, at 11:35 AM, Dionne Cloudoupoulos > wrote: > > On 2017/10/31 16:56:29, Chris Lohfink wrote: >> The "CompletedTasks" metric is a measure of how many tasks ran on these two >> executors c

Re: Cassandra Compaction Metrics - CompletedTasks vs TotalCompactionCompleted

2018-08-10 Thread Dionne Cloudoupoulos
On 2017/10/31 16:56:29, Chris Lohfink wrote: > The "CompletedTasks" metric is a measure of how many tasks ran on these two > executors combined. > The "TotalCompactionsCompleted" metric is a measure of how many compactions > issued from the compaction manager ran (normal compactions, cache writes,

Re: Cassandra Compaction Metrics - CompletedTasks vs TotalCompactionCompleted

2017-11-01 Thread Lucas Benevides
Thanks a lot Chris, I had noticed that even the counter in the TotalCompactionsCompleted is higher than the number of SSTables compactions, that is what interests me most. I measured the number of compactions turning on the log_all in the compaction settings in the tables and reading the compactio

Re: Cassandra Compaction Metrics - CompletedTasks vs TotalCompactionCompleted

2017-10-31 Thread Chris Lohfink
CompactionMetrics is a combination of the compaction executor (sstable compactions, secondary index build, view building, relocate, garbagecollect, cleanup, scrub etc) and validation executor (repairs). Keep in mind not all jobs execute 1 task per operation, things that use the parallelAllSSTableOp

Re: Cassandra Compaction Metrics - CompletedTasks vs TotalCompactionCompleted

2017-10-30 Thread Lucas Benevides
Kurt, I apreciate your answer but I don't believe CompletedTasks count the "validation compactions". These are compactions that occur from repair operations. I am running tests on 10 cluster nodes in the same physical rack, with Cassandra Stress Tool and I didn't make any Repair commands. The tabl

Re: Cassandra Compaction Metrics - CompletedTasks vs TotalCompactionCompleted

2017-10-30 Thread kurt greaves
I believe (may be wrong) that CompletedTasks counts Validation compactions while TotalCompactionsCompleted does not. Considering a lot of validation compactions can be created every repair it might explain the difference. I'm not sure why they are named that way or work the way they do. There appea