>From the output you shared, it looks like you have at least one *very*
large partition — my guess is its lots of very small rows per partition.
This would explain why the slow compaction and why "nodetool stop
compaction" didn’t work (prior to CASSANDRA-14397 stop only works between
partitions).
You probably have a very large partition in that file. Nodetool cfstats
will show you the largest compacted partition now - I suspect it's much
higher than before.
On Thu, Jul 5, 2018 at 9:50 PM, atul atri wrote:
> Hi Chris,
>
> Compaction process finally finished. It took long time though.
>
>
Hi Chris,
Compaction process finally finished. It took long time though.
Thank you very much for all your help.
Please let me know if you have any guidelines to make future compaction
processes faster.
Thanks & Regards,
Atul Atri.
On 5 July 2018 at 22:05, atul atri wrote:
> Hi Cris,
>
> Than
Hi Cris,
Thank you for reply.
I already have tried to run "nodetool stop compaction" and this does not
help. I have restarted each node in cluster one by one and compaction
starts again. It gets stuck on same table.
Following in 'nodetool compactionstats' output. It's stuck at *1336035468*
for m
That looks a bit to me like it isnt stuck but just a long running compaction.
Can you include the output of `nodetool compactionstats` and the `nodetool
cfstats` with schema for the table thats being compacted (redacted names if
necessary).
Can stop compaction with `nodetool stop COMPACTION` or
Hi Chris,
Thanks for reply.
Unfortunately, our servers do not have jstack installed.
I tried "kill -3 " option but that is also not generating thread dump.
Is there any other way I can generate thread dump?
Thanks & Regards,
Atul Atri.
On 4 July 2018 at 20:32, Chris Lohfink wrote:
> Can you t
Can you take a thread dump (jstack) and share the state of the compaction
threads? Also check for “Exception” in logs
Chris
Sent from my iPhone
> On Jul 4, 2018, at 8:37 AM, atul atri wrote:
>
> Hi,
>
> On one of our server, compaction process is hanging. It's stuck at 80%. It
> was stuck f
Hi,
On one of our server, compaction process is hanging. It's stuck at 80%. It
was stuck for last 3 days. And today we did a cluster restart (one host at
time). And again it is stuck at same 80%. CPU usages are 100% and there
seems no IO issue. We are seeing following kinds of WARNING in system.lo
