Re: LCS: sstables grow larger

2014-11-18 Thread Andrei Ivanov
Amazing how I missed the -Dcassandra.disable_stcs_in_l0=true option - I have LeveledManifest source opened the whole day;-) On Tue, Nov 18, 2014 at 9:15 PM, Andrei Ivanov wrote: > Thanks a lot for your support, Marcus - that is useful beyond all > recognition!;-) And I will try #6621 right away.

Re: LCS: sstables grow larger

2014-11-18 Thread Andrei Ivanov
Thanks a lot for your support, Marcus - that is useful beyond all recognition!;-) And I will try #6621 right away. Sincerely, Andrei. On Tue, Nov 18, 2014 at 8:50 PM, Marcus Eriksson wrote: > you should stick to as small nodes as possible yes :) > > There are a few relevant tickets related to bo

Re: LCS: sstables grow larger

2014-11-18 Thread Marcus Eriksson
you should stick to as small nodes as possible yes :) There are a few relevant tickets related to bootstrap and LCS: https://issues.apache.org/jira/browse/CASSANDRA-6621 - startup with -Dcassandra.disable_stcs_in_l0=true to not do STCS in L0 https://issues.apache.org/jira/browse/CASSANDRA-7460 - (

Re: LCS: sstables grow larger

2014-11-18 Thread Andrei Ivanov
OK, got it. Actually, my problem is not that we constantly having many files at L0. Normally, quite a few of them - that is, nodes are managing to compact incoming writes in a timely manner. But it looks like when we join a new node, it receives tons of files from existing nodes (and they end up

Re: LCS: sstables grow larger

2014-11-18 Thread Marcus Eriksson
No, they will get compacted into smaller sstables in L1+ eventually (once you have less than 32 sstables in L0, an ordinary L0 -> L1 compaction will happen) But, if you consistently get many files in L0 it means that compaction is not keeping up with your inserts and you should probably expand you

Re: LCS: sstables grow larger

2014-11-18 Thread Andrei Ivanov
Marcus, thanks a lot! It explains a lot those huge tables are indeed at L0. It seems that they start to appear as a result of some "massive" operations (join, repair, rebuild). What's their fate in the future? Will they continue to propagate like this through levels? Is there anything that can be

Re: LCS: sstables grow larger

2014-11-18 Thread Marcus Eriksson
I suspect they are getting size tiered in L0 - if you have too many sstables in L0, we will do size tiered compaction on sstables in L0 to improve performance Use tools/bin/sstablemetadata to get the level for those sstables, if they are in L0, that is probably the reason. /Marcus On Tue, Nov 18