Re: Huge files in level 1 and level 0 of LeveledCompactionStrategy

2016-12-08 Thread Sotirios Delimanolis
What do you mean?  I'm logging the list of files when creating the CompactionTask and it's showing these -rw-r--r-- 1 user group      3540336 Dec  7 23:40 lb-29715834-big-Data.db-rw-r--r-- 1 user group      5997853 Dec  7 22:07 lb-29715833-big-Data.db-rw-r--r-- 1 user group      5210561 Dec  7 2

Re: Huge files in level 1 and level 0 of LeveledCompactionStrategy

2016-12-08 Thread Eric Evans
On Wed, Dec 7, 2016 at 6:35 PM, Sotirios Delimanolis wrote: > I have a couple of SSTables that are humongous > > -rw-r--r-- 1 user group 138933736915 Dec 1 03:41 lb-29677471-big-Data.db > -rw-r--r-- 1 user group 78444316655 Dec 1 03:58 lb-29677495-big-Data.db > -rw-r--r-- 1 user group 212429252

Re: Huge files in level 1 and level 0 of LeveledCompactionStrategy

2016-12-07 Thread Sotirios Delimanolis
2 -- P {margin-top:0;margin-bottom:0;}#yiv9834340812 This can happen as part of node bootstrap,repair or rebuild node. From: Sotirios Delimanolis Sent: Wednesday, December 7, 2016 4:35:45 PM To: User Subject: Huge files in level 1 and level 0 of LeveledCompactionStrategy I have a couple of SS

Re: Huge files in level 1 and level 0 of LeveledCompactionStrategy

2016-12-07 Thread Harikrishnan Pillai
This can happen as part of node bootstrap,repair or rebuild node. From: Sotirios Delimanolis Sent: Wednesday, December 7, 2016 4:35:45 PM To: User Subject: Huge files in level 1 and level 0 of LeveledCompactionStrategy I have a couple of SSTables that are

Huge files in level 1 and level 0 of LeveledCompactionStrategy

2016-12-07 Thread Sotirios Delimanolis
I have a couple of SSTables that are humongous  -rw-r--r-- 1 user group 138933736915 Dec  1 03:41 lb-29677471-big-Data.db-rw-r--r-- 1 user group  78444316655 Dec  1 03:58 lb-29677495-big-Data.db-rw-r--r-- 1 user group 212429252597 Dec  1 08:20 lb-29678145-big-Data.db sstablemetadata reports that

Re: A number of questions on LeveledCompactionStrategy

2015-10-12 Thread Jeff Ferland
> On Oct 10, 2015, at 9:24 AM, San Luoji wrote: > > Hi, > > I've got a number of questions when looking into LCS in Cassandra. Could > somebody help to enlighten me? > > 1. Will LCS always strive to clean up L0 sstable? i.e. whenever a new L0 > sstable shows up, it will trigger LCS compacti

A number of questions on LeveledCompactionStrategy

2015-10-10 Thread San Luoji
Hi, I've got a number of questions when looking into LCS in Cassandra. Could somebody help to enlighten me? 1. Will LCS always strive to clean up L0 sstable? i.e. whenever a new L0 sstable shows up, it will trigger LCS compaction to upgrade it into higher level? If that’s what’s happening, what s

Re: LeveledCompactionStrategy

2015-05-26 Thread Stefano Ortolani
imes. > > I would like to be able to schedule a Tombstone Compaction. > > Is there a way to trigger immediately a Tombstone Compaction on a table > which is using LeveledCompactionStrategy? > > > Thanks a lot for your help > > Jean > > On 14 May 2015

Re: LeveledCompactionStrategy

2015-05-26 Thread Jean Tremblay
immediately a Tombstone Compaction on a table which is using LeveledCompactionStrategy? Thanks a lot for your help Jean On 14 May 2015, at 22:45 , Nate McCall mailto:n...@thelastpickle.com>> wrote: You can make LCS more aggressive with tombstone-only compactions via

Re: LeveledCompactionStrategy

2015-05-14 Thread Jean Tremblay
ferent for each workload will make a huge difference in overall performance. On Thu, May 14, 2015 at 8:06 AM, Jean Tremblay mailto:jean.tremb...@zen-innovations.com>> wrote: > > Hi, > > I’m using Cassandra 2.1.4 with a table using LeveledCompactionStrategy. > Often I need

Re: LeveledCompactionStrategy

2015-05-14 Thread Nate McCall
AM, Jean Tremblay < jean.tremb...@zen-innovations.com> wrote: > > Hi, > > I’m using Cassandra 2.1.4 with a table using LeveledCompactionStrategy. > Often I need to delete many rows and I want to make sure I don’t have too many tombstones. > > How does one get rid of tombs

LeveledCompactionStrategy

2015-05-14 Thread Jean Tremblay
Hi, I’m using Cassandra 2.1.4 with a table using LeveledCompactionStrategy. Often I need to delete many rows and I want to make sure I don’t have too many tombstones. How does one get rid of tombstones in a table using LCS? How can we monitor how many tombstones are around? Thanks for your

Re: CQL query throws TombstoneOverwhelmingException against a LeveledCompactionStrategy table

2014-10-06 Thread dlu66061
If it is of the same cause, does that mean I should switch to SizeTieredCompactionStrategy? -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/CQL-query-throws-TombstoneOverwhelmingException-against-a-LeveledCompactionStrategy-table-tp7597077p759709

CQL query throws TombstoneOverwhelmingException against a LeveledCompactionStrategy table

2014-10-03 Thread dlu66061
-TombstoneOverwhelmingException-against-a-LeveledCompactionStrategy-table-tp7597077.html Sent from the cassandra-u...@incubator.apache.org mailing list archive at Nabble.com.

Re: What is the ideal value for sstable_size_in_mb when using LeveledCompactionStrategy ?

2013-09-18 Thread Nate McCall
lto:user@cassandra.apache.org>" < >> user@cassandra.apache.org<mailto:user@cassandra.apache.org>> >> Date: Wednesday, September 18, 2013 1:30 PM >> To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" < >> user@cassandra.apach

Re: What is the ideal value for sstable_size_in_mb when using LeveledCompactionStrategy ?

2013-09-18 Thread Jayadev Jayaraman
< > user@cassandra.apache.org<mailto:user@cassandra.apache.org>> > Date: Wednesday, September 18, 2013 1:30 PM > To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" < > user@cassandra.apache.org<mailto:user@cassandra.apache.org>> > Su

Re: What is the ideal value for sstable_size_in_mb when using LeveledCompactionStrategy ?

2013-09-18 Thread Hiller, Dean
lt;mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Date: Wednesday, September 18, 2013 1:30 PM To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Subject: Re: What is the ideal value for sstable_size_in_

Re: What is the ideal value for sstable_size_in_mb when using LeveledCompactionStrategy ?

2013-09-18 Thread Jayadev Jayaraman
ay, September 18, 2013 1:02 PM > To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" < > user@cassandra.apache.org<mailto:user@cassandra.apache.org>> > Subject: What is the ideal value for sstable_size_in_mb when using > LeveledCompactionStrateg

What is the ideal value for sstable_size_in_mb when using LeveledCompactionStrategy ?

2013-09-18 Thread Jayadev Jayaraman
sstableloader to load 10GB+ of analytics data per day ( 100 million+ row keys, 5 or so columns per day on average.) . We have chosen LeveledCompactionStrategy in the hope that it constrains the number of SSTables that are read in order to retrieve a sliced-predicate for a row. We don't want too

Re: What is the ideal value for sstable_size_in_mb when using LeveledCompactionStrategy ?

2013-09-18 Thread Hiller, Dean
<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Subject: What is the ideal value for sstable_size_in_mb when using LeveledCompactionStrategy ? We have set up a 24 node (m1.xlarge nodes, 1.7 TB per node) cassandra cluster on Amazon EC2 : version=1.2.9 replicat

Re: Continue running major compaction after switching to LeveledCompactionStrategy

2013-08-23 Thread Nate McCall
l > drives and cassandra version 1.2.3. > > I will really appreciate the help! :) > > Lucas Brunialti. > Thanks much Rob! > > Brian > > > > -- > View this message in context: > http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Continue-r

Re: Continue running major compaction after switching to LeveledCompactionStrategy

2013-08-22 Thread Lucas Fernandes Brunialti
6.n2.nabble.com/Continue-running-major-compaction-after-switching-to-LeveledCompactionStrategy-tp7589839p7589846.html Sent from the cassandra-u...@incubator.apache.org mailing list archive at Nabble.com.

Re: Continue running major compaction after switching to LeveledCompactionStrategy

2013-08-22 Thread brianchang
Thanks much Rob! Brian -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Continue-running-major-compaction-after-switching-to-LeveledCompactionStrategy-tp7589839p7589846.html Sent from the cassandra-u...@incubator.apache.org mailing list archive

Re: Continue running major compaction after switching to LeveledCompactionStrategy

2013-08-22 Thread Robert Coli
On Thu, Aug 22, 2013 at 5:24 PM, brianchang wrote: > One more follow-up question: can we freely switch back to > SizeTieredCompactionStrategy later (and also resume running major > compaction > cron job), if we find LeveledCompactionStrategy does not end up with better > performan

Re: Continue running major compaction after switching to LeveledCompactionStrategy

2013-08-22 Thread brianchang
Thanks much Edward! One more follow-up question: can we freely switch back to SizeTieredCompactionStrategy later (and also resume running major compaction cron job), if we find LeveledCompactionStrategy does not end up with better performance (e.g., if we should experience those intensive I/O

Re: Continue running major compaction after switching to LeveledCompactionStrategy

2013-08-22 Thread Edward Capriolo
; automatically expire/deleted by TTL. > > We are going to switch to using LeveledCompactionStrategy, and we are > wondering if we need to continue the major compaction cron job? Or once > being switched to using LeveledCompactionStrategy, we should not run major > compactio

Continue running major compaction after switching to LeveledCompactionStrategy

2013-08-22 Thread brianchang
Hi, Cassandra experts, Currently we are running major compaction (triggered daily by cron job), as our application continue creating new columns in each row with old columns automatically expire/deleted by TTL. We are going to switch to using LeveledCompactionStrategy, and we are wondering if we

Re: Estimating write throughput with LeveledCompactionStrategy

2013-02-11 Thread Ивaн Cобoлeв
0M? > > Thanks. > -Wei > > > From: Ивaн Cобoлeв > To: user@cassandra.apache.org > Sent: Wednesday, February 6, 2013 2:42 AM > Subject: Estimating write throughput with LeveledCompactionStrategy > > Dear Community, > > Could anyone

Re: Estimating write throughput with LeveledCompactionStrategy

2013-02-06 Thread Wei Zhu
  From: Ивaн Cобoлeв To: user@cassandra.apache.org Sent: Wednesday, February 6, 2013 2:42 AM Subject: Estimating write throughput with LeveledCompactionStrategy Dear Community, Could anyone please give me a hand with understanding what am I missing while trying to

Estimating write throughput with LeveledCompactionStrategy

2013-02-06 Thread Ивaн Cобoлeв
Dear Community, Could anyone please give me a hand with understanding what am I missing while trying to model how LeveledCompactionStrategy works: https://docs.google.com/spreadsheet/ccc?key=0AvNacZ0w52BydDQ3N2ZPSks2OHR1dlFmMVV4d1E2eEE#gid=0 Logs mostly contain something like this: INFO

Re: How to set LeveledCompactionStrategy for an existing table

2012-09-02 Thread Data Craftsman 木匠
> @aaronmorton > http://www.thelastpickle.com > On 31/08/2012, at 7:05 AM, Jean-Armel Luce wrote: > > I tried as you said with cassandra-cli, and still unsuccessfully > > [default@unknown] use test1; > Authenticated to keyspace: test1 > [default@test1] UPDATE

Re: How to set LeveledCompactionStrategy for an existing table

2012-08-31 Thread Jean-Armel Luce
AM, Jean-Armel Luce wrote: > > I tried as you said with cassandra-cli, and still unsuccessfully > > [default@unknown] use test1; > Authenticated to keyspace: test1 > [default@test1] UPDATE COLUMN FAMILY pns_credentials with > compaction_strategy='LeveledCompact

Re: How to set LeveledCompactionStrategy for an existing table

2012-08-30 Thread aaron morton
redentials with > compaction_strategy='LeveledCompactionStrategy'; > 8ed12919-ef2b-327f-8f57-4c2de26c9d51 > Waiting for schema agreement... > ... schemas agree across the cluster > > And then, when I check the compaction strategy, it is still > SizeTieredCompactionStrat

Re: How to set LeveledCompactionStrategy for an existing table

2012-08-30 Thread Jean-Armel Luce
I tried as you said with cassandra-cli, and still unsuccessfully [default@unknown] use test1; Authenticated to keyspace: test1 [default@test1] UPDATE COLUMN FAMILY pns_credentials with compaction_strategy='LeveledCompactionStrategy'; 8ed12919-ef2b-327f-8f57-4c2de26c9d51 Waiting

Re: How to set LeveledCompactionStrategy for an existing table

2012-08-30 Thread feedly team
in cassandra-cli, i did something like: update column family xyz with compaction_strategy='LeveledCompactionStrategy' On Thu, Aug 30, 2012 at 5:20 AM, Jean-Armel Luce wrote: > > Hello, > > I am using Cassandra 1.1.1 and CQL3. > I have a cluster with 1 node (test envi

How to set LeveledCompactionStrategy for an existing table

2012-08-30 Thread Jean-Armel Luce
LE : cqlsh:test1> alter table pns_credentials ... WITH compaction_strategy_class='LeveledCompactionStrategy' ... AND compaction_strategy_options:sstable_size_in_mb=10; In Cassandra logs, I see some informations : INFO 10:23:52,532 Enqueuing flush of Memtable-schema_columnfamili