RE: Turn off compression (1.2.11)

2014-02-23 Thread Plotnik, Alexey
...@gmail.com] Sent: 19 февраля 2014 г. 10:21 To: user@cassandra.apache.org Subject: Re: Turn off compression (1.2.11) I am new and trying to learn Cassandra. Based on my understanding of the problem, almost 2Gb is taken up just for the compression headers heap. And 100MB per SSTable, and about 30,000

Re: Turn off compression (1.2.11)

2014-02-18 Thread Robert Coli
On Tue, Feb 18, 2014 at 2:51 PM, Plotnik, Alexey wrote: > My SSTable size is 100Mb. Last time I removed leveled manifest compaction > was running for 3 months > At 3TB per node, you are at, and probably exceeding the maximum size anyone suggests for Cassandra 1.2.x. Add more nodes? =Rob

Re: Turn off compression (1.2.11)

2014-02-18 Thread Yogi Nerella
.@eventbrite.com] > *Sent:* 19 февраля 2014 г. 6:24 > *To:* user@cassandra.apache.org > *Subject:* Re: Turn off compression (1.2.11) > > > > On Mon, Feb 17, 2014 at 4:35 PM, Plotnik, Alexey > wrote: > > > > As an aside, 1.2.0 beta moved a bunch of data related to

RE: Turn off compression (1.2.11)

2014-02-18 Thread Plotnik, Alexey
ent: 19 февраля 2014 г. 6:24 To: user@cassandra.apache.org Subject: Re: Turn off compression (1.2.11) On Mon, Feb 17, 2014 at 4:35 PM, Plotnik, Alexey mailto:aplot...@rhonda.ru>> wrote: As an aside, 1.2.0 beta moved a bunch of data related to compression off the heap. If you were to try t

RE: Turn off compression (1.2.11)

2014-02-18 Thread Plotnik, Alexey
My SSTable size is 100Mb. Last time I removed leveled manifest compaction was running for 3 months From: Robert Coli [mailto:rc...@eventbrite.com] Sent: 19 февраля 2014 г. 6:24 To: user@cassandra.apache.org Subject: Re: Turn off compression (1.2.11) On Mon, Feb 17, 2014 at 4:35 PM, Plotnik

Re: Turn off compression (1.2.11)

2014-02-18 Thread Edward Capriolo
Personally I think having compression on by default is the wrong choice. Depending on your access patterns and row sizes the overhead of compression can create more Garbage Collection and become your bottleneck before your potentially bottleneck your disk (ssd disk) On Tue, Feb 18, 2014 at 2:23 P

Re: Turn off compression (1.2.11)

2014-02-18 Thread Robert Coli
On Mon, Feb 17, 2014 at 4:35 PM, Plotnik, Alexey wrote: > After analyzing Heap I saw this buffer has a size about 70KB per SSTable. > I have more than 30K SSTables per node. > I'm thinking your problem is not compression, it's using the old 5mb default for Level Compaction and having 30,000 SSTa

Turn off compression (1.2.11)

2014-02-17 Thread Plotnik, Alexey
Each compressed SSTable uses additional transfer buffer in CompressedRandomAccessReader instance. After analyzing Heap I saw this buffer has a size about 70KB per SSTable. I have more than 30K SSTables per node. I want to turn off a compression for this column family to save some Heap. How can I