Re: SSTable compaction issue in our system

2012-01-31 Thread aaron morton
There is no way to reverse a compaction. You can initiate a user compaction on a single file though, see nodetool (i think) or the JMX interface. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 1/02/2012, at 4:10 AM, Micah Hausler wrote:

Re: SSTable compaction issue in our system

2012-01-31 Thread Micah Hausler
A related question, is there any way to reverse a major compaction without loosing performance? Do I just have to wait it out? Micah Hausler On Jan 30, 2012, at 7:50 PM, Roshan Pradeep wrote: > Thanks Aaron for the perfect explanation. Decided to go with automatic > compaction. Thanks again. >

Re: SSTable compaction issue in our system

2012-01-30 Thread Roshan Pradeep
Thanks Aaron for the perfect explanation. Decided to go with automatic compaction. Thanks again. On Wed, Jan 25, 2012 at 11:19 AM, aaron morton wrote: > The issue with major / manual compaction is that it creates a one file. > One big old file. > > That one file will not be compacted unless there

Re: SSTable compaction issue in our system

2012-01-24 Thread aaron morton
The issue with major / manual compaction is that it creates a one file. One big old file. That one file will not be compacted unless there are (min_compaction_threshold -1) other files of a similar size. So thombstones and overwrites in that file may not be purged for a long time. If you go

Re: SSTable compaction issue in our system

2012-01-24 Thread aaron morton
When the default compaction strategy the SSTables are grouped into buckets, where the size of every sstable int he bucket is within 50% of the average size of files in the bucket. There is also a catch all first bucket for all files less than 50MB (by default). The min_compaction_threshold CF