RE: Removal of old data files

2011-09-28 Thread hiroyuki.watanabe
Thank you. You have been very helpful. We stored only one day worth of data for now. However, we want to store 5 days worth of data eventually. That is 5 times more disk space. That is our main reason for us to look at older SSTables that appears to be holding only tombstones. - yuki ___

RE: Removal of old data files

2011-09-27 Thread hiroyuki.watanabe
Now, we use TTL of 12 hours and GC grace period of 8 hours for encouraging Cassandra to remove old data/files more aggressively. Cassandra do remove fair amount of old data files. Cassandra tends to removed 4 out of every 5 files. I notice it because data file has a sequence number as a part

RE: Removal of old data files

2011-09-02 Thread hiroyuki.watanabe
I see. Thank you for helpful information Yuki -Original Message- From: Sylvain Lebresne [mailto:sylv...@datastax.com] Sent: Friday, September 02, 2011 3:40 AM To: user@cassandra.apache.org Subject: Re: Removal of old data files On Fri, Sep 2, 2011 at 12:11 AM, wrote: > Yes, I see

RE: Removal of old data files

2011-09-01 Thread hiroyuki.watanabe
Yes, I see files with name like Orders-g-6517-Compacted However, all of those file have a size of 0. Starting from Monday to Thurseday we have 5642 files for -Data.db, -Filter.db and Statistics.db and only 128 -Compacted files. and all of -Compacted file has size of 0. Is this normal, or we