Re: Removal of old data files

2011-09-28 Thread aaron morton
hat is 5 times more disk space. > That is our main reason for us to look at older SSTables that appears to be > holding only tombstones. > > - yuki > > > From: aaron morton [mailto:aa...@thelastpickle.com] > Sent: Tuesday, September 27, 2011 8:22 PM > To: user@cass

RE: Removal of old data files

2011-09-28 Thread hiroyuki.watanabe
From: aaron morton [mailto:aa...@thelastpickle.com] Sent: Tuesday, September 27, 2011 8:22 PM To: user@cassandra.apache.org Subject: Re: Removal of old data files Short Answer: Cassandra will actively delete files when it needs to make space. Otherwise they will be

Re: Removal of old data files

2011-09-27 Thread aaron morton
remove all data file whose time stamp > is much older than TTL + grace period. > > Does anybody have similar experience ? > > > Yuki Watanabe > > > > -----Original Message- > From: Watanabe, Hiroyuki: IT (NYK) > Sent: Friday, September 02, 2011 9:01 A

RE: Removal of old data files

2011-09-27 Thread hiroyuki.watanabe
file whose time stamp is much older than TTL + grace period. Does anybody have similar experience ? Yuki Watanabe -Original Message- From: Watanabe, Hiroyuki: IT (NYK) Sent: Friday, September 02, 2011 9:01 AM To: user@cassandra.apache.org Subject: RE: Removal of old data files I

RE: Removal of old data files

2011-09-02 Thread hiroyuki.watanabe
I see. Thank you for helpful information Yuki -Original Message- From: Sylvain Lebresne [mailto:sylv...@datastax.com] Sent: Friday, September 02, 2011 3:40 AM To: user@cassandra.apache.org Subject: Re: Removal of old data files On Fri, Sep 2, 2011 at 12:11 AM, wrote: > Yes

Re: Removal of old data files

2011-09-02 Thread Sylvain Lebresne
lly be removed. So those files will always have a size of 0. -- Sylvain > > > yuki > > > From: aaron morton [mailto:aa...@thelastpickle.com] > Sent: Thursday, August 25, 2011 6:13 PM > To: user@cassandra.apache.org > Subject: Re: Remova

RE: Removal of old data files

2011-09-01 Thread hiroyuki.watanabe
we are doing something wrong? yuki From: aaron morton [mailto:aa...@thelastpickle.com] Sent: Thursday, August 25, 2011 6:13 PM To: user@cassandra.apache.org Subject: Re: Removal of old data files If cassandra does not have enough disk space to create a new file

Re: Removal of old data files

2011-08-25 Thread aaron morton
If cassandra does not have enough disk space to create a new file it will provoke a JVM GC which should result in compacted SStables that are no longer needed been deleted. Otherwise they are deleted at some time in the future. Compacted SSTables have a file written out with a "compacted" extens

Removal of old data files

2011-08-25 Thread yuki watanabe
We are using Cassandra 0.8.0 with 8 node ring and only one CF. Every column has TTL of 86400 (24 hours). we also set 'GC grace second' to 43200 (12 hours). We have to store massive amount of data for one day now and eventually for five days if we get more disk space. Even for one day, we do run ou