Re: data clean up problem

2013-05-29 Thread cem
Thanks for the answers! Cem On Wed, May 29, 2013 at 1:26 AM, Robert Coli wrote: > On Tue, May 28, 2013 at 2:38 PM, Bryan Talbot > wrote: > > I think what you're asking for (efficient removal of TTL'd write-once > data) > > is already in the works but not until 2.0 it seems. > > If your entir

Re: data clean up problem

2013-05-28 Thread Robert Coli
On Tue, May 28, 2013 at 2:38 PM, Bryan Talbot wrote: > I think what you're asking for (efficient removal of TTL'd write-once data) > is already in the works but not until 2.0 it seems. If your entire dataset in a keyspace or column family is deleted every [small time period], then maybe use TRUNC

Re: data clean up problem

2013-05-28 Thread Bryan Talbot
; > >>-----Original Message- > >>From: Hiller, Dean [mailto:dean.hil...@nrel.gov] > >>Sent: Tuesday, May 28, 2013 1:10 PM > >>To: user@cassandra.apache.org > >>Subject: Re: data clean up problem > >> > >>How much disk used on each node

Re: data clean up problem

2013-05-28 Thread Hiller, Dean
.@nrel.gov] >>Sent: Tuesday, May 28, 2013 1:10 PM >>To: user@cassandra.apache.org >>Subject: Re: data clean up problem >> >>How much disk used on each node? We run the suggested < 300G per node as >>above that compactions can have trouble keeping up. >> &g

Re: data clean up problem

2013-05-28 Thread Hiller, Dean
>From: Hiller, Dean [mailto:dean.hil...@nrel.gov] >Sent: Tuesday, May 28, 2013 1:10 PM >To: user@cassandra.apache.org >Subject: Re: data clean up problem > >How much disk used on each node? We run the suggested < 300G per node as >above that compactions can have trouble keepin

RE: data clean up problem

2013-05-28 Thread Dwight Smith
How do you determine the slow node, client side response latency? -Original Message- From: Hiller, Dean [mailto:dean.hil...@nrel.gov] Sent: Tuesday, May 28, 2013 1:10 PM To: user@cassandra.apache.org Subject: Re: data clean up problem How much disk used on each node? We run the

Re: data clean up problem

2013-05-28 Thread Hiller, Dean
.org>> Date: Tuesday, May 28, 2013 1:45 PM To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Subject: Re: data clean up problem Thanks for the answer. Sorry for the misunderstanding. I tried to say I don't send del

Re: data clean up problem

2013-05-28 Thread cem
andra.apache.org<mailto:user@cassandra.apache.org>" < > user@cassandra.apache.org<mailto:user@cassandra.apache.org>> > Date: Tuesday, May 28, 2013 1:17 PM > To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" < > user@cassandra.apache.org<mailt

Re: data clean up problem

2013-05-28 Thread Hiller, Dean
<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Subject: Re: data clean up problem Thanks for the answer but it is already set to 0 since I don't do any delete. Cem On Tue, May 28, 2013 at 9:03 PM, Edward Capriolo mailto:edlinuxg...@gmail.com>> wrote:

Re: data clean up problem

2013-05-28 Thread Hiller, Dean
gt; Date: Tuesday, May 28, 2013 1:17 PM To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Subject: Re: data clean up problem Thanks for the answer but it is already set to 0 since I don't do any delete. Cem On Tu

Re: data clean up problem

2013-05-28 Thread Hiller, Dean
ed. Dean From: cem mailto:cayiro...@gmail.com>> Reply-To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Date: Tuesday, May 28, 2013 1:17 PM To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>"

Re: data clean up problem

2013-05-28 Thread cem
Thanks for the answer but it is already set to 0 since I don't do any delete. Cem On Tue, May 28, 2013 at 9:03 PM, Edward Capriolo wrote: > You need to change the gc_grace time of the column family. It defaults to > 10 days. By default the tombstones will not go away for 10 days. > > > On Tue,

Re: data clean up problem

2013-05-28 Thread Edward Capriolo
You need to change the gc_grace time of the column family. It defaults to 10 days. By default the tombstones will not go away for 10 days. On Tue, May 28, 2013 at 2:46 PM, cem wrote: > Hi Experts, > > We have general problem about cleaning up data from the disk. I need to > free the disk space

data clean up problem

2013-05-28 Thread cem
Hi Experts, We have general problem about cleaning up data from the disk. I need to free the disk space after retention period and the customer wants to dimension the disk space base on that. After running multiple performance tests with TTL of 1 day we saw that the compaction couldn't keep up wi