Re: Cassandra pending compaction tasks keeps increasing

2013-02-01 Thread Wei Zhu
nt: Friday, February 1, 2013 1:56 PM Subject: Re: Cassandra pending compaction tasks keeps increasing Did the node list itself as a seed node in cassandra.yaml? Unless something has changed, a node that considers itself a seed will not auto bootstrap. Although I haven't tried it, I think ru

Re: Cassandra pending compaction tasks keeps increasing

2013-02-01 Thread Derek Williams
have at least 400G for the > HD...Although SSD is cheap now, still hard to convince the management. > three replicates + double the Disk for compaction? that is 6 times of the > real data size! > > Sorry for the long email. Any suggestion or advice? > > Thanks. > -Wei > >

Re: Cassandra pending compaction tasks keeps increasing

2013-02-01 Thread aaron morton
es of the real data > size! > > Sorry for the long email. Any suggestion or advice? > > Thanks. > -Wei > > From: "aaron morton" > To: "Cassandra User" > Sent: Tuesday, January 29, 2013 12:59:42 PM > Subject: Re: Cassandra pending compactio

Re: Cassandra pending compaction tasks keeps increasing

2013-01-30 Thread Wei Zhu
s. -Wei - Original Message - From: "aaron morton" To: "Cassandra User" Sent: Tuesday, January 29, 2013 12:59:42 PM Subject: Re: Cassandra pending compaction tasks keeps increasing * Will try it tomorrow. Do I need to restart server to change the log level? Yo

Re: Cassandra pending compaction tasks keeps increasing

2013-01-29 Thread aaron morton
riginal Message ----- > From: "aaron morton" > To: user@cassandra.apache.org > Sent: Monday, January 28, 2013 11:31:42 PM > Subject: Re: Cassandra pending compaction tasks keeps increasing > > > > > > > > * Why nodetool repair increases the dat

Re: Cassandra pending compaction tasks keeps increasing

2013-01-29 Thread Wei Zhu
ailable ? * Will try it tomorrow. Do I need to restart server to change the log level? -Wei - Original Message - From: "aaron morton" To: user@cassandra.apache.org Sent: Monday, January 28, 2013 11:31:42 PM Subject: Re: Cassandra pending compaction tasks keeps increasing

Re: Cassandra pending compaction tasks keeps increasing

2013-01-28 Thread aaron morton
We use default SSTable size as 5M, Will increase the size of SSTable > help? What will happen if I change the setting after the data is loaded. > > Any suggestion is very much appreciated. > > -Wei > > - Original Message - > > From: "Wei Zhu" > To:

Re: Cassandra pending compaction tasks keeps increasing

2013-01-28 Thread Derek Williams
n Mon, Jan 28, 2013 at 12:16 PM, Wei Zhu wrote: > Any thoughts? > > Thanks. > -Wei > > - Original Message - > From: "Wei Zhu" > To: user@cassandra.apache.org > Sent: Friday, January 25, 2013 10:09:37 PM > Subject: Re: Cassandra pending compaction

Re: Cassandra pending compaction tasks keeps increasing

2013-01-28 Thread Wei Zhu
Monday, January 28, 2013 11:16:47 AM Subject: Re: Cassandra pending compaction tasks keeps increasing Any thoughts? Thanks. -Wei - Original Message - From: "Wei Zhu" To: user@cassandra.apache.org Sent: Friday, January 25, 2013 10:09:37 PM Subject: Re: Cassandra pendi

Re: Cassandra pending compaction tasks keeps increasing

2013-01-28 Thread Wei Zhu
Any thoughts? Thanks. -Wei - Original Message - From: "Wei Zhu" To: user@cassandra.apache.org Sent: Friday, January 25, 2013 10:09:37 PM Subject: Re: Cassandra pending compaction tasks keeps increasing To recap the problem, 1.1.6 on SSD, 5 nodes, RF = 3, one CF only. After

Re: Cassandra pending compaction tasks keeps increasing

2013-01-25 Thread Wei Zhu
uot; To: user@cassandra.apache.org Sent: Thursday, January 24, 2013 11:46:04 PM Subject: Re: Cassandra pending compaction tasks keeps increasing I believe I am running into this one: https://issues.apache.org/jira/browse/CASSANDRA-4765 By the way, I am using 1.1.6 (I though I was using 1.1.7)

Re: Cassandra pending compaction tasks keeps increasing

2013-01-24 Thread Wei Zhu
4, 2013 11:18:59 PM Subject: Re: Cassandra pending compaction tasks keeps increasing Thanks Derek, in the cassandra-env.sh, it says # reduce the per-thread stack size to minimize the impact

Re: Cassandra pending compaction tasks keeps increasing

2013-01-24 Thread Wei Zhu
. Thanks. -Wei - Original Message - From: "Derek Williams" To: user@cassandra.apache.org, "Wei Zhu" Sent: Thursday, January 24, 2013 11:06:00 PM Subject: Re: Cassandra pending compaction tasks keeps increasing Increasing the stack size in cassandra-env.sh should help yo

Re: Cassandra pending compaction tasks keeps increasing

2013-01-24 Thread Derek Williams
e - > From: "Wei Zhu" > To: user@cassandra.apache.org > Sent: Thursday, January 24, 2013 10:55:07 PM > Subject: Re: Cassandra pending compaction tasks keeps increasing > > Do you mean 90% of the reads should come from 1 SSTable? > > By the way, after I finished the

Re: Cassandra pending compaction tasks keeps increasing

2013-01-24 Thread Wei Zhu
y, January 24, 2013 10:55:07 PM Subject: Re: Cassandra pending compaction tasks keeps increasing Do you mean 90% of the reads should come from 1 SSTable? By the way, after I finished the data migrating, I ran nodetool repair -pr on one of the nodes. Before nodetool repair, all the nodes have the

Re: Cassandra pending compaction tasks keeps increasing

2013-01-24 Thread Wei Zhu
iginal Message - From: "aaron morton" To: user@cassandra.apache.org Sent: Wednesday, January 23, 2013 2:40:45 PM Subject: Re: Cassandra pending compaction tasks keeps increasing The histogram does not look right to me, too many SSTables for an LCS CF. It's a symptom no a cause. I

Re: Cassandra pending compaction tasks keeps increasing

2013-01-23 Thread aaron morton
ding transactions queueing up. > > Jc > > From: Wei Zhu > Reply-To: "user@cassandra.apache.org" , Wei Zhu > > Date: Tuesday, January 22, 2013 12:56 PM > To: "user@cassandra.apache.org" > Subject: Re: Cassandra pending compaction tasks keeps increa

Re: Cassandra pending compaction tasks keeps increasing

2013-01-22 Thread Jim Cistaro
lt;mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>>, Wei Zhu mailto:wz1...@yahoo.com>> Date: Tuesday, January 22, 2013 12:56 PM To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Subject: Re: Cas

Re: Cassandra pending compaction tasks keeps increasing

2013-01-22 Thread Wei Zhu
put, we set ours high for SSD.  You >usually wont use it all because the compactions are usually single threaded.   >Dstat will help you measure this. > > >I hope this helps, >jc > >From: Wei Zhu >Reply-To: "user@cassandra.apache.org" , Wei Zhu > >Date: Frid

Re: Cassandra pending compaction tasks keeps increasing

2013-01-21 Thread aaron morton
igh for SSD. You > usually wont use it all because the compactions are usually single threaded. > Dstat will help you measure this. > > I hope this helps, > jc > > From: Wei Zhu > Reply-To: "user@cassandra.apache.org" , Wei Zhu > > Date: Friday, J

Re: Cassandra pending compaction tasks keeps increasing

2013-01-19 Thread Jim Cistaro
o: Cassandr usergroup mailto:user@cassandra.apache.org>> Subject: Cassandra pending compaction tasks keeps increasing Hi, When I run nodetool compactionstats I see the number of pending tasks keep going up steadily. I tried to increase the compactionthroughput, by using nodetool setcompactio

Cassandra pending compaction tasks keeps increasing

2013-01-18 Thread Wei Zhu
Hi, When I run nodetool compactionstats I see the number of pending tasks keep going up steadily.  I tried to increase the  compactionthroughput, by using nodetool setcompactionthroughput I even tried the extreme to set it to 0 to disable the throttling.  I checked iostats and we have SSD for