Re: Pending on ReadStage

2012-01-07 Thread aaron morton
It may be IO, it's a good place to look http://spyced.blogspot.com/2010/01/linux-performance-basics.html Look at the logs, when messages are dropped you will see logs from StatusLogger that include TP stats and some other things. Cheers - Aaron Morton Freelance Developer @aaro

Re: Pending on ReadStage

2012-01-06 Thread Daning Wang
Thanks for your reply. Nodes are equally balanced. and it is RandomPartitioner. I think that machine is slower, Are you saying it is IO issue? Daning On Fri, Jan 6, 2012 at 10:25 AM, Mohit Anchlia wrote: > Are all your nodes equally balanced in terms of read requests? Are you > using RandomPart

Re: Pending on ReadStage

2012-01-06 Thread Mohit Anchlia
Are all your nodes equally balanced in terms of read requests? Are you using RandomPartitioner? Are you reading using indexes? First thing you can do is compare iostat -x output between the 2 nodes to rule out any io issues assuming your read requests are equally balanced. On Fri, Jan 6, 2012 at

Pending on ReadStage

2012-01-06 Thread Daning Wang
Hi all, We have 5 nodes cluster(0.8.6), but the performance from one node is way behind others, I checked tpstats, It always show non-zero pending ReadStage, I don't see this problem on other nodes. What caused the problem? I/O? Memory? Cpu usage is still low. How to fix this problem? ~/bin/node