Re: stress.py bug?

2011-03-22 Thread Maki Watanabe
A client thread need to wait for response, during the server can handle multiple requests simultaneously. 2011/3/22 Sheng Chen : > I am just wondering, why the stress test tools (python, java) need more > threads ? > Is the bottleneck of a single thread in the client, or in the server? > Thanks. >

Re: stress.py bug?

2011-03-22 Thread Sheng Chen
I am just wondering, why the stress test tools (python, java) need more threads ? Is the bottleneck of a single thread in the client, or in the server? Thanks. Sean 2011/3/22 Ryan King > On Mon, Mar 21, 2011 at 4:02 AM, pob wrote: > > Hi, > > I'm inserting data from client node with stress.py

Re: stress.py bug?

2011-03-21 Thread A J
Not completely related. just fyi. I like it better to see the start time, end time, duration of each execution in each thread. And then do the aggregation (avg,max,min) myself. I modified last few lines of the Inserter function as follows: endtime = time.time() self.latencies[self.idx

Re: stress.py bug?

2011-03-21 Thread Ryan King
On Mon, Mar 21, 2011 at 9:34 AM, pob wrote: > You mean, > more threads in stress.py? The purpose was figure out whats the > biggest bandwidth that C* can use. You should try more threads, but at some point you'll hit diminishing returns there. You many need to drive load from more than one host.

Re: stress.py bug?

2011-03-21 Thread pob
You mean, more threads in stress.py? The purpose was figure out whats the biggest bandwidth that C* can use. Peter 2011/3/21 Ryan King > On Mon, Mar 21, 2011 at 4:02 AM, pob wrote: > > Hi, > > I'm inserting data from client node with stress.py to cluster of 6 nodes. > > They are all on 1Gbps

Re: stress.py bug?

2011-03-21 Thread Ryan King
On Mon, Mar 21, 2011 at 4:02 AM, pob wrote: > Hi, > I'm inserting data from client node with stress.py to cluster of 6 nodes. > They are all on 1Gbps network, max real throughput of network is 930Mbps > (after measurement). > python stress.py -c 1 -S 17  -d{6nodes}  -l3 -e QUORUM >  --operatio

Re: stress.py

2010-08-05 Thread Aaron Morton
: Peter Schuller To: user@cassandra.apache.orgSent: Wed, August 4, 2010 6:51:53 PMSubject: Re: stress.py > After I add the thift libs to CLASS_PATH , it's failing with following> error.>> /stress.py: line 21: have_multiproc: command not found> ./stress.py: line 22: try:: command not

Re: stress.py

2010-08-05 Thread SSam
@cassandra.apache.org Sent: Wed, August 4, 2010 6:51:53 PM Subject: Re: stress.py > After I add the thift libs to CLASS_PATH , it's failing with following > error. > > /stress.py: line 21: have_multiproc: command not found > ./stress.py: line 22: try:: command not found

Re: stress.py

2010-08-05 Thread SSam
This url got simple steps to create cluster and stress testing setup also. http://www.coreyhulen.org/category/cassandra/ From: SSam To: user@cassandra.apache.org Sent: Wed, August 4, 2010 7:02:24 PM Subject: Re: stress.py Thanks for the reply, Issue

Re: stress.py

2010-08-04 Thread SSam
, 2010 6:51:53 PM Subject: Re: stress.py > After I add the thift libs to CLASS_PATH , it's failing with following > error. > > /stress.py: line 21: have_multiproc: command not found > ./stress.py: line 22: try:: command not found And that sounds like stress.py is being run by a

Re: stress.py

2010-08-04 Thread Peter Schuller
> After I add the thift libs to CLASS_PATH , it's failing with following > error. > > /stress.py: line 21: have_multiproc: command not found > ./stress.py: line 22: try:: command not found And that sounds like stress.py is being run by a shell rather than by Python. Not sure how that happened sinc

Re: stress.py

2010-08-04 Thread Peter Schuller
(Jonathan Ellis' suggestion to just use 'ant gen-thrift-py' is of course preferred over my manual approach) As for this: > Now it's failing with following error. Do I have put thrift.jar in  JAVA > CLASSPATH. > > Traceback (most recent call last): >   File "stress.py"

Re: stress.py

2010-08-04 Thread SSam
token `(' ./stress.py: line 46: `L = os.path.abspath(__file__).split(os.path.sep)[:-3]' From: SSam To: user@cassandra.apache.org Sent: Wed, August 4, 2010 6:04:49 PM Subject: Re: stress.py Peter, Thank you so much for reply. I am not much familiar with p

Re: stress.py

2010-08-04 Thread SSam
2010 5:53:35 PM Subject: Re: stress.py > Can somebody please give steps to run cassandra stess.py program. Assuming you have the thrift compiler installed, something like (from memory, not tested): cd contrib/py_stress thrift --gen py:new ../../interface/cassandra.thrift export PYTHONPATH=$(

Re: stress.py

2010-08-04 Thread Jonathan Ellis
or just ant gen-thrift-py python contrib/py_stress/stress.py On Wed, Aug 4, 2010 at 5:53 PM, Peter Schuller wrote: >> Can somebody please give steps to run cassandra stess.py  program. > > Assuming you have the thrift compiler installed, something like (from > memory, not tested): > > cd contrib

Re: stress.py

2010-08-04 Thread Peter Schuller
> Can somebody please give steps to run cassandra stess.py  program. Assuming you have the thrift compiler installed, something like (from memory, not tested): cd contrib/py_stress thrift --gen py:new ../../interface/cassandra.thrift export PYTHONPATH=$(pwd)/gen-py python stress.py -- / Peter S