Re: Performance issue for ActiveMQ Server

2008-02-24 Thread vc123
zaoliu wrote: > > I am tuning the performance of ActiveMQ broker for Queue by using three > separate machines as producer, consumer and server. I got pretty good > throughput for non persistent messages, approximate 2 msgs/s. For > persistent messages, approximate 4000 megs/s. But when I te

Re: Performance issue for ActiveMQ Server

2008-02-22 Thread Zao Liu
I am using Apache ActiveMQ 5.0. To my understand, dispatchSync only helpful when have slower consumers and using the consumers using the same connection, different sessions. But in my case, all consumer threads are using different connections. Thanks, Zao On Fri, Feb 22, 2008 at 1:28 AM, Rob Dav

Re: Performance issue for ActiveMQ Server

2008-02-22 Thread Ben Chobot
Rob Davies wrote: Writes are usually fast because of the journaling part of the default message store Which version are you using btw? I'm using 5.0, and like I said in another email, when writing safely (syncOnWrite="true") performance isn't all that good without write caching. How do you d

Re: Performance issue for ActiveMQ Server

2008-02-22 Thread Rob Davies
You can try setting async dispatch on the consumer - see: http://activemq.apache.org/consumer-dispatch-async.html A separate task would be used then for dispatching to each consumer cheers. Rob On 21 Feb 2008, at 22:40, Zao Liu wrote: Another issue I met is when I increase the number of consum

Re: Performance issue for ActiveMQ Server

2008-02-22 Thread Rob Davies
On 21 Feb 2008, at 19:52, Ben Chobot wrote: It sounds like you don't have a very firm grasp on what's going on, under the covers. If you need persistence, have you tried pulling the power cord from your server and verifying you haven't lost messages? If you don't care, why do you need pers

Re: Performance issue for ActiveMQ Server

2008-02-21 Thread Zao Liu
Another issue I met is when I increase the number of consumers for testing non-persistent messages, the throughput also get down very fast. I can't find the reason for it. Each consumer thread is a separate connection to the broker. Below is my result for testing (all using one producer to send mes

Re: Performance issue for ActiveMQ Server

2008-02-21 Thread Ben Chobot
Well, I'm just starting to play with ActiveMQ myself, but just as a datapoint, I found that when writing every durable message to disk using the default Kaha store in 5.0, I maxed out at transferring a whopping 14 40KB msgs/s. That's using a single, low-performance 7200RPM drive without write c

Re: Performance issue for ActiveMQ Server

2008-02-21 Thread Zao Liu
Yeah, I do need to test for persistence, but firstly I wan to make sure the performance is good. The result for consuming durable messages make me disappointed. Is any specific configuration for consuming durable messages? I do test for producing and consuming durable messages at the same time, th

Re: Performance issue for ActiveMQ Server

2008-02-21 Thread Ben Chobot
It sounds like you don't have a very firm grasp on what's going on, under the covers. If you need persistence, have you tried pulling the power cord from your server and verifying you haven't lost messages? If you don't care, why do you need persistence? :) I suspect that what might be happeni

Re: Performance issue for ActiveMQ Server

2008-02-21 Thread zaoliu
I have no idea about the IO systems. The server is using Linux Operating System and has 6 cpus. I find that the speed is getting lower and lower with time. When produce 50 messages, the speed is 3500/s. But when consumer 70 messages, the speed get down to avg 1700/s. I think I need to ru

Re: Performance issue for ActiveMQ Server

2008-02-21 Thread Ben Chobot
What is the underlying I/O system like for your broker? As I understand the persistence layer for ActiveMQ, 3,500 durable messages a second sounds too good to be true, assuming you're writing them safely. zaoliu wrote: I am tuning the performance of ActiveMQ broker for Queue by using three sep