Network of Brokers recommendations

2015-03-12 Thread James A. Robinson
Hi folks, I joined this list because we're starting to look into setting up ActiveMQ for our developers. My preference at this time is to set up a highly reliable system that doesn't have single points of failure. Due to the concern about single points of failure I didn't want to introduce a sha

Re: Data Migration from KahaDB to LevelDB?

2015-03-12 Thread James A. Robinson
On Thu, Mar 12, 2015 at 9:26 PM, Tim Bain wrote: > This doesn't really work for topics; you need to get the new messages to > collect on b2 while the old consumer drains b1, and only then have the old > consumer disconnect and reconnect on b2; you can't have the consumer > simultaneously connecte

Re: Data Migration from KahaDB to LevelDB?

2015-03-12 Thread Tim Bain
This doesn't really work for topics; you need to get the new messages to collect on b2 while the old consumer drains b1, and only then have the old consumer disconnect and reconnect on b2; you can't have the consumer simultaneously connected to both b1 and b2. (Obviously this is only for durable s

Re: ActiveMQ 5.11 Dynamic Camel Route updates

2015-03-12 Thread mtod
I was able to get this working except for authorization. Thanks -- View this message in context: http://activemq.2283324.n4.nabble.com/ActiveMQ-5-11-Dynamic-Camel-Route-updates-tp4693120p4693136.html Sent from the ActiveMQ - User mailing list archive at Nabble.com.

Re: Lots of small ActiveMQ instances or one big one?

2015-03-12 Thread Kevin Burton
Yes. I’m curious about this as well. I can’t easily benchmark / profile this box to find the lock. I just did some analysis and it looks like LevelDB imposed about a 2x overhead just in terms of CPU. I setup a benchmark backed by a RAM disk and LevelDB and this performed 2x slower than just a no

Re: Lots of small ActiveMQ instances or one big one?

2015-03-12 Thread Tim Bain
Keep in mind that as soon as you have a network of brokers, some portion of your messages will have to cross two brokers to get from producer to consumer (and more than that if your topology isn't a mesh) instead of just one. So my gut instinct (with nothing to back it up) is that if you're going

Lots of small ActiveMQ instances or one big one?

2015-03-12 Thread Kevin Burton
I’m trying to improve our ActiveMQ message throughput and I’m not really seeing the performance I would expect. We moved from non-persistent to persistent (which would be more ideal) and the performance is about 4-5x slower than before. I think this would be somewhat reasonable but our disks aren

What’s the state of apollo?

2015-03-12 Thread Kevin Burton
Just curious. Is it still being worked on? How is the code being maintained while ActiveMQ moves on? -- Founder/CEO Spinn3r.com Location: *San Francisco, CA* blog: http://burtonator.wordpress.com … or check out my Google+ profile

Re: Are Scheduled Messages persistent ?

2015-03-12 Thread Kevin Burton
One heads up. Only KahaDB is supported. LevelDB doesn’t work with scheduled messages (last I checked and would be cool to be proven wrong). On Thu, Mar 12, 2015 at 8:08 AM, cdelgadob wrote: > Great answer! thanks a lot! > > > > -- > View this message in context: > http://activemq.2283324.n4.nab

Re: ActiveMQ 5.11 Dynamic Camel Route updates

2015-03-12 Thread mtod
Thanks for the reply I have the basic functionality working but I'm finding that I can't place any beans in the route.xml and get it to work. My existing route file is listed below. I'm trying to duplicate that in the routes.xml and it just throws errors. I have tried moving the beans to the act

Re: ActiveMQ 5.11 Dynamic Camel Route updates

2015-03-12 Thread Timothy Bish
On 03/12/2015 05:51 PM, mtod wrote: Does anyone have an example of how to configure Activemq.xml to use dynamic route updates? https://issues.apache.org/jira/browse/AMQ-5351 I can't seem to find any information on this update. Thanks Mike --

ActiveMQ 5.11 Dynamic Camel Route updates

2015-03-12 Thread mtod
Does anyone have an example of how to configure Activemq.xml to use dynamic route updates? https://issues.apache.org/jira/browse/AMQ-5351 I can't seem to find any information on this update. Thanks Mike -- View this message in context: http

Does maxBrowsePageSize require the entire queue to be read into memory?

2015-03-12 Thread Kevin Burton
I’ve been using a large maxBrowsePageSize (of 2^31) but I’ve also been using a non-persistent broker. So this means the data is *already* in memory so a max browse page size is acceptable. We’ve been using this to track down message loss. AKA if we browse all our queues, and the message isn’t th

Re: Data Migration from KahaDB to LevelDB?

2015-03-12 Thread James A. Robinson
On Thu, Mar 12, 2015 at 8:58 AM, Tim Bain wrote: > And there would need to be a change > to allow a non-durable subscriber to disconnect from the old broker without > unsubscribing the consumer and to resume that subscription once the > connection is made to the new broker (and obviously this wou

Re: ActiveMQ Spring listener suddently stops working

2015-03-12 Thread Tim Bain
You can use a JMX viewer (such as JConsole) to look at the number of dispatched messages for a given consumer; if messages are backed up on the broker, then you know that the client's prefetch buffer is full, so the number of messages currently dispatched to it is equal to its prefetch buffer size.

Re: ActiveMQ Spring listener suddently stops working

2015-03-12 Thread cdelgadob
That's what I suspect, although I'm not sure if this is handled somehow by Spring. Also, as you can see, the session is transacted, and I'm not sure if that affects the acknowledge mode... I'll take a look at the prefetch buffer as soon as we can start the system, this only happens in production, s

Re: Data Migration from KahaDB to LevelDB?

2015-03-12 Thread Tim Bain
Art, Sure, as currently implemented, non-durable topic subscriptions have that issue. What I'm saying is that to do a seamless transition from one broker to another, features would need to be built into the broker to transition the broker's state from the old broker to the new one. This would ne

Re: ActiveMQ Spring listener suddently stops working

2015-03-12 Thread Tim Bain
How many messages get processed before it stops working? I see it's using CLIENT_ACKNOWLEDGE; have you confirmed that the ack happens on all code paths (including exceptions)? It's been a while, but I think what happens if you don't ack messages is that you can only process your prefetch buffer w

ActiveMQ Spring listener suddently stops working

2015-03-12 Thread cdelgadob
Hi all! I have to fix an inherited application from another company, and I have an error which is not clear to me: the jms listener stops working suddently without any evident reason. It's a spring-based client, here is the context: /

Re: Are Scheduled Messages persistent ?

2015-03-12 Thread cdelgadob
Great answer! thanks a lot! -- View this message in context: http://activemq.2283324.n4.nabble.com/Are-Scheduled-Messages-persistent-tp4665977p4693078.html Sent from the ActiveMQ - User mailing list archive at Nabble.com.

Re: Thousands of workers waiting to receive jobs but ActiveMQ isn’t sending them.

2015-03-12 Thread Kevin Burton
I didn’t configure one… so we’re running the stock one. I’m trying to verify it it’s just a specific task not committing messages but for some reason it processes them in batches. If it wasn’t committing the messages I would expect it to lock up permanently. One thing that could be nice for Activ

Re: Thousands of workers waiting to receive jobs but ActiveMQ isn’t sending them.

2015-03-12 Thread Kevin Burton
The problem is that this is happening in production but not locally. Setting prefetchPolicy to zero fixed it for one of our tasks, but another one of our tasks is still waiting for work and I can’t figure out why. It has 6000 consumers / threads, 200k messages waiting to be processed, but none ar