Re: DLQ, cause:null

2015-04-27 Thread James Green
) where > messages have been dispatched to the consumer but not acknowledged (i.e. > they're in the consumer's prefetch buffer or they're the message the > consumer was processing at the time of the disconnect under certain > acknowledgement modes). > Surely if a client tak

Re: DLQ, cause:null

2015-04-28 Thread James Green
On 27 April 2015 at 17:32, Tim Bain wrote: > On Mon, Apr 27, 2015 at 7:30 AM, James Green > wrote: > > > > > Surely if a client takes more than the receive time-out to process a > > message, a re-delivery will occur? If not, what does happen? > > > I don'

Re: DLQ, cause:null

2015-04-29 Thread James Green
On 28 April 2015 at 14:09, Tim Bain wrote: > On Apr 28, 2015 3:21 AM, "James Green" wrote: > > > > > > So to re-work my understanding, the pre-fetch buffer in the connected > > client is filled with messages and the broker's queue counters react as >

Large db.data with ActiveMQ 5.13.1

2016-07-14 Thread James Green
For a broker that should be holding almost nothing this looks very suspicious: total 779M -rw-r--r-- 1 999 docker 32M Jul 11 06:51 db-3393.log -rw-r--r-- 1 999 docker 32M Jul 11 09:21 db-3394.log -rw-r--r-- 1 999 docker 32M Jul 14 09:26 db-3444.log -rw-r--r-- 1 999 docker 684M Jul 14 09:26 db.d

Unexplained slow sending

2019-08-22 Thread James Green
Hi all, I've been busy shifting an existing workload into AWS recently, and a load test shows a serious performance drop when sending to ActiveMQ which I could use some advice on. Quick architecture summary: We send requests via a webserver that are forwarded as messages to a queue. A backend rec

Re: Unexplained slow sending

2019-08-28 Thread James Green
running into the Nagle algorithm on your TCP sockets? If > you use larger (e.g. 1KB) payloads, what does that do to your throughput on > a single producer? > > Tim > > On Thu, Aug 22, 2019, 2:54 AM James Green > wrote: > > > Hi all, > > > > I&#

Re: Unexplained slow sending

2019-08-29 Thread James Green
rrentStoreAndDispatchQueues and rerun > the > > tests. > > > > Alan Diego > > > > > > On Wed, Aug 28, 2019 at 9:42 AM James Green > > wrote: > > > > > Hi, > > > > > > Following-up as I've run more tests. > > &g

Dynamic SSL certs

2012-01-23 Thread James Green
Looking at ways to connect an fluctuating list of clients at customer sites to our ActiveMQ network of brokers. They all require anything going over the Internet to be SSL-encrypted. I really don't want to have to restart our brokers when a new customer comes on board (several per week). Is there

Re: AMQ 5.5: KahaDB failed to store to Journal, java.io.IOException: The process cannot access the file because another process has locked a portion of the file

2012-04-04 Thread James Green
Someone should really add that the message store be isolated from host machine's filesystem activities within the installation documentation. Anti-virus software is the most obvious example. I cannot see it mentioned here: http://activemq.apache.org/getting-started.html On 3 April 2012 18:26, sea

Re: Avoiding distribution of queues

2012-08-15 Thread James Green
/www.nighttale.net > ActiveMQ in Action: http://www.manning.com/snyder/ > > > On Wed, Aug 15, 2012 at 5:32 PM, James Green > wrote: > > Hi, > > > > We have three remote ActiveMQ installs each connecting to a central hub. > > > > Each remote ActiveMQ install creates queu

Re: Queue Size wrong

2012-10-26 Thread James Green
Interesting I think I'm seeing the same with the web console on 5.7.0. I have a queue that's constantly got a "Number of Pending Messages" count of 4. Yet the consumer is processing messages quite happily and is often waiting for new messages. The Dequeued count is occassionally rising. I am tryi

Re: Ignoring subscriptions to excluded destinations

2012-10-30 Thread James Green
umerInfo come in for a destination that is excluded, it will > just ignore it and log the message you see below. This is by design, at the > moment. > > On Mon, Oct 29, 2012 at 5:59 AM, James Green >wrote: > > > Given: > > > > > > &

Re: AMQ 5.7.0: Stomp trace does not log frames

2012-10-30 Thread James Green
class: > org.apache.activemq.transport.TransportLogger > > Can you try with the following settings > > log4j.logger.org.apache.activemq.transport.TransportLogger=TRACE, stomp > > > to get the logging you want? > > On Fri, Oct 26, 2012 at 8:34 AM, James G

Re: Ignoring subscriptions to excluded destinations

2012-10-30 Thread James Green
che.org/jira/browse/AMQ-3384 > > > On 30 October 2012 09:10, James Green wrote: > > Part of my intention of declaring excluded destinations was to reduce the > > amount of traffic over the ADSL line that exists between hub and the > spokes. > > > > However, despi

Re: Ignoring subscriptions to excluded destinations

2012-10-30 Thread James Green
We are running 5.7.0 on hub and spokes, forgot to mention. On 30 October 2012 12:08, James Green wrote: > Gary, > > I think you're saying that subscription advisories for excluded > destinations should be suppressed. > > On the hub we're seeing advisories for qu

Re: Ignoring subscriptions to excluded destinations

2012-10-30 Thread James Green
ch seems to be what you want. > > On 30 October 2012 12:08, James Green wrote: > > Gary, > > > > I think you're saying that subscription advisories for excluded > > destinations should be suppressed. > > > > On the hub we're seeing advisories for

Re: Ignoring subscriptions to excluded destinations

2012-10-30 Thread James Green
ns will be subscribed to > automatically. > > > On 30 October 2012 12:40, James Green wrote: > > http://activemq.apache.org/networks-of-brokers.html states for > > dynamicallyIncludedDestinations that "destinations that match this list * > > will* be forwarded a

Re: Ignoring subscriptions to excluded destinations

2012-10-30 Thread James Green
nable debug logging for > org.apache.activemq.transport.TransportLogger to see it. > > > On 30 October 2012 14:39, James Green wrote: > > Gary, > > > > On our test cluster one of our spokes has been configured thus: > > > > > >

Re: Network bridge is stuck, repeatedly requires broker restart

2012-10-30 Thread James Green
12 11:32, James Green wrote: > Hub with three spokes. The network between the hub and one of these spokes > seems to be dying irregularly yet frequently. > > I managed to get a thread dump of the hub's ssl connector to this spoke > along with the thread it was waiting on

Re: Whitelisting forwarded queues

2012-11-01 Thread James Green
Are you referring to this discussion, had only days ago? http://mail-archives.apache.org/mod_mbox/activemq-users/201210.mbox/%3ccamh6+azsejinb8zadd5_vyo0u_9y-42uyg+7yc6to7zt+k5...@mail.gmail.com%3E On 31 October 2012 23:45, Geurt Schimmel wrote: > BrokerA is forwarding a number of queues with >

Re: Whitelisting forwarded queues

2012-11-01 Thread James Green
or a solution for that problem. > > Geurt > > -Original Message- > From: James Green [mailto:james.mk.gr...@gmail.com] > Sent: Thursday, November 01, 2012 8:35 AM > To: users@activemq.apache.org > Subject: Re: Whitelisting forwarded queues > > Are you referring to

Re: Network bridge is stuck, repeatedly requires broker restart

2012-11-01 Thread James Green
; and that the write needs to timeout at the tcp level. that can take > some time. > > There is a writeTimeout filter that can help at the activemq level. > > Have a peek at https://issues.apache.org/jira/browse/AMQ-1993 > > > On 30 October 2012 21:31, James Green wrote: &g

Re: Network bridge is stuck, repeatedly requires broker restart

2012-11-01 Thread James Green
It should do once a remote > close has been initiated. > > Or is the problem that the hub/spoke does not really close the > connection when it sees a problem? > > It is odd that it is a 24hr thing, what happens at that time. > > On 1 November 2012 11:27, James Green wr

Re: Network bridge is stuck, repeatedly requires broker restart

2012-11-01 Thread James Green
listens for stomp connections on port 61612 is the above, and it's waiting on... something? Having to restart again! What's the best way forward here, anyone? Thanks again, James On 1 November 2012 12:18, James Green wrote: > Gary, > > Spokes reach out to the hub. The hub is

Re: Pending messages on queue is stale or wrong

2012-11-02 Thread James Green
I restarted AMQ. The counter remains at 55. Browsing, I now see messages! They are 40 minutes old and have redelivery true. Is there anything more that can be suggested as a result? On 2 November 2012 15:14, James Green wrote: > I am looking at the web console and the JMX connection wh

Re: Pending messages on queue is stale or wrong

2012-11-05 Thread James Green
rwise it would be interesting to find out how to reproduce the problem > so that it can be analyzed further. > > Regards, > > Torsten Mielke > tors...@fusesource.com > tmielke.blogspot.com > > > > On Nov 2, 2012, at 4:20 PM, James Green wrote: > > > I restarted AMQ

Re: Memory usage with large messages

2012-11-08 Thread James Green
the memory > usage. > > If the memory limits allow, on the send, the message will be retained > in memory and dispatched from memory. > > It would be great to get a handle on why the stomp clients on the spoke > die? > is it inactivity timeout? > > > On 8 November 2012

Re: Stomp PHP libs

2012-11-16 Thread James Green
it's client or broker problem? > > Regards > -- > Dejan Bosanac > -- > Red Hat, Inc. > FuseSource is now part of Red Hat > dbosa...@redhat.com > Twitter: @dejanb > Blog: http://sensatic.net > ActiveMQ in Action: http://www.manning.com/snyder

Re: RESTful deletion/purging of queue in default config?

2012-11-20 Thread James Green
see http://activemq.apache.org/rest.html > > On Nov 20, 2012, at 3:03, James Green wrote: > > > Trying to whip up a quick script to test performance. > > > > It would be really useful to call a URI to purge/delete the queue I'm > using > > between iterations without nee

Re: RESTful deletion/purging of queue in default config?

2012-11-20 Thread James Green
talks about mapping but there's no > > detail on that. > > > > > > > > On 20 November 2012 11:20, Gaurav Sharma > wrote: > > > >> Yes, see http://activemq.apache.org/rest.html > >> > >> On Nov 20, 2012, at 3:03, James Green wrote:

Re: RESTful deletion/purging of queue in default config?

2012-11-20 Thread James Green
part of Red Hat > dbosa...@redhat.com > Twitter: @dejanb > Blog: http://sensatic.net > ActiveMQ in Action: http://www.manning.com/snyder/ > > > On Tue, Nov 20, 2012 at 1:00 PM, James Green > wrote: > > From the console works but has a session "secret" guid which

Fusesource PHP Stomp bug

2012-11-20 Thread James Green
If I try and send a large, multi-megabyte (base64 encoded), message to a queue my script issues the following notice then "hangs" consuming all available CPU: Notice: fwrite(): send of 8192 bytes failed with errno=104 Connection reset by peer in /home/jamesg/Stomp.php on line 495 Is this library

Re: Fusesource PHP Stomp bug

2012-11-21 Thread James Green
b > Blog: http://sensatic.net > ActiveMQ in Action: http://www.manning.com/snyder/ > > > On Tue, Nov 20, 2012 at 3:57 PM, James Green > wrote: > > If I try and send a large, multi-megabyte (base64 encoded), message to a > > queue my script issues the following notic

Prefetch limit is 1? (non-persistent queue, stomp)

2012-11-22 Thread James Green
I have a stomp client connected using pretty much default settings, and I changed it to ack every 100 messages for performance. It gets one message then gives up. Checking the "Active Consumers" for the queue I two entries: A client-id, with a prefetch of 1 A connection-id, with a prefetch of 0

Re: Stomp & ActiveMQ

2012-12-08 Thread James Green
You missed the conf/activemq-stomp.xml example. Christian's kindly copied the entry it seems :) On 7 December 2012 18:24, rischfre wrote: > Hi, > > i m a bit surprise by the lack of documentation about Stomp instalation. In > my case it would be interresant as after installing ActiveMQ 5.7.0

Re: Edit permission for wiki

2012-12-18 Thread James Green
Speaking of which I am listed under the "Unlisted CLAs" and have been for months. I also wanted to update the wiki. Still can of course if someone adds me in. James On 18 December 2012 10:20, Dejan Bosanac wrote: > Hi Neil, > > you need to sign ICLA > > http://www.apache.org/dev/new-committer

Re: Edit permission for wiki

2012-12-19 Thread James Green
That's not annoying... jmkgreen all the same. On 19 December 2012 16:43, Christian Posta wrote: > James, I believe you have to create it for the wiki (not linked through > Crowd) > > > On Wed, Dec 19, 2012 at 8:39 AM, James Green >wrote: > > > My JIRA is j

Re: Network of broker question

2013-01-04 Thread James Green
We have observed this when the link between A & B is slow. Probably a different scenario to the one Mohit is describing though. In our case we had a hub behind a shared ADSL link and several spokes in "production land". We would see messages piling up at random on the spokes until restarts where i

Re: Web Console: Empty Message Details (but message is fine in stomp)

2013-01-09 Thread James Green
> Dejan Bosanac > -- > Red Hat, Inc. > FuseSource is now part of Red Hat > dbosa...@redhat.com > Twitter: @dejanb > Blog: http://sensatic.net > ActiveMQ in Action: http://www.manning.com/snyder/ > > > On Wed, Jan 9, 2013 at 10:28 AM, James Green

Re: ActiveMQ 5.8: Failed to execute purge task

2013-02-25 Thread James Green
This problem will almost certainly prevent us upgrading to 5.8.0. On 25 February 2013 11:55, Gary Tully wrote: > 5.9.0 is typically a few months away, but we have a few osgi related issues > with 5.8.0 so I think we will need to do a 5.8.1 towards the end of march > or early may when all of th

sslContext - do keys identify brokers?

2013-05-29 Thread James Green
Quick one - I want to add another spoke broker and connect it to our hub. At present each spoke has it's own Key in the keystore with a corresponding certificate on the hub. This works but I'm wondering if ActiveMQ uses the the certificates to help identify individual brokers? If I add this new

DemandForwardingBridgeSupport: one topic muted on one server

2013-05-31 Thread James Green
I'm setting up a new spoke broker. It works fine except for one durable topic subscription. I've copied the config across from an existing one that works. The spokes connect into the hub:

Re: DemandForwardingBridgeSupport: one topic muted on one server

2013-05-31 Thread James Green
OK time to face-palm myself. There were line endings in the destinationFilter. I even ignored when the copy-paste into the email showed them! Going to shift this into SVN internally! On 31 May 2013 11:26, James Green wrote: > I'm setting up a new spoke broker. It works fine except

Re: gcInactiveDestinations

2013-07-01 Thread James Green
Either give the messages an expiration time or write something to drain the destinations according to your own business logic. Then gcInactiveDestinations doesn't need to care about your specific use-case. On 28 June 2013 20:42, Paul Gale wrote: > gcInactiveDestinations is defined as delete ina

GPG failure

2010-08-18 Thread James Green
jam...@blofeld:~$ gpg --import KEYS gpg: directory `/home/jamesg/.gnupg' created gpg: new configuration file `/home/jamesg/.gnupg/gpg.conf' created gpg: WARNING: options in `/home/jamesg/.gnupg/gpg.conf' are not yet active during this run gpg: keyring `/home/jamesg/.gnupg/secring.gpg' created gpg:

Re: GPG failure

2010-08-18 Thread James Green
I suggest the public link http://www.apache.org/dist/activemq/apache-activemq/KEYS is updated :-) All works now. On 18 August 2010 12:43, Gary Tully wrote: > you must not have the latest version of the KEYS file from trunk as > Hadrians key was not imported. > see: http://svn.apache.org/viewvc?re

Subscribing with a selector over stomp isn't working

2010-08-20 Thread James Green
I'm using PHP with Stomp for connectivity. Where $o is my Stomp client: $o->subscribe("/queue/message.status.outbox", array("selector" => "AccountId = 21211")); Leaves the following trace: 2010-08-20 16:20:54,362 [127.0.0.1:44882] TRACE StompTransportFilter - Received: CONNECT passcode:

Re: Subscribing with a selector over stomp isn't working

2010-08-22 Thread James Green
I believe I've traced this. The value 21211 must be enclosed in single quotes. Without quotes it does not work. Enclosed in double quotes (") it does not work. It this one of the finer details of the JMS spec does anyone know? James On 20 August 2010 16:30, James Green wrote: >

Unix shell script to stop activemq

2010-08-24 Thread James Green
Hi, Using 5.4.0 I've symlinked /etc/init.d/activemq to /opt/activemq/bin/activemq and ran the setup command. I am able to start the process fine, but when I come to stop it I have to wait thirty seconds because of this: jam...@blofeld:/opt/activemq/conf$ sudo /etc/init.d/activemq stop INFO: Loadi

Cryptic error time!

2010-08-25 Thread James Green
On our hub I see the following: 2010-08-25 12:09:47,378 | ERROR | Failed to register subscription QueueSubscription: consumer=ID:billing-59361-1282733145999-6:14:-1:1, destinations=0, dispatched=0, delivered=0, pending=0 | org.apache.activemq.broker.jmx.ManagedRegionBroker | ActiveMQ Transport: tc

Re: Cryptic error time!

2010-08-25 Thread James Green
ote: > is there a stack trace? please post if there is. > what version of broker? > > On 25 August 2010 12:31, James Green wrote: >> On our hub I see the following: >> >> 2010-08-25 12:09:47,378 | ERROR | Failed to register subscription >> QueueSubscription: consumer

Re: Cryptic error time!

2010-08-25 Thread James Green
ueue subscription. > > Can you post the relevant stomp frames, and possibly open a jira issue > to track this and collect the relevant information. > Ideally a test case that can reproduce would be great. This seems to > be a stomp/openwire mismatch or a series of stomp commands i

Re: Cryptic error time!

2010-08-25 Thread James Green
I've created issue #2879 but I could use some help narrowing down what I need to look for. I don't even know for instance if this is triggered by a particular topic or queue. Similarly if I were to open junit I'm not sure what I'd be testing for at present. James On 25 August 2010 14:48, Gary Tu

"Working with Destinations with Stomp" <-- clarification please

2010-08-27 Thread James Green
Hi, I'm working with a stomp client and up till now I've assumed that the following it's what's needed for a nicely structured hierarchy: /queue/Foo.Bar.Baz However, an accidental post to /queue/Foo/Bar/Baz shows up in the web interface verbatim. Is the separator arbitrary then? Is dot just an

Re: Unix shell script to stop activemq

2010-08-30 Thread James Green
In short, yes. I needed to uncomment some lines in my /etc/default/activemq to enable JMX. I will post the changes hopefully tomorrow. On 29 August 2010 08:28, Romain CHANU wrote: > Hi James, > > I have the issue as well. Have you found anything solution yet? > > Cheers, > > Romain

Re: is there a doc which provides an overview of ActiveMQ from a users perspective?

2010-08-31 Thread James Green
If you have not already done so, grab a copy of "Enterprise Integration Patterns" off Amazon. Seriously worth the time investment before you get really going. I've just finished it. James On 31 August 2010 18:32, ChicagoBob123 wrote: > > I am stumbling on examples and some code snippets and have

Re: Unix shell script to stop activemq

2010-08-31 Thread James Green
As promised, I've documented what I did here: http://www.jmkg.co.uk/2010/08/31/installing-activemq-on-ubuntu/ On 29 August 2010 08:28, Romain CHANU wrote: > Hi James, > > I have the issue as well. Have you found anything solution yet? > > Cheers, > > Romain > >

Re: Unix shell script to stop activemq

2010-09-01 Thread James Green
ter.com/dejanb > > Open Source Integration - http://fusesource.com/ > ActiveMQ in Action - http://www.manning.com/snyder/ > Blog - http://www.nighttale.net > > > > On Tue, Aug 31, 2010 at 11:03 PM, James Green > wrote: >> As promised, I've documented what I d

Re: Newbie questions on NMS or CMS ActiveMQ consumers puzzle

2010-09-01 Thread James Green
AIUI unless your client is operating in an "auto-ack" mode, the client must "ack" each message it consumes to remove it from the queue. This means that if you do not acknowledge the message, it will remain for the next client. Pretty simple and prevents a client reading a message then immediately

Re: ActiveMQ - sending async persistent messages, what is the maximum that can be lost?

2010-09-13 Thread James Green
AFAIK ActiveMQ writes the persistent message to disk prior to acknowledging receipt to the producer. That's relatively simple. What do you mean by "system failure"? You mean the s/w dies or something more serious like filesystem corruption? Not entirely certain what your question really is. On 1

FIFO order - just not quite

2010-09-14 Thread James Green
Hi, I've been trying to debug an odd sequence problem. I've written a basic test case in PHP using the stomp connector. First script adds ten numbered messages (indexed from 0) to a test queue. Second script receives from the queue and spits them out. They arrive in the order: 1, 2, 3, 4, 5, 6,

Re: FIFO order - just not quite

2010-09-16 Thread James Green
ember 2010 16:16, James Green wrote: > Hi, > > I've been trying to debug an odd sequence problem. I've written a > basic test case in PHP using the stomp connector. > > First script adds ten numbered messages (indexed from 0) to a test queue. > Second script receiv

Lots of "Failed to register subscription QueueSubscription"

2010-10-12 Thread James Green
We've just gone live with ActiveMQ and we're getting lots of: 2010-10-12 13:54:07,842 | ERROR | Failed to register subscription QueueSubscription: consumer=ID:zorin-55759-1286874482476-5:1:1:105, destinations=0, dispatched=0, delivered=0, pending=0 | org.apache.activemq.broker.jmx.ManagedRegionBro

Re: Lots of "Failed to register subscription QueueSubscription"

2010-10-12 Thread James Green
I should mention this is with 5.4.1 and the "hub" server mentioned is also 5.4.1. On 12 October 2010 13:56, James Green wrote: > We've just gone live with ActiveMQ and we're getting lots of: > > 2010-10-12 13:54:07,842 | ERROR | Failed to register subscription

Help destroying 1,000+ subscribers

2010-10-21 Thread James Green
Hi, Due to a bug my side I've managed to create over 1,000 durable topic subscribers each with differing client-ids. Yep, that equals quite a mess. Somehow I need to unsubscribe these guys. Each was created by the same PHP script being invoked repeatedly overnight. I have created a script that i

Re: Thread and memory usage on 5.4.1

2010-11-03 Thread James Green
If you haven't already, try reading this: http://activemq.apache.org/javalangoutofmemory.html On 2 November 2010 10:51, Manuel Teira Paz wrote: > Hello all. > I'm working into the migration from activemq 4.1 to activemq 5.4.1. One > of the things we have noticed is a sensible growth in both mem

Re: Quest for Job queue

2010-11-07 Thread James Green
You are describing the default behaviour of an ActiveMQ consumer. Fire up the consumer and ask for the next message in the queue. Loop. Fire up a second (and more) consumer and loop. The messages will be handed out evenly. James On 7 November 2010 10:13, Allan Kamau wrote: > I am new to Active

Full host migration

2010-11-19 Thread James Green
Hi, Assume we have hosts A and B. Host A currently has an AMQ broker but is old and needs decommissioning. Host B is being set up to replace A. I do not have a master/slave configuration. Is it safe to shut down AMQ on A, rsync the entire /opt/activemq folder with it's data store and configuratio

Selected messages not being passed between brokers

2010-11-25 Thread James Green
Two 5.4.1 brokers A and B connected to each other via a duplex transport. Sender X fires a message on /queue/account_events to A, consumer Y collects from B. This is normal. Sender Z fires a message on /queue/account_events to A, consumer Y gets nothing. This is abnormal. Check broker A, /queue/

SOLVED - Re: Selected messages not being passed between brokers

2010-11-28 Thread James Green
sesource.com > Twitter: http://twitter.com/dejanb > ActiveMQ in Action - http://www.manning.com/snyder/ > Blog - http://www.nighttale.net > > > > On Thu, Nov 25, 2010 at 2:02 PM, James Green > wrote: > > Two 5.4.1 brokers A and B connected to each other via a duplex

Message arrives after unsubscribing - normal?

2010-11-30 Thread James Green
I have a Stomp-connected PHP client. I connect to a queue using a selector, receive messages then unsubscribe. Earlier today I switched on Stomp debugging to track an issue and found that after unsubscribing, one last message was sent to this newly unsubscribed client. Are there any circumstances

Re: Change Expiration

2010-12-05 Thread James Green
Mark, AMQ is just an elaborate FIFO queue of messages. If you need to change the expiration on a bunch of messages, use a client to consume them. Once flushed, you'll need to re-submit them with modified parameters as appropriate. You might be able to do all this within a transaction - I have not

Re: Query regarding the working of a message queue

2010-12-10 Thread James Green
As I see it you have two choices: 1. Use selectors. Each broker would need to be network connected to the producer's broker with a fetch size of one message which might well limit performance but would avoid possible stuck messages. http://activemq.apache.org/selectors.html 2. Use a different que

Re: ActiveMQ slowness every 30 days

2010-12-10 Thread James Green
Why do you need to redeliver topic messages? To me you are bending a message queue to react like a database. Does the log show anything? I'm wondering if the kahadb cleanup is kicking in and is eventually going over some threshold causing the slowdown. James On 9 December 2010 18:28, fenbers wr

Re: How to setup the Message Selectors on MessageConsumer

2010-12-10 Thread James Green
You put a custom header=value in when sending the message. In the consumer you specify the selectors to use when subscribing to the queue. You might want to consider using a queue per message type. If you don't want the producer to know in advance which queue is for which type of message, you cou

Re: ActiveMQ slowness every 30 days

2010-12-10 Thread James Green
. I can't comment on the rest as I don't have the necessary experience - though what you are seeing is likely the result of your perhaps unanticipated use of AMQ. James On 10 December 2010 18:34, fenbers wrote: > > > James Green-3 [via ActiveMQ] wrote: > Why do you need to red

Upgrade procedure?

2010-12-14 Thread James Green
I cannot see any references to an upgrade procedure for AMQ... I can manually rsync -zarul --delete [bin/|lib/|webapps] /opt/activemq/[bin/|lib/|webapps] but that seems rather haphazard. I've got several servers to do this across possibly tomorrow evening. So am I missing something or does it sim

message-id format

2011-01-06 Thread James Green
I am trying to debug a little of https://issues.apache.org/jira/browse/AMQ-2923 which I created. To help, could someone very quickly document how the message-id gets created? I.e. X-Y-Z what's the X, the Y and the Z? I'm trying to write a script to reproduce the problem and so far I've failed so

Is a 5.4.3 release due?

2011-03-07 Thread James Green
Hi I am having to deal with (lots of) stale log files, hopefully a result of "AMQ-2736 KahaDB doesn't clean up old files". Could someone provide guidance on whether a stable release is imminent of 5.4.3 or is everything focused on 5.5.0 (which may be far away)? Having to shutdown and restart serv

Re: In a network of brokers, Are the broker names required to be different?

2011-03-07 Thread James Green
Yeah they do need to be different I think for the network connectors to work properly. Not an unreasonable requirement I think, As to configuring lots of servers it should be possible to say load the hostname of the server directly into a placeholder within the xml file. I did take a look at this

Setup writes wrong default JMX port?

2011-04-04 Thread James Green
Using Ubuntu here, I have run setup which results in a configuration file. I have to uncomment ACTIVEMQ_SUNJMX_CONTROL in order to provide username/password. However, after doing this I get the following when restarting: INFO: Loading '/etc/default/activemq' INFO: Using java '/usr/bin/java' INFO:

Re: KahaDB data files not cleaned up

2011-04-11 Thread James Green
This is something that affects some of my installations. Is there any reason not to delete a file that should have been removed by now? James On 11 April 2011 20:37, BD wrote: > A bit more info on older kahadb journal files. I checked and they are not > open by any process. Deleting them frees

Strategy question - many queues or use selectors?

2011-04-11 Thread James Green
I'm sure this must get asked routinely but for my benefit at least, which is considered best: Have many (hundreds) of queues, or a single queue of similar messages and use selectors to pick the right ones out? To shed a little more light on my scenario we have an application to which several hundr

Missing / corrupt journal file

2011-04-21 Thread James Green
2011-04-21 15:03:59,134 | ERROR | Failed to start ActiveMQ JMS Message Broker. Reason: java.io.IOException: Detected missing/corrupt journal files. 73 messages affected. | org.apache.activemq.broker.BrokerService | main java.io.IOException: Detected missing/corrupt journal files. 73 messages affect

12G datastore - there should be virtually nothing

2011-05-06 Thread James Green
Ubuntu Linux running AMQ 5.5.0, previously running 5.4.x releases. I have just noticed our "hub" machine has 12% store used. df -h inside the kahadb dir shows 357 .log files consuming 12G of space. They begin Oct 2010 - there are no obvious large gaps over time but some files are clearly gone. Lo

Re: Scaleability problems with queue subscriptors

2011-05-06 Thread James Green
It does support prefetch. activemq.prefetchSize = n during the subscription stage. >From http://activemq.apache.org/stomp.html On 5 May 2011 21:20, Josh Carlson wrote: > We are using the STOMP protocol which doesn't support that. I was curious > if there might be any settings server side which

Re: 12G datastore - there should be virtually nothing

2011-05-06 Thread James Green
destination has a > reference to those data files. > > On 6 May 2011 09:26, James Green wrote: > > Ubuntu Linux running AMQ 5.5.0, previously running 5.4.x releases. > > > > I have just noticed our "hub" machine has 12% store used. df -h inside > the > > kah

Re: 12G datastore - there should be virtually nothing

2011-05-09 Thread James Green
gone and the messages in > the referenced data files would be replayed in error. > > That further reduces the candidate list. > > So you need to look for the channel that pulls the most from the gc > candidate list. > > > On 6 May 2011 17:18, James Green wr

Re: 12G datastore - there should be virtually nothing

2011-05-09 Thread James Green
s for the other 'NC' clients and hope to have further clean up happen. James On 9 May 2011 14:43, James Green wrote: > Gary, > > Let me check I understand you correctly. > > If I see the GC kick in and list lots of references after lots of channels > are considered, the

Re: 12G datastore - there should be virtually nothing

2011-05-09 Thread James Green
It seems there are a few NC_ clients. I'll be waiting for our office to close this evening, switching off the clients and then deleting them all. Should kill off all remaining stale references. At least this time it's not an AMQ/KahaDb bug ;-) On 9 May 2011 15:51, Gary Tully wrote: > great, tha

Re: 12G datastore - there should be virtually nothing

2011-05-09 Thread James Green
Deleted all NC_ connections and seconds later went from 11GB to 78MB, much more likely :) On 9 May 2011 16:11, James Green wrote: > It seems there are a few NC_ clients. I'll be waiting for our office to > close this evening, switching off the clients and then deleting them all. &g

Possibly a daft question

2011-05-10 Thread James Green
But I'll ask it anyway... Client(s) receiving from a topic messages 1, 2, 3 and 4. prefetch is set to 1, client to ACK. Msgs 1,2 come in and are ACK'd. Msg 3 comes in but is not ACK'd. Does msg 4 make it through or must 3 be either ACK'd or expired first? I am expecting that the queue comes to a

Big problem. Transport failed: Async Exception Handler

2011-05-24 Thread James Green
One of our staff just reported that a queue on our "hub" machine was not being read any more. Checking the logs of the PHP app we're getting: exception 'StompException' with message 'Unexpected EOF while reading from socket' Inside AMQ (5.5.0/Linux and configured with ACTIVEMQ_OPTS_MEMORY="-Xms5

Re: KahaDB and backups

2011-06-02 Thread James Green
+1 for that. What would happen in a snapshot freeze then restore to the journal file at present? Would KahaDB roll back those transactions? James On 2 June 2011 00:19, Steve Smith wrote: > > A user-space KahaDB snapshotting tool would certainly be useful regardless. > > Cheers, > Steve >

Stomp EOFException logged

2011-06-07 Thread James Green
Got a Stomp client that just reported "Server not responding". Logs from AMQ: 2011-06-07 09:45:15,087 | DEBUG | Setting up new connection id: ID:ubuntu-33097-1307336686696- 5:54, address: /127.0.0.1:36529 | org.apache.activemq.broker.TransportConnection | ActiveMQ Tr ansport: tcp:///127.0.0.1:3652

Re: Stomp EOFException logged

2011-06-07 Thread James Green
ts in open source integration and messaging - > http://fusesource.com > ActiveMQ in Action - http://www.manning.com/snyder/ > Blog - http://www.nighttale.net > > > On Tue, Jun 7, 2011 at 10:51 AM, James Green >wrote: > > > Got a Stomp client that just reported "Serv

Re: KahaDB storage size grows despite almost no pending messages

2011-06-08 Thread James Green
I experienced the same. To debug add the following to your log4j.properties file (if needed): log4j.appender.kahadb=org.apache.log4j.RollingFileAppender log4j.appender.kahadb.file=${activemq.base}/data/kahadb.log log4j.appender.kahadb.maxFileSize=1024KB log4j.appender.kahadb.maxBackupIndex=5 log4j

Re: Kahadb Corruption Scenarios

2011-06-10 Thread James Green
http://fusesource.com/docs/broker/5.4/persistence/KahaDB-Recovery.html Don't forget there are hardware-level performance improvements from the operating system down to the disks which may affect reliability. James On 8 June 2011 16:53, Ozan Seymen wrote: > Hi all, > > Can you please explain th

Re: KahaDB storage size grows despite almost no pending messages

2011-06-15 Thread James Green
> Best regards, > Martin > > On Wed, Jun 8, 2011 at 10:40 AM, James Green > wrote: > > I experienced the same. To debug add the following to your > log4j.properties > > file (if needed): > > > > log4j.appender.kahadb=org.ap

How can I remove old queues without a java client?

2011-06-15 Thread James Green
Not sure this is even possible? We dynamically create our queues by pushing messages to channels with account numbers appended. They get read as the account reads from it's queue. When that account goes dead and it's messages expired (or no more get pushed) we then end up with many queues doing no

  1   2   >