Re: ActiveMQ crashes frequently

2013-06-05 Thread Matt Pavlovich
>often taking 10 seconds to list just 5 files in an NFS-mounted That screams network issue. + Check your network interface stats for errors (ifconfig) + Check your duplex setting -- many switches do not really do "auto" well. Hard-coding to full-duplex helps, but if you have a managed s

Re: ActiveMQ crashes frequently

2013-06-02 Thread Johan Edstrom
It sounds like your switch fabric might be the issue? Those types of hangs should show pretty frequent kernel alarms. On Jun 2, 2013, at 21:10, Christian Posta wrote: > You should checkout the failover transport to handle reconnecting. > > On Sunday, June 2, 2013, fenbers wrote: > >> >> >>

Re: ActiveMQ crashes frequently

2013-06-02 Thread Christian Posta
You should checkout the failover transport to handle reconnecting. On Sunday, June 2, 2013, fenbers wrote: > > > > > > I don't know how to determine the NFS version but we are running on > RHEL 5.5. > > I have not checked the syslog.  Thanks for the tip.  I will > do that > after

Re: ActiveMQ crashes frequently

2013-06-02 Thread fenbers
I don't know how to determine the NFS version but we are running on RHEL 5.5. I have not checked the syslog.  Thanks for the tip.  I will do that after our morning Operations. We are also very inclined to believe this is an NFS issue, based on beh

Re: ActiveMQ crashes frequently

2013-05-29 Thread Robert Davies
Ultimately I'm pretty confident this problem is an NFS problem - and as Johan has already let the cat out of the bag ;) - let me ask the following: Which version of NFS 4 are you using and which environment? Have you checked the system logs for NFS errors on all the machines running ActiveMQ

Re: ActiveMQ crashes frequently

2013-05-28 Thread Christian Posta
I can make two recommendations. #1, being the preferred, create a test case that shows this... that will give us the best chance of finding out what's going on... take a look at the following test cases in the activemq source code to give you an idea about how to go about doing it... http://svn.a

Re: ActiveMQ crashes frequently

2013-05-28 Thread fenbers
I'm getting the Sync exception on both, local and NFS.  Originally, I was only using a local disk, but there wasn't much disk space for the ever growing list of 33MB enumerated .log files that weren't cleaned up.  So I reconfigured ActiveMQ to put these db files on an

Re: ActiveMQ crashes frequently

2013-05-28 Thread Christian Posta
Sounds like there's multiple issues... You're journal files aren't being cleaned up, AND you're getting the Sync exception? You get the sync exception on local disk mount? Or just NFS? If the journals aren't being cleaned up, are your consumers properly ack'ing messages? On Tue, May 28, 2013 at

Re: ActiveMQ crashes frequently

2013-05-28 Thread fenbers
I would LOVE to help you help me!  But I have no idea how to go about making a test case.  If you could drop some hints in this regard, I might be able to produce one. My ActiveMQ issues seem to be related to network slowness, which we are diagnosing separat

Re: ActiveMQ crashes frequently

2013-05-28 Thread Johan Edstrom
I smelled the word NFS too. On May 28, 2013, at 3:18 PM, Robert Davies wrote: > Hi Mark, > > could you produce a test case for your problem - it would help us identify > the problem a lot quicker > > thanks, > > Rob > On 30 Apr 2013, at 16:40, fenbers wrote: > >> Zagan wrote >>> Can yo

Re: ActiveMQ crashes frequently

2013-05-28 Thread Robert Davies
Hi Mark, could you produce a test case for your problem - it would help us identify the problem a lot quicker thanks, Rob On 30 Apr 2013, at 16:40, fenbers wrote: > Zagan wrote >> Can you please check if your .log files in the /data directory are cleaned >> up? On basis of the information I s

Re: ActiveMQ crashes frequently

2013-04-30 Thread fenbers
Zagan wrote > Can you please check if your .log files in the /data directory are cleaned > up? On basis of the information I suppose this behaviour is due to a > misconfiguration of your clients. > If this is the case often broken log file cleanup is a symptom. I get the same error as brought up i

Re: ActiveMQ crashes frequently

2012-01-19 Thread Zagan
Hi I run in the same issue a time ago. Can you please check if your .log files in the /data directory are cleaned up? On basis of the information I suppose this behaviour is due to a misconfiguration of your clients. If this is the case often broken log file cleanup is a symptom. -- View this mess