Hi Rainer, Also find attached the jk log file of the reply timeout occurrence of today in Prod envt.Please notice the thread "1258649952" which has failed and there are also some successful responses seen in the intermediate duration.I am not sure at this point if this belongs to the same request or due to a parallel thread.At this point,I am not able to enable the debug logs in prod as it might overflow the log bringing down the web instance.
Regards, Bala -----Original Message----- From: Balakarthik Baskaran (WT01 - Retail, CPG, Transportation & Gover Sent: Monday, September 14, 2009 12:52 PM To: 'Tomcat Users List' Subject: RE: Need Help - Mod_jk/Apache - Mutiple Content issue Hi Rainer, Pfa the config files in txt format.I tried with the combinatrions available in the settings marked with comments. Also,could you pl let me know the following: - Will the access log contain an entry for each request that is seen in the jk log?I can see a corresponding entry in the accesslog for an entry in the jk log in my local setup.But I coulnt interpret the same from my prod log.I hope getting this will provide some direction on what element is creating the timeout as from the prod log I can see one entry haing the a timeout in the same time perios as that of the other requests.Pl let me know how to interpret the files.I have sent you the prod log file in my prev mail.Pl let me know if you would like to resend the same or any other details.I too the all entries around 13:44:08 from both logs from prod. Regards, Bala -----Original Message----- From: Rainer Jung [mailto:rainer.j...@kippdata.de] Sent: Thursday, September 10, 2009 10:43 PM To: Tomcat Users List Subject: Re: Need Help - Mod_jk/Apache - Mutiple Content issue On 10.09.2009 14:46, balakarthik.baska...@wipro.com wrote: > Hi Rainer, > > I did tried with a lot of combinations for the settings and can see > that when recovery_options is set,no multiple content is seen and > partial content is seen followed by an "OK" message when a huge chunk > of data is written. However,the failover case didn't at all work out > when the recovery_options is set.Pfa a doc with the scenarios that I > tested and the results that I am seeing. > > However,in our prod envt,we currently have the reply_timeout and the > recovery_options setting available and we have reomoved the > socket_timeout.The recent behaviour that we are observing is,unlike > the duplicate content with the header that we saw earlier with > socket_timeout,we are seeing some of the content in the middle of the > response being duplicated. > > We are making use of dynamic includes of the jsp files (with ATG dsp > tags) and when I tried having the same in my local setup,I could see > the response being written into the socket once the jsp completes.But > not able to replicate a scenario of recreating multiple content from > the middle of the page/content served by a fragment that is included. > > Pfa a file with the behaviour that I am noticing from the access and > jk log files.For the test app,I could see only one GET request and a > corresponding response in the jk log with the response time.I included > one image and I can see a corresponding entry for the image as well in > both files.However,there are no entries seen for the included jsp files. > > I am attaching the log entries from our prod envt as well which I took > when I was able to see a timeout reply in the jk file.However,from the > access log I couldn't interpret a corresponding entry/behaviour.Could > you pl help on how the multiple content could have been occuring in > the middle and your insights from the log files? (Also,pl note that we > have currenlty turned off akamai in prod and the timeout is seen > without akamai as well) Let's start in the right way, first fix the configuration, then do and analyze the tests, maybe resulting in more config optimization. Please post your config. I had a quick look at the files you attached, but it looks very much like we first need to improve the config, before analyzing behaviour, that will likely not appear with the right config. > Also,reg your explanation about akamai,I can contact akamai to find > out if they can handle the prematurely closed data differently.Do you > remember any setting to the browser to interpret this invalid data > based on content length/premature closure?(just for testing though > wouldn't apply to real life scenario) No there is no such browser setting that I'm aware of. But akamai is not a browser, its a server that behaves more like a cache. So they need to solve a server problem, not an end user problem. They should immediately invalidate content, that was delivered over a connection that had a protocol abort. > Thanks much for your help.I can give you a call if you would like to > discuss this over phone. Lets first check the config, maybe then everything will be fine ;) Regards, Rainer --------------------------------------------------------------------- To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org Please do not print this email unless it is absolutely necessary. The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. www.wipro.com
[Sun Sep 13 08:28:30 2009]bbolsp-A-lb www.XYZ.com 0.039989 [Sun Sep 13 08:28:30 2009]bbolsp-A-lb www.XYZ.com 0.345847 [Sun Sep 13 08:28:30 2009]bbolsp-A-lb www.XYZ.com 0.286399 [Sun Sep 13 08:28:30 2009]bbolsp-A-lb www.XYZ.com 0.258498 [Sun Sep 13 08:28:30 2009]bbolsp-A-lb www.XYZ.com 0.056257 [Sun Sep 13 08:28:30 2009]bbolsp-A-lb www.XYZ.com 0.306971 [Sun Sep 13 08:28:30 2009]bbolsp-A-lb www.XYZ.com 1.144702 [Sun Sep 13 08:28:30 2009]bbolsp-A-lb www.XYZ.com 0.170699 [Sun Sep 13 08:28:30 2009]bbolsp-A-lb www.XYZ.com 0.155535 [Sun Sep 13 08:28:30 2009]bbolsp-A-lb www.XYZ.com 0.085321 [Sun Sep 13 08:28:30 2009]bbolsp-A-lb www.XYZ.com 0.024867 [Sun Sep 13 08:28:30 2009][22486:1258649952] [error] ajp_get_reply::jk_ajp_common.c (1884): (bbolsp-app03-37) Timeout with wa iting reply from tomcat. Tomcat is down, stopped or network problems (errno=110) [Sun Sep 13 08:28:30 2009]bbolsp-A-lb www.XYZ.com 0.129704 [Sun Sep 13 08:28:30 2009]bbolsp-A-lb www.XYZ.com 0.115269 [Sun Sep 13 08:28:30 2009]bbolsp-A-lb www.XYZ.com 0.261159 [Sun Sep 13 08:28:30 2009]bbolsp-A-lb www.XYZ.com 0.220318 [Sun Sep 13 08:28:30 2009]bbolsp-A-lb www.XYZ.com 0.020328 [Sun Sep 13 08:28:30 2009]bbolsp-A-lb www.XYZ.com 0.441125 [Sun Sep 13 08:28:30 2009]bbolsp-A-lb www.XYZ.com 0.296755 [Sun Sep 13 08:28:31 2009]bbolsp-A-lb www.XYZ.com 0.071449 [Sun Sep 13 08:28:31 2009]bbolsp-A-lb www.XYZ.com 0.139041 [Sun Sep 13 08:28:31 2009]bbolsp-A-lb www.XYZ.com 0.061829 [Sun Sep 13 08:28:31 2009]bbolsp-A-lb www.XYZ.com 0.134434 [Sun Sep 13 08:28:31 2009]bbolsp-A-lb www.XYZ.com 0.028043 [Sun Sep 13 08:28:31 2009]bbolsp-A-lb www.XYZ.com 0.863276 [Sun Sep 13 08:28:31 2009]bbolsp-A-lb www.XYZ.com 0.350392 [Sun Sep 13 08:28:31 2009]bbolsp-A-lb www.XYZ.com 0.208796 [Sun Sep 13 08:28:31 2009]bbolsp-A-lb www.XYZ.com 0.186224 [Sun Sep 13 08:28:31 2009]bbolsp-A-lb www.XYZ.com 0.031469 [Sun Sep 13 08:28:31 2009]bbolsp-A-lb www.XYZ.com 0.328612 [Sun Sep 13 08:28:31 2009]bbolsp-A-lb www.XYZ.com 0.263672 [Sun Sep 13 08:28:31 2009]bbolsp-A-lb www.XYZ.com 0.239733 [Sun Sep 13 08:28:32 2009]bbolsp-A-lb www.XYZ.com 0.063436 [Sun Sep 13 08:28:32 2009]bbolsp-A-lb www.XYZ.com 0.371411 [Sun Sep 13 08:28:32 2009]bbolsp-A-lb www.XYZ.com 0.224932 [Sun Sep 13 08:28:32 2009]bbolsp-A-lb www.XYZ.com 0.151491 [Sun Sep 13 08:28:32 2009]bbolsp-A-lb www.XYZ.com 0.281606 [Sun Sep 13 08:28:32 2009]bbolsp-A-lb www.XYZ.com 0.279110 [Sun Sep 13 08:28:32 2009]bbolsp-A-lb www.XYZ.com 0.587669 [Sun Sep 13 08:28:32 2009][22486:1258649952] [error] ajp_service::jk_ajp_common.c (2400): (bbolsp-app03-37) sending request t o tomcat failed (unrecoverable), because of reply timeout (attempt=1) [Sun Sep 13 08:28:32 2009][22486:1258649952] [error] service::jk_lb_worker.c (1372): unrecoverable error 504, request failed. Tomcat failed in the middle of request, we can't recover to another instance. [Sun Sep 13 08:28:32 2009][22486:1258649952] [error] service::jk_lb_worker.c (1432): All tomcat instances failed, no more wor kers left [Sun Sep 13 08:28:32 2009]bbolsp-A-lb www.XYZ.com 182.004225 [Sun Sep 13 08:28:32 2009]bbolsp-A-lb www.XYZ.com 0.292797 [Sun Sep 13 08:28:32 2009]bbolsp-A-lb www.XYZ.com 0.077609 [Sun Sep 13 08:28:32 2009]bbolsp-A-lb www.XYZ.com 0.015746 [Sun Sep 13 08:28:32 2009]bbolsp-A-lb www.XYZ.com 0.221490 [Sun Sep 13 08:28:32 2009]bbolsp-A-lb www.XYZ.com 0.875568
--------------------------------------------------------------------- To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org
