Hi Mark, Good day! Thank you very much for the reply!
Yes, we are using both Apache & Tomcat environment. Apache - 2.4.25 version Tomcat - 8.5.5 version OS - Linux You are correct, we got this error in Apache webserver logs. We are attaching both Apache httpd (error.log) and Tomcat (Catalina.out) logs Please let us know if any other information required. Thanks, Sahil -----Original Message----- From: Mark Thomas <ma...@apache.org> Sent: Wednesday, May 11, 2022 11:39 PM To: users@tomcat.apache.org Subject: Re: Help Needed for Root cause - ApacheTomcat services stopped That is an Apache Web Server (httpd) log message, not an Apache Tomcat log message. Are you sure you are using Apache Tomcat? Mark On 11/05/2022 19:01, Verma, Sahil wrote: > Hi Team, > > > > In our production environment, ApacheTomcat services went down. We > have checked the logs and found below error - > > > > [Thu May 05 10:34:51.441668 2022] [mpm_event:error] [pid 27440:tid > 140464737793792] AH00484: server reached MaxRequestWorkers setting, > consider raising the MaxRequestWorkers setting > > > > Please help to find the root cause of the issue why services got stopped. > Kindly let us know if any other information required. > > Apache version - 2.2 > OS - Linux > > > Thanks, > Sahil > > DXC Technology India Private Limited - 9th Floor, Block-D Littlewood Tower, > TRIL Info Park Ramanujan IT City, Rajiv Gandhi Salai, Taramani, Chennai - > 600113. CIN: U72900TN2015FTC102489. > DXC Technology Company -- This message is transmitted to you by or on behalf > of DXC Technology Company or one of its affiliates. It is intended > exclusively for the addressee. The substance of this message, along with any > attachments, may contain proprietary, confidential or privileged information > or information that is otherwise legally exempt from disclosure. Any > unauthorized review, use, disclosure or distribution is prohibited. If you > are not the intended recipient of this message, you are not authorized to > read, print, retain, copy or disseminate any part of this message. If you > have received this message in error, please destroy and delete all copies and > notify the sender by return e-mail. Regardless of content, this e-mail shall > not operate to bind DXC Technology Company or any of its affiliates to any > order or other contract unless pursuant to explicit written agreement or > government initiative expressly permitting the use of e-mail for such purpose. > --------------------------------------------------------------------- To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org
-bash-4.1$ cat error_log.20220505 rm: cannot remove `/share/images/pdf/Statementkimpickett20220505.zip': No such file or directory rm: cannot remove `/share/images/pdf/Statementcweishuhn20220505.zip': No such file or directory [Thu May 05 10:34:51.441668 2022] [mpm_event:error] [pid 27440:tid 140464737793792] AH00484: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting [Thu May 05 11:28:16.826878 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 27465 still did not exit, sending a SIGTERM [Thu May 05 11:28:16.826994 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 27466 still did not exit, sending a SIGTERM [Thu May 05 11:28:16.827047 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 27467 still did not exit, sending a SIGTERM [Thu May 05 11:28:16.827098 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 27698 still did not exit, sending a SIGTERM [Thu May 05 11:28:16.827151 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 27896 still did not exit, sending a SIGTERM [Thu May 05 11:28:16.827205 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 27971 still did not exit, sending a SIGTERM [Thu May 05 11:28:16.827254 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 28071 still did not exit, sending a SIGTERM [Thu May 05 11:28:16.827307 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 28135 still did not exit, sending a SIGTERM [Thu May 05 11:28:18.829711 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 27465 still did not exit, sending a SIGTERM [Thu May 05 11:28:18.829835 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 27466 still did not exit, sending a SIGTERM [Thu May 05 11:28:18.829901 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 27467 still did not exit, sending a SIGTERM [Thu May 05 11:28:18.829970 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 27698 still did not exit, sending a SIGTERM [Thu May 05 11:28:18.830032 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 27896 still did not exit, sending a SIGTERM [Thu May 05 11:28:18.830093 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 27971 still did not exit, sending a SIGTERM [Thu May 05 11:28:18.830156 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 28071 still did not exit, sending a SIGTERM [Thu May 05 11:28:18.830212 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 28135 still did not exit, sending a SIGTERM [Thu May 05 11:28:20.832544 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 27465 still did not exit, sending a SIGTERM [Thu May 05 11:28:20.832649 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 27466 still did not exit, sending a SIGTERM [Thu May 05 11:28:20.832742 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 27467 still did not exit, sending a SIGTERM [Thu May 05 11:28:20.832814 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 27698 still did not exit, sending a SIGTERM [Thu May 05 11:28:20.832881 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 27896 still did not exit, sending a SIGTERM [Thu May 05 11:28:20.832956 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 27971 still did not exit, sending a SIGTERM [Thu May 05 11:28:20.833024 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 28071 still did not exit, sending a SIGTERM [Thu May 05 11:28:20.833092 2022] [core:warn] [pid 27440:tid 140464737793792] AH00045: child process 28135 still did not exit, sending a SIGTERM [Thu May 05 11:28:22.835512 2022] [core:error] [pid 27440:tid 140464737793792] AH00046: child process 27465 still did not exit, sending a SIGKILL [Thu May 05 11:28:22.835922 2022] [core:error] [pid 27440:tid 140464737793792] AH00046: child process 27466 still did not exit, sending a SIGKILL [Thu May 05 11:28:22.836190 2022] [core:error] [pid 27440:tid 140464737793792] AH00046: child process 27467 still did not exit, sending a SIGKILL [Thu May 05 11:28:22.836397 2022] [core:error] [pid 27440:tid 140464737793792] AH00046: child process 27698 still did not exit, sending a SIGKILL [Thu May 05 11:28:22.836601 2022] [core:error] [pid 27440:tid 140464737793792] AH00046: child process 27896 still did not exit, sending a SIGKILL [Thu May 05 11:28:22.836875 2022] [core:error] [pid 27440:tid 140464737793792] AH00046: child process 27971 still did not exit, sending a SIGKILL [Thu May 05 11:28:22.837155 2022] [core:error] [pid 27440:tid 140464737793792] AH00046: child process 28071 still did not exit, sending a SIGKILL [Thu May 05 11:28:22.837425 2022] [core:error] [pid 27440:tid 140464737793792] AH00046: child process 28135 still did not exit, sending a SIGKILL [Thu May 05 11:28:23.839789 2022] [mpm_event:notice] [pid 27440:tid 140464737793792] AH00491: caught SIGTERM, shutting down [Thu May 05 11:29:48.024377 2022] [jk:warn] [pid 3764:tid 139624077395712] No JkShmFile defined in httpd.conf. Using default /opt/apache/logs/jk-runtime-status [Thu May 05 11:29:48.044975 2022] [auth_digest:notice] [pid 3769:tid 139624077395712] AH01757: generating secret for digest authentication ... [Thu May 05 11:29:49.002591 2022] [jk:warn] [pid 3769:tid 139624077395712] No JkShmFile defined in httpd.conf. Using default /opt/apache/logs/jk-runtime-status [Thu May 05 11:29:49.004715 2022] [mpm_event:notice] [pid 3769:tid 139624077395712] AH00489: Apache/2.4.25 (Unix) OpenSSL/1.0.2k mod_jk/1.2.42 configured -- resuming normal operations [Thu May 05 11:29:49.004745 2022] [core:notice] [pid 3769:tid 139624077395712] AH00094: Command line: '/opt/apache/bin/httpd' rm: cannot remove `/share/images/pdf/Statementdebbiewolfgang20220505.zip': No such file or directory rm: cannot remove `/share/images/pdf/Statementnlibby20220505.zip': No such file or directory rm: cannot remove `/share/images/pdf/Statementvickicox20220505.zip': No such file or directory rm: cannot remove `/share/images/pdf/Statementgeorgemccoy20220505.zip': No such file or directory rm: cannot remove `/share/images/pdf/Statementhuntermoffitt20220505.zip': No such file or directory [Thu May 05 13:00:31.350844 2022] [cgid:error] [pid 4415:tid 139623432800000] [client 157.55.39.127:56512] End of script output before headers: DispSTMT_BLOB rm: cannot remove `/share/images/pdf/Statementscottwhite20220505.zip': No such file or directory rm: cannot remove `/share/images/pdf/Statementlorne120220505.zip': No such file or directory [Thu May 05 14:19:48.695531 2022] [cgid:error] [pid 4831:tid 139623590147840] [client 157.55.39.127:48832] End of script output before headers: DispSTMT_BLOB [Thu May 05 14:23:18.859886 2022] [cgid:error] [pid 4415:tid 139623453779712] [client 157.55.39.127:59008] End of script output before headers: DispSTMT_BLOB [Thu May 05 15:30:12.155331 2022] [cgid:error] [pid 4831:tid 139623831414528] [client 157.55.39.127:49344] End of script output before headers: DispSTMT_BLOB rm: cannot remove `/share/images/pdf/Statementdeborahlyell20220505.zip': No such file or directory rm: cannot remove `/share/images/pdf/Statementcathymerkle20220505.zip': No such file or directory rm: cannot remove `/share/images/pdf/Statementbdecker20220505.zip': No such file or directory rm: cannot remove `/share/images/pdf/Statementkdaswani20220505.zip': No such file or directory rm: cannot remove `/share/images/pdf/Statementginajohnson20220505.zip': No such file or directory rm: cannot remove `/share/images/pdf/Statementmillerm20220505.zip': No such file or directory rm: cannot remove `/share/images/pdf/Statementpbailey20220505.zip': No such file or directory
05-May-2022 11:28:48.058 WARNING [localhost-startStop-2] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesJdbc The web application [thq] registered the JDBC driver [com.ibm.db2.jcc.DB2Driver] but failed to unregister it when the web application was stopped. To prevent a memory leak, the JDBC Driver has been forcibly unregistered. 05-May-2022 11:28:48.058 WARNING [localhost-startStop-2] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesJdbc The web application [thq] registered the JDBC driver [com.teradata.jdbc.TeraDriver] but failed to unregister it when the web application was stopped. To prevent a memory leak, the JDBC Driver has been forcibly unregistered. 05-May-2022 11:28:48.063 WARNING [localhost-startStop-2] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [thq] appears to have started a thread named [Timer-0] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: 05-May-2022 11:28:48.064 WARNING [localhost-startStop-2] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [thq] appears to have started a thread named [Thread-12] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: 05-May-2022 11:28:48.065 WARNING [localhost-startStop-2] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [thq] appears to have started a thread named [JMSCCThreadPoolMaster] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: 05-May-2022 11:28:48.066 SEVERE [localhost-startStop-2] org.apache.catalina.loader.WebappClassLoaderBase.checkThreadLocalMapForLeaks The web application [thq] created a ThreadLocal with key of type [com.ibm.msg.client.jms.internal.JmsTls$1] (value [com.ibm.msg.client.jms.internal.JmsTls$1@17a957aa]) and a value of type [com.ibm.msg.client.jms.internal.JmsTls] (value [com.ibm.msg.client.jms.internal.JmsTls@10456393]) but failed to remove it when the web application was stopped. Threads are going to be renewed over time to try and avoid a probable memory leak.
--------------------------------------------------------------------- To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org
