Hi, I've a tomcat (6.0.18) running on an ubuntu 9.04 (64bit) that run a Jira and a personnal webapp that somehow stop to works.
I didn't change anything to the tomcat configuration or webapps. Tomcat was using APR and is linked to Apache 2 with modjk. One day I noticed that tomcat was not running, so I try to start it and I get this error : Sep 2, 2009 3:42:25 PM org.apache.coyote.http11.Http11AprProtocol init SEVERE: Error initializing endpoint java.lang.Exception:* Socket bind failed: [22] Invalid argument* at org.apache.tomcat.util.net.AprEndpoint.init(AprEndpoint.java:623) at org.apache.coyote.http11.Http11AprProtocol.init(Http11AprProtocol.java:107) at org.apache.catalina.connector.Connector.initialize(Connector.java:1058) at org.apache.catalina.core.StandardService.initialize(StandardService.java:677) at org.apache.catalina.core.StandardServer.initialize(StandardServer.java:795) at org.apache.catalina.startup.Catalina.load(Catalina.java:535) at org.apache.catalina.startup.Catalina.load(Catalina.java:555) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.catalina.startup.Bootstrap.load(Bootstrap.java:260) at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:412) Sep 2, 2009 3:42:25 PM org.apache.catalina.startup.Catalina load SEVERE: Catalina.start L*ifecycleException: Protocol handler initialization failed: java.lang.Exception: Socket bind failed: [22] Invalid argument* at org.apache.catalina.connector.Connector.initialize(Connector.java:1060) at org.apache.catalina.core.StandardService.initialize(StandardService.java:677) at org.apache.catalina.core.StandardServer.initialize(StandardServer.java:795) at org.apache.catalina.startup.Catalina.load(Catalina.java:535) at org.apache.catalina.startup.Catalina.load(Catalina.java:555) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.catalina.startup.Bootstrap.load(Bootstrap.java:260) at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:412) Sep 2, 2009 3:42:25 PM org.apache.catalina.startup.Catalina load INFO: Initialization processed in 1340 ms Sep 2, 2009 3:42:25 PM org.apache.catalina.core.StandardService start I've googled and find only old post related to APR. APR has been compiled this way : sudo aptitude install make gcc gcc-4.2 gcc-4.2-locales gcc-4.2-multilib libapr1-dev cd /usr/local/apache-tomcat-6.0.18/bin/ tar zxf tomcat-native.tar.gz cd /usr/local/apache-tomcat-6.0.18/bin/tomcat-native-1.1.14-src/jni/native ./configure --with-apr=/usr/bin/apr-config; make; sudo make install cd /usr/lib sudo ln -s /usr/local/apr/lib/libtcnative-1.so.0.1.14 libtcnative-1.so and, it was working : tho...@home:/home/special/tomcat/logs$ cat catalina.out Oct 18, 2008 9:13:02 PM org.apache.catalina.core.AprLifecycleListener init *INFO: Loaded APR based Apache Tomcat Native library 1.1.14.* Oct 18, 2008 9:13:02 PM org.apache.catalina.core.AprLifecycleListener init *INFO: APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true].* Oct 18, 2008 9:13:02 PM org.apache.catalina.core.AprLifecycleListener lifecycleEvent INFO: Failed to initialize the SSLEngine. Oct 18, 2008 9:13:02 PM org.apache.coyote.http11.Http11AprProtocol init INFO: Initializing Coyote HTTP/1.1 on http-8080 Oct 18, 2008 9:13:02 PM org.apache.coyote.ajp.AjpAprProtocol init INFO: Initializing Coyote AJP/1.3 on ajp-8009 Oct 18, 2008 9:13:02 PM org.apache.catalina.startup.Catalina load INFO: Initialization processed in 708 ms So I've tryed to upgrade to tomcat 6.0.20 without APR installed, no change. (I'm still using this version now) Regarding the port bind issue : tho...@home:/home/special/tomcat/conf$ grep port server.xml <Server port="8005" shutdown="SHUTDOWN"> <!-- JMX Support for the Tomcat server. Documentation at /docs/non-existent.html --> Define a non-SSL HTTP/1.1 Connector on port 8080 <Connector port="8080" protocol="HTTP/1.1" port="8080" protocol="HTTP/1.1" <!-- Define a SSL HTTP/1.1 Connector on port 8443 <Connector port="8443" protocol="HTTP/1.1" SSLEnabled="true" <!-- Define an AJP 1.3 Connector on port 8009 --> <!--Connector port="8009" protocol="AJP/1.3" redirectPort="8443" /--> <!-- You should set jvmRoute to support load-balancing via AJP ie : *Standart ports configured : 8080, 8005, 8009* tho...@home:/home/special/tomcat/logs$ /bin/ps -ef | grep java thomas 12628 10333 0 10:21 pts/0 00:00:00 grep --color=auto java *no java running* tho...@home:/home/special/tomcat/logs$ ll total 8 drwxr-xr-x 2 thomas thomas 4096 2009-09-11 10:21 . drwxr-xr-x 10 thomas thomas 4096 2009-08-24 14:20 .. Empty Log tho...@home:/home/special/tomcat/logs$ sudo netstat -netpl Active Internet connections (only servers) Proto Recv-Q Send-Q Local Address Foreign Address State User Inode PID/Program name tcp 0 0 127.0.0.1:3493 0.0.0.0:* LISTEN 0 9954 4255/upsd tcp 0 0 0.0.0.0:4712 0.0.0.0:* LISTEN 1003 7567 3364/amuled tcp 0 0 127.0.0.1:3306 0.0.0.0:* LISTEN 109 7298 3273/mysqld tcp 0 0 192.168.0.1:9101 0.0.0.0:* LISTEN 111 9833120 18027/bacula-dir tcp 0 0 192.168.0.1:9102 0.0.0.0:* LISTEN 0 9833136 18068/bacula-fd tcp 0 0 192.168.0.1:9103 0.0.0.0:* LISTEN 111 9833196 18107/bacula-sd tcp 0 0 0.0.0.0:4662 0.0.0.0:* LISTEN 1003 7569 3364/amuled tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 0 7070 3104/sshd tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN 0 12518982 4219/cupsd tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN 0 8301 3753/exim4 tcp 0 0 127.0.0.1:6010 0.0.0.0:* LISTEN 1000 12573779 10331/0 tcp6 0 0 ::1:3493 :::* LISTEN 0 9956 4255/upsd tcp6 0 0 :::139 :::* LISTEN 0 8488 3808/smbd tcp6 0 0 :::80 :::* LISTEN 0 1856347 4737/apache2 tcp6 0 0 :::22 :::* LISTEN 0 7072 3104/sshd tcp6 0 0 ::1:6010 :::* LISTEN 1000 12573778 10331/0 tcp6 0 0 :::445 :::* LISTEN 0 8486 3808/smbd no tomcat port used tho...@home:/home/special/tomcat/logs$ sudo service tomcat start Using CATALINA_BASE: /home/special/tomcat Using CATALINA_HOME: /usr/local/tomcat Using CATALINA_TMPDIR: /home/special/tomcat/temp Using JRE_HOME: /usr/lib/jvm/java-6-sun tho...@home:/home/special/tomcat/logs$ cat catalina.out Sep 11, 2009 10:22:22 AM org.apache.coyote.http11.Http11AprProtocol init *SEVERE: Error initializing endpoint* *java.lang.Exception: Socket bind failed: [22] Invalid argument* at org.apache.tomcat.util.net.AprEndpoint.init(AprEndpoint.java:623) at org.apache.coyote.http11.Http11AprProtocol.init(Http11AprProtocol.java:107) at org.apache.catalina.connector.Connector.initialize(Connector.java:1058) at org.apache.catalina.core.StandardService.initialize(StandardService.java:677) at org.apache.catalina.core.StandardServer.initialize(StandardServer.java:795) at org.apache.catalina.startup.Catalina.load(Catalina.java:535) at org.apache.catalina.startup.Catalina.load(Catalina.java:555) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.catalina.startup.Bootstrap.load(Bootstrap.java:260) at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:412) Sep 11, 2009 10:22:22 AM org.apache.catalina.startup.Catalina load *SEVERE: Catalina.start* *LifecycleException: Protocol handler initialization failed: java.lang.Exception: Socket bind failed: [22] Invalid argument* at org.apache.catalina.connector.Connector.initialize(Connector.java:1060) at org.apache.catalina.core.StandardService.initialize(StandardService.java:677) at org.apache.catalina.core.StandardServer.initialize(StandardServer.java:795) at org.apache.catalina.startup.Catalina.load(Catalina.java:535) at org.apache.catalina.startup.Catalina.load(Catalina.java:555) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.catalina.startup.Bootstrap.load(Bootstrap.java:260) at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:412) Sep 11, 2009 10:22:22 AM org.apache.catalina.startup.Catalina load INFO: Initialization processed in 1596 ms Sep 11, 2009 10:22:22 AM org.apache.catalina.core.StandardService start INFO: Starting service Catalina Sep 11, 2009 10:22:22 AM org.apache.catalina.core.StandardEngine start INFO: Starting Servlet Engine: Apache Tomcat/6.0.20 Sep 11, 2009 10:22:27 AM org.apache.catalina.core.StandardContext start SEVERE: Error listenerStart Sep 11, 2009 10:22:27 AM org.apache.catalina.session.PersistentManagerBase start SEVERE: No Store configured, persistence disabled Sep 11, 2009 10:22:27 AM org.apache.catalina.core.StandardContext start SEVERE: Context [/jira] startup failed due to previous errors 2009-09-11 10:22:29,689 - INFO - main (ContextLoader.java:189) - Root WebApplicationContext: initialization started 2009-09-11 10:22:29,774 - INFO - main (AbstractApplicationContext.java:412) - Refreshing org.springframework.web.context.support.xmlwebapplicationcont...@2d82ef6b: display name [Root WebApplicationContext]; startup date [Fri Sep 11 10:22:29 CEST 2009]; root of context hierarchy 2009-09-11 10:22:30,006 - INFO - main (XmlBeanDefinitionReader.java:323) - Loading XML bean definitions from ServletContext resource [/WEB-INF/applicationContext.xml] 2009-09-11 10:22:30,143 - INFO - main (XmlBeanDefinitionReader.java:323) - Loading XML bean definitions from ServletContext resource [/WEB-INF/spring/propertiesAndLogger.xml] 2009-09-11 10:22:30,229 - INFO - main (XmlBeanDefinitionReader.java:323) - Loading XML bean definitions from ServletContext resource [/WEB-INF/spring/cache.xml] 2009-09-11 10:22:30,269 - INFO - main (XmlBeanDefinitionReader.java:323) - Loading XML bean definitions from ServletContext resource [/WEB-INF/spring/dao.xml] 2009-09-11 10:22:30,523 - INFO - main (XmlBeanDefinitionReader.java:323) - Loading XML bean definitions from ServletContext resource [/WEB-INF/spring/scheduler.xml] 2009-09-11 10:22:30,589 - INFO - main (XmlBeanDefinitionReader.java:323) - Loading XML bean definitions from ServletContext resource [/WEB-INF/spring/dwr.xml] 2009-09-11 10:22:30,661 - INFO - main (XmlBeanDefinitionReader.java:323) - Loading XML bean definitions from ServletContext resource [/WEB-INF/spring/services.xml] 2009-09-11 10:22:30,740 - INFO - main (AbstractApplicationContext.java:427) - Bean factory for application context [org.springframework.web.context.support.xmlwebapplicationcont...@2d82ef6b]: org.springframework.beans.factory.support.defaultlistablebeanfact...@61672bbb 2009-09-11 10:22:31,209 - INFO - main (PropertiesLoaderSupport.java:178) - Loading properties file from class path resource [crf-irp.properties] 2009-09-11 10:22:31,318 - INFO - main (DefaultListableBeanFactory.java:414) - Pre-instantiating singletons in org.springframework.beans.factory.support.defaultlistablebeanfact...@61672bbb: defining beans [exportHostList,exportPath,fr.croixrouge.utilities.web.conf.PerMachinePropertyPlaceholderConfigurer#0,Log4JConfigurer,EHCacheManager,UtilCacheHashesFB,crfIrpDataSource,jdbcTemplate,txManager,org.springframework.aop.config.internalAutoProxyCreator,org.springframework.transaction.annotation.AnnotationTransactionAttributeSource#0,org.springframework.transaction.interceptor.TransactionInterceptor#0,org.springframework.transaction.config.internalTransactionAdvisor,org.springframework.scheduling.quartz.SchedulerFactoryBean#0,cronTrigger,clockJob,clockJobExecuter,monitorOutputDispositif,monitor,monitorOutputIntervention,monitorInput,monitorInputDispositif,monitorInputIntervention,monitorInputBilan,monitorCommons,homepage,regulationService,dispositifService,equipierService,listService,interventionService,lieuService,dispositifInterventionDelegate,SecurityService]; root of factory hierarchy Sep 11, 2009 10:22:45 AM org.apache.catalina.core.StandardContext start SEVERE: Error listenerStart Sep 11, 2009 10:22:45 AM org.apache.catalina.core.StandardContext start SEVERE: Context [/crf-irp] startup failed due to previous errors Sep 11, 2009 10:22:45 AM org.apache.coyote.http11.Http11AprProtocol start *SEVERE: Error starting endpoint* *java.lang.Exception: Socket bind failed: [22] Invalid argument* at org.apache.tomcat.util.net.AprEndpoint.init(AprEndpoint.java:623) at org.apache.tomcat.util.net.AprEndpoint.start(AprEndpoint.java:730) at org.apache.coyote.http11.Http11AprProtocol.start(Http11AprProtocol.java:137) at org.apache.catalina.connector.Connector.start(Connector.java:1131) at org.apache.catalina.core.StandardService.start(StandardService.java:531) at org.apache.catalina.core.StandardServer.start(StandardServer.java:710) at org.apache.catalina.startup.Catalina.start(Catalina.java:583) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:288) at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:413) Sep 11, 2009 10:22:45 AM org.apache.catalina.startup.Catalina start *SEVERE: Catalina.start:* *LifecycleException: service.getName(): "Catalina"; Protocol handler start failed: java.lang.Exception: Socket bind failed: [22] Invalid argument* at org.apache.catalina.connector.Connector.start(Connector.java:1138) at org.apache.catalina.core.StandardService.start(StandardService.java:531) at org.apache.catalina.core.StandardServer.start(StandardServer.java:710) at org.apache.catalina.startup.Catalina.start(Catalina.java:583) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:288) at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:413) *2 errors almost the same but different...* Sep 11, 2009 10:22:45 AM org.apache.catalina.startup.Catalina start INFO: Server startup in 22667 ms tho...@home:/home/special/tomcat/logs$ sudo netstat -netpl Active Internet connections (only servers) Proto Recv-Q Send-Q Local Address Foreign Address State User Inode PID/Program name tcp 0 0 127.0.0.1:3493 0.0.0.0:* LISTEN 0 9954 4255/upsd tcp 0 0 0.0.0.0:4712 0.0.0.0:* LISTEN 1003 7567 3364/amuled tcp 0 0 127.0.0.1:3306 0.0.0.0:* LISTEN 109 7298 3273/mysqld tcp 0 0 192.168.0.1:9101 0.0.0.0:* LISTEN 111 9833120 18027/bacula-dir tcp 0 0 192.168.0.1:9102 0.0.0.0:* LISTEN 0 9833136 18068/bacula-fd tcp 0 0 192.168.0.1:9103 0.0.0.0:* LISTEN 111 9833196 18107/bacula-sd tcp 0 0 0.0.0.0:4662 0.0.0.0:* LISTEN 1003 7569 3364/amuled tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 0 7070 3104/sshd tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN 0 12518982 4219/cupsd tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN 0 8301 3753/exim4 tcp 0 0 127.0.0.1:6010 0.0.0.0:* LISTEN 1000 12573779 10331/0 *tcp6 0 0 127.0.0.1:8005 :::* LISTEN 0 12588180 12716/java* tcp6 0 0 ::1:3493 :::* LISTEN 0 9956 4255/upsd tcp6 0 0 :::139 :::* LISTEN 0 8488 3808/smbd tcp6 0 0 :::80 :::* LISTEN 0 1856347 4737/apache2 tcp6 0 0 :::22 :::* LISTEN 0 7072 3104/sshd tcp6 0 0 ::1:6010 :::* LISTEN 1000 12573778 10331/0 tcp6 0 0 :::445 :::* LISTEN 0 8486 3808/smbd tho...@home:/home/special/tomcat/logs$ Here is something really strange : it says java is running on 127.0.0.1 but on proto tcp6 !! * * * * *Tomcat init script : * * * *tho...@home:/home/special/tomcat/conf$ cat /etc/init.d/tomcat # Tomcat auto-start # # description: Auto-starts tomcat # processname: tomcat # pidfile: /var/run/tomcat.pid JAVA_HOME=/usr/lib/jvm/java-6-sun; export JAVA_HOME JAVA_OPTS="-server -Xms100m -Xmx512m"; export JAVA_OPTS CATALINA_HOME=/usr/local/tomcat; export CATALINA_HOME CATALINA_BASE=/home/special/tomcat; export CATALINA_BASE case $1 in start) sh $CATALINA_HOME/bin/startup.sh ;; stop) sh $CATALINA_HOME/bin/shutdown.sh ;; restart) sh $CATALINA_HOME/bin/shutdown.sh sh $CATALINA_HOME/bin/startup.sh ;; *) echo $"Usage: $0 {start|stop|restart}" exit 1 esac exit 0 * * * *tho...@home:/home/special/tomcat/conf$ ll /usr/local/ total 52 drwxr-xr-x 13 root root 4096 2009-09-02 15:35 . drwxr-xr-x 12 root root 4096 2008-10-18 19:28 .. drwxr-xr-x 9 thomas thomas 4096 2009-09-02 15:35 apache-tomcat-6.0.18 drwxr-xr-x 9 thomas thomas 4096 2009-09-02 15:34 apache-tomcat-6.0.20 drwxr-xr-x 5 root root 4096 2008-10-18 21:03 apr drwxr-xr-x 3 root root 4096 2008-10-08 22:47 bin drwxr-xr-x 2 root root 4096 2008-10-01 20:02 etc drwxr-xr-x 2 root root 4096 2008-10-01 20:02 games drwxr-xr-x 2 root root 4096 2008-10-01 20:02 include drwxr-xr-x 6 root root 4096 2009-08-05 17:39 lib lrwxrwxrwx 1 root root 9 2008-10-01 20:02 man -> share/man drwxr-xr-x 2 root root 4096 2008-10-01 20:02 sbin drwxr-xr-x 11 root root 4096 2009-08-05 17:41 share drwxr-xr-x 2 root root 4096 2008-10-01 20:02 src lrwxrwxrwx 1 root root 20 2009-09-02 15:35 tomcat -> apache-tomcat-6.0.20 * * * * * * * *Here is my network configuration : * * * *tho...@home:/home/special/tomcat/conf$ cat /etc/network/interfaces # This file describes the network interfaces available on your system # and how to activate them. For more information, see interfaces(5). # The loopback network interface auto lo iface lo inet loopback # The primary network interface auto eth0 iface eth0 inet static address 192.168.0.1 netmask 255.255.255.0 broadcast 192.168.0.255 gateway 192.168.0.254 iface eth0 inet6 static address 2a01:e35:8a60:6471:22e:c6ef:fef6:df6e netmask 64 gateway 2a01:e35:8a60:6471::1 * * * any ideas? Regards, Thomas.