Below is the most recent Exception Access Violation tcnative Error we are receiving. This error log is generated every time the service randomly stops causing us to believe this to be the primary catalyst.
# # A fatal error has been detected by the Java Runtime Environment: # # EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000001800057b2, pid=4648, tid=5464 # # JRE version: 6.0_21-b07 # Java VM: Java HotSpot(TM) 64-Bit Server VM (17.0-b17 mixed mode windows-amd64 ) # Problematic frame: # C [tcnative-1.dll+0x57b2] # # If you would like to submit a bug report, please visit: # http://java.sun.com/webapps/bugreport/crash.jsp # The crash happened outside the Java Virtual Machine in native code. # See problematic frame for where to report the bug. # --------------- T H R E A D --------------- Current thread (0x0000000004f32800): JavaThread "Finalizer" daemon [_thread_in_native, id=5464, stack(0x0000000005b50000,0x0000000005c50000)] siginfo: ExceptionCode=0xc0000005, reading address 0x0000000000000040 Registers: EAX=0x0000000000000000, EBX=0x0000000000000000, ECX=0x000000000742bb60, EDX=0x0000000007d23000 ESP=0x0000000005c4ee30, EBP=0x0000000000000000, ESI=0x0000000007457c20, EDI=0x000000000000006f EIP=0x00000001800057b2, EFLAGS=0x0000000000010206 Top of Stack: (sp=0x0000000005c4ee30) 0x0000000005c4ee30: 000000000000006f 0000000000000000 0x0000000005c4ee40: 0000000000000087 0000000000000000 0x0000000005c4ee50: 00000000013959ce 00000000013a1260 0x0000000005c4ee60: 0000000005c4eee0 000000000000006f 0x0000000005c4ee70: 0000000080c39190 0000000000000054 0x0000000005c4ee80: 000000000000006f 000000000000006f 0x0000000005c4ee90: 00000000dc87efd0 0000000005c4ee98 0x0000000005c4eea0: 0000000005c4eea0 0000000000000000 0x0000000005c4eeb0: 0000000005c4ef18 0000000080c3a7a8 0x0000000005c4eec0: 0000000000000000 0000000080c39190 0x0000000005c4eed0: 0000000000000000 0000000005c4ef00 0x0000000005c4eee0: 0000000005c4ef60 00000000013959ce 0x0000000005c4eef0: 0000000080c3a6f0 000000000139e316 0x0000000005c4ef00: 000000000000006f 0000000000000000 0x0000000005c4ef10: 0000000007457c20 00000000dc87efd0 0x0000000005c4ef20: 0000000005c4ef20 0000000080fbd18e Instructions: (pc=0x00000001800057b2) 0x00000001800057a2: 8d 44 24 38 48 89 44 24 38 48 8b 46 30 48 03 d3 0x00000001800057b2: ff 50 40 85 c0 75 29 48 8b 44 24 38 48 85 c0 74 Stack: [0x0000000005b50000,0x0000000005c50000], sp=0x0000000005c4ee30, free space=3fb0000000000000000k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) C [tcnative-1.dll+0x57b2] [error occurred during error reporting (printing native stack), id 0xc0000005] Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) j org.apache.tomcat.jni.Socket.sendbb(JII)I+0 j org.apache.coyote.http11.InternalAprOutputBuffer.flushBuffer()V+22 j org.apache.coyote.http11.InternalAprOutputBuffer.flush()V+5 j org.apache.coyote.http11.AbstractHttp11Processor.action(Lorg/apache/coyote/ActionCode;Ljava/lang/Object;)V+130 j org.apache.coyote.Response.action(Lorg/apache/coyote/ActionCode;Ljava/lang/Object;)V+31 j org.apache.catalina.connector.OutputBuffer.doFlush(Z)V+97 j org.apache.catalina.connector.OutputBuffer.flush()V+2 j org.apache.catalina.connector.CoyoteOutputStream.flush()V+4 j javax.imageio.stream.FileCacheImageOutputStream.close()V+60 j javax.imageio.stream.ImageInputStreamImpl.finalize()V+8 v ~StubRoutines::call_stub j java.lang.ref.Finalizer.invokeFinalizeMethod(Ljava/lang/Object;)V+0 j java.lang.ref.Finalizer.runFinalizer()V+45 j java.lang.ref.Finalizer.access$100(Ljava/lang/ref/Finalizer;)V+1 j java.lang.ref.Finalizer$FinalizerThread.run()V+11 v ~StubRoutines::call_stub --------------- P R O C E S S --------------- Java Threads: ( => current thread ) 0x0000000007148000 JavaThread "http-apr-80-exec-6" daemon [_thread_blocked, id=5004, stack(0x000000000db50000,0x000000000dc50000)] 0x0000000007147000 JavaThread "http-apr-80-exec-5" daemon [_thread_blocked, id=636, stack(0x000000000da50000,0x000000000db50000)] 0x0000000007146800 JavaThread "http-apr-80-exec-4" daemon [_thread_blocked, id=1696, stack(0x000000000d950000,0x000000000da50000)] 0x0000000007146000 JavaThread "http-apr-80-exec-3" daemon [_thread_blocked, id=3280, stack(0x000000000d850000,0x000000000d950000)] 0x0000000007145000 JavaThread "http-apr-80-exec-2" daemon [_thread_blocked, id=3300, stack(0x000000000d750000,0x000000000d850000)] 0x0000000007143000 JavaThread "http-apr-80-exec-1" daemon [_thread_blocked, id=1136, stack(0x000000000d550000,0x000000000d650000)] 0x0000000007143800 JavaThread "AWT-Windows" daemon [_thread_in_native, id=5604, stack(0x000000000d650000,0x000000000d750000)] 0x0000000007142000 JavaThread "Java2D Disposer" daemon [_thread_blocked, id=5624, stack(0x000000000d450000,0x000000000d550000)] 0x0000000007141800 JavaThread "http-apr-443-exec-25" daemon [_thread_blocked, id=5404, stack(0x000000000d050000,0x000000000d150000)] 0x0000000007140800 JavaThread "http-apr-443-exec-24" daemon [_thread_blocked, id=4780, stack(0x000000000cf50000,0x000000000d050000)] 0x0000000007140000 JavaThread "http-apr-443-exec-23" daemon [_thread_blocked, id=4552, stack(0x000000000ce50000,0x000000000cf50000)] 0x000000000713f800 JavaThread "http-apr-443-exec-22" daemon [_thread_blocked, id=4196, stack(0x000000000cd50000,0x000000000ce50000)] 0x000000000713e800 JavaThread "http-apr-443-exec-21" daemon [_thread_blocked, id=6008, stack(0x000000000cc50000,0x000000000cd50000)] 0x000000000713e000 JavaThread "http-apr-443-exec-20" daemon [_thread_in_native, id=2028, stack(0x000000000cb50000,0x000000000cc50000)] 0x000000000713d000 JavaThread "http-apr-443-exec-19" daemon [_thread_blocked, id=524, stack(0x000000000ca50000,0x000000000cb50000)] 0x000000000713c800 JavaThread "http-apr-443-exec-18" daemon [_thread_blocked, id=5220, stack(0x000000000c950000,0x000000000ca50000)] 0x000000000713b800 JavaThread "http-apr-443-exec-17" daemon [_thread_blocked, id=3604, stack(0x000000000c850000,0x000000000c950000)] 0x000000000713b000 JavaThread "http-apr-443-exec-16" daemon [_thread_blocked, id=2052, stack(0x000000000c750000,0x000000000c850000)] 0x000000000720e800 JavaThread "http-apr-443-exec-15" daemon [_thread_blocked, id=5824, stack(0x000000000c650000,0x000000000c750000)] 0x000000000720d800 JavaThread "http-apr-443-exec-14" daemon [_thread_blocked, id=3724, stack(0x000000000c550000,0x000000000c650000)] 0x000000000720d000 JavaThread "http-apr-443-exec-13" daemon [_thread_blocked, id=4232, stack(0x000000000c450000,0x000000000c550000)] 0x000000000720c800 JavaThread "http-apr-443-exec-12" daemon [_thread_blocked, id=4436, stack(0x000000000c350000,0x000000000c450000)] 0x000000000720b800 JavaThread "http-apr-443-exec-11" daemon [_thread_blocked, id=3160, stack(0x000000000c250000,0x000000000c350000)] 0x000000000720b000 JavaThread "http-apr-443-exec-10" daemon [_thread_blocked, id=4520, stack(0x000000000c150000,0x000000000c250000)] 0x000000000720a000 JavaThread "http-apr-443-exec-9" daemon [_thread_blocked, id=5412, stack(0x000000000c050000,0x000000000c150000)] 0x0000000007209800 JavaThread "http-apr-443-exec-8" daemon [_thread_blocked, id=5104, stack(0x000000000bf50000,0x000000000c050000)] 0x0000000007208800 JavaThread "http-apr-443-exec-7" daemon [_thread_blocked, id=1392, stack(0x000000000be50000,0x000000000bf50000)] 0x0000000007208000 JavaThread "http-apr-443-exec-6" daemon [_thread_blocked, id=5136, stack(0x000000000bd50000,0x000000000be50000)] 0x0000000007207000 JavaThread "http-apr-443-exec-5" daemon [_thread_blocked, id=6112, stack(0x000000000bc50000,0x000000000bd50000)] 0x0000000007206800 JavaThread "http-apr-443-exec-4" daemon [_thread_blocked, id=4980, stack(0x000000000bb50000,0x000000000bc50000)] 0x0000000007206000 JavaThread "http-apr-443-exec-3" daemon [_thread_blocked, id=5040, stack(0x000000000ba50000,0x000000000bb50000)] 0x0000000007205000 JavaThread "http-apr-443-exec-2" daemon [_thread_blocked, id=2108, stack(0x00000000080d0000,0x00000000081d0000)] 0x0000000007204800 JavaThread "http-apr-443-exec-1" daemon [_thread_blocked, id=3476, stack(0x0000000007fd0000,0x00000000080d0000)] 0x0000000007203800 JavaThread "ajp-apr-8009-AsyncTimeout" daemon [_thread_blocked, id=2784, stack(0x000000000b950000,0x000000000ba50000)] 0x0000000007203000 JavaThread "ajp-apr-8009-Acceptor-0" daemon [_thread_in_native, id=5292, stack(0x000000000b850000,0x000000000b950000)] 0x0000000007202000 JavaThread "ajp-apr-8009-CometPoller-7" daemon [_thread_blocked, id=4120, stack(0x000000000b750000,0x000000000b850000)] 0x0000000007201800 JavaThread "ajp-apr-8009-CometPoller-6" daemon [_thread_blocked, id=1324, stack(0x000000000b650000,0x000000000b750000)] 0x0000000007200800 JavaThread "ajp-apr-8009-CometPoller-5" daemon [_thread_blocked, id=4924, stack(0x000000000b550000,0x000000000b650000)] 0x0000000007200000 JavaThread "ajp-apr-8009-CometPoller-4" daemon [_thread_blocked, id=2884, stack(0x000000000b450000,0x000000000b550000)] 0x00000000071ff800 JavaThread "ajp-apr-8009-CometPoller-3" daemon [_thread_blocked, id=6084, stack(0x000000000b350000,0x000000000b450000)] 0x0000000007a63000 JavaThread "ajp-apr-8009-CometPoller-2" daemon [_thread_blocked, id=2936, stack(0x000000000b250000,0x000000000b350000)] 0x0000000007a62800 JavaThread "ajp-apr-8009-CometPoller-1" daemon [_thread_blocked, id=5364, stack(0x000000000b150000,0x000000000b250000)] 0x0000000007a61800 JavaThread "ajp-apr-8009-CometPoller-0" daemon [_thread_blocked, id=5508, stack(0x000000000b050000,0x000000000b150000)] 0x0000000007a61000 JavaThread "ajp-apr-8009-Poller-7" daemon [_thread_blocked, id=5788, stack(0x000000000af50000,0x000000000b050000)] 0x0000000007a60000 JavaThread "ajp-apr-8009-Poller-6" daemon [_thread_blocked, id=5008, stack(0x000000000ae50000,0x000000000af50000)] 0x0000000007a5f800 JavaThread "ajp-apr-8009-Poller-5" daemon [_thread_blocked, id=4216, stack(0x000000000ad50000,0x000000000ae50000)] 0x0000000007a5f000 JavaThread "ajp-apr-8009-Poller-4" daemon [_thread_blocked, id=5272, stack(0x000000000ac50000,0x000000000ad50000)] 0x0000000007a5e000 JavaThread "ajp-apr-8009-Poller-3" daemon [_thread_blocked, id=5612, stack(0x000000000ab50000,0x000000000ac50000)] 0x0000000007a5d800 JavaThread "ajp-apr-8009-Poller-2" daemon [_thread_blocked, id=3404, stack(0x000000000aa50000,0x000000000ab50000)] 0x0000000007a5c800 JavaThread "ajp-apr-8009-Poller-1" daemon [_thread_blocked, id=3880, stack(0x000000000a950000,0x000000000aa50000)] 0x0000000007a5c000 JavaThread "ajp-apr-8009-Poller-0" daemon [_thread_blocked, id=5284, stack(0x000000000a850000,0x000000000a950000)] 0x0000000007a5b000 JavaThread "http-apr-443-AsyncTimeout" daemon [_thread_blocked, id=368, stack(0x000000000a750000,0x000000000a850000)] 0x0000000007a5a800 JavaThread "http-apr-443-Acceptor-0" daemon [_thread_in_native, id=5800, stack(0x000000000a650000,0x000000000a750000)] 0x0000000007a59800 JavaThread "http-apr-443-CometPoller-7" daemon [_thread_blocked, id=3396, stack(0x000000000a550000,0x000000000a650000)] 0x0000000007a59000 JavaThread "http-apr-443-CometPoller-6" daemon [_thread_blocked, id=2820, stack(0x000000000a450000,0x000000000a550000)] 0x0000000007a58800 JavaThread "http-apr-443-CometPoller-5" daemon [_thread_blocked, id=2140, stack(0x000000000a350000,0x000000000a450000)] 0x0000000007a57800 JavaThread "http-apr-443-CometPoller-4" daemon [_thread_blocked, id=5472, stack(0x000000000a250000,0x000000000a350000)] 0x0000000007a57000 JavaThread "http-apr-443-CometPoller-3" daemon [_thread_blocked, id=3288, stack(0x000000000a150000,0x000000000a250000)] 0x0000000007a56000 JavaThread "http-apr-443-CometPoller-2" daemon [_thread_blocked, id=4064, stack(0x000000000a050000,0x000000000a150000)] 0x0000000007a55800 JavaThread "http-apr-443-CometPoller-1" daemon [_thread_blocked, id=5632, stack(0x0000000009f50000,0x000000000a050000)] 0x0000000007a54800 JavaThread "http-apr-443-CometPoller-0" daemon [_thread_blocked, id=5780, stack(0x0000000009e50000,0x0000000009f50000)] 0x0000000007a54000 JavaThread "http-apr-443-Poller-7" daemon [_thread_in_native, id=5956, stack(0x0000000009d50000,0x0000000009e50000)] 0x00000000079b0000 JavaThread "http-apr-443-Poller-6" daemon [_thread_blocked, id=5528, stack(0x0000000009c50000,0x0000000009d50000)] 0x00000000079af800 JavaThread "http-apr-443-Poller-5" daemon [_thread_blocked, id=2660, stack(0x0000000009b50000,0x0000000009c50000)] 0x00000000079ae800 JavaThread "http-apr-443-Poller-4" daemon [_thread_blocked, id=1660, stack(0x0000000009a50000,0x0000000009b50000)] 0x00000000079ae000 JavaThread "http-apr-443-Poller-3" daemon [_thread_blocked, id=5804, stack(0x0000000009950000,0x0000000009a50000)] 0x00000000079ad000 JavaThread "http-apr-443-Poller-2" daemon [_thread_in_native, id=3904, stack(0x0000000009850000,0x0000000009950000)] 0x00000000079ac800 JavaThread "http-apr-443-Poller-1" daemon [_thread_in_native, id=1832, stack(0x0000000009750000,0x0000000009850000)] 0x00000000079ac000 JavaThread "http-apr-443-Poller-0" daemon [_thread_in_native, id=5048, stack(0x0000000009650000,0x0000000009750000)] 0x00000000079ab000 JavaThread "http-apr-80-AsyncTimeout" daemon [_thread_blocked, id=3224, stack(0x0000000009550000,0x0000000009650000)] 0x00000000079aa800 JavaThread "http-apr-80-Acceptor-0" daemon [_thread_in_native, id=6036, stack(0x0000000009450000,0x0000000009550000)] 0x00000000079a9800 JavaThread "http-apr-80-Sendfile-0" daemon [_thread_blocked, id=4180, stack(0x0000000009350000,0x0000000009450000)] 0x00000000079a9000 JavaThread "http-apr-80-CometPoller-7" daemon [_thread_blocked, id=4328, stack(0x0000000009250000,0x0000000009350000)] 0x00000000079a8000 JavaThread "http-apr-80-CometPoller-6" daemon [_thread_blocked, id=1232, stack(0x0000000009150000,0x0000000009250000)] 0x00000000079a7800 JavaThread "http-apr-80-CometPoller-5" daemon [_thread_blocked, id=3240, stack(0x0000000009050000,0x0000000009150000)] 0x00000000079a6800 JavaThread "http-apr-80-CometPoller-4" daemon [_thread_blocked, id=2420, stack(0x0000000008f50000,0x0000000009050000)] 0x00000000079a6000 JavaThread "http-apr-80-CometPoller-3" daemon [_thread_blocked, id=4200, stack(0x0000000008e50000,0x0000000008f50000)] 0x00000000079a5800 JavaThread "http-apr-80-CometPoller-2" daemon [_thread_blocked, id=1920, stack(0x0000000008d50000,0x0000000008e50000)] 0x00000000079a4800 JavaThread "http-apr-80-CometPoller-1" daemon [_thread_blocked, id=5168, stack(0x0000000008c50000,0x0000000008d50000)] 0x00000000079a4000 JavaThread "http-apr-80-CometPoller-0" daemon [_thread_blocked, id=5540, stack(0x0000000008b50000,0x0000000008c50000)] 0x00000000079a3000 JavaThread "http-apr-80-Poller-7" daemon [_thread_blocked, id=5148, stack(0x0000000008a50000,0x0000000008b50000)] 0x00000000079a2800 JavaThread "http-apr-80-Poller-6" daemon [_thread_blocked, id=3088, stack(0x0000000008950000,0x0000000008a50000)] 0x00000000079a1800 JavaThread "http-apr-80-Poller-5" daemon [_thread_blocked, id=5384, stack(0x0000000008850000,0x0000000008950000)] 0x00000000079a1000 JavaThread "http-apr-80-Poller-4" daemon [_thread_blocked, id=5392, stack(0x0000000008750000,0x0000000008850000)] 0x0000000006722800 JavaThread "http-apr-80-Poller-3" daemon [_thread_blocked, id=5336, stack(0x0000000008650000,0x0000000008750000)] 0x0000000006670800 JavaThread "http-apr-80-Poller-2" daemon [_thread_blocked, id=6012, stack(0x0000000008550000,0x0000000008650000)] 0x0000000006742800 JavaThread "http-apr-80-Poller-1" daemon [_thread_blocked, id=3284, stack(0x0000000008450000,0x0000000008550000)] 0x000000000691c800 JavaThread "http-apr-80-Poller-0" daemon [_thread_blocked, id=1668, stack(0x0000000008350000,0x0000000008450000)] 0x0000000007190000 JavaThread "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon [_thread_blocked, id=3856, stack(0x0000000008250000,0x0000000008350000)] 0x0000000006cd4800 JavaThread "GC Daemon" daemon [_thread_blocked, id=3248, stack(0x0000000007e50000,0x0000000007f50000)] 0x0000000004fb4000 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=4100, stack(0x0000000006050000,0x0000000006150000)] 0x0000000004fa0800 JavaThread "CompilerThread1" daemon [_thread_blocked, id=4460, stack(0x0000000005f50000,0x0000000006050000)] 0x0000000004f9a800 JavaThread "CompilerThread0" daemon [_thread_blocked, id=5512, stack(0x0000000005e50000,0x0000000005f50000)] 0x0000000004f99800 JavaThread "Attach Listener" daemon [_thread_blocked, id=3052, stack(0x0000000005d50000,0x0000000005e50000)] 0x0000000004f99000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=1320, stack(0x0000000005c50000,0x0000000005d50000)] =>0x0000000004f32800 JavaThread "Finalizer" daemon [_thread_in_native, id=5464, stack(0x0000000005b50000,0x0000000005c50000)] 0x0000000004f30000 JavaThread "Reference Handler" daemon [_thread_blocked, id=3544, stack(0x0000000005a50000,0x0000000005b50000)] 0x00000000003c8800 JavaThread "main" [_thread_in_native, id=4528, stack(0x0000000000bb0000,0x0000000000cb0000)] Other Threads: 0x0000000004f2d000 VMThread [stack: 0x0000000005950000,0x0000000005a50000] [id=1260] 0x0000000004fc1800 WatcherThread [stack: 0x0000000006150000,0x0000000006250000] [id=5880] VM state:not at safepoint (normal execution) VM Mutex/Monitor currently owned by a thread: None Heap PSYoungGen total 37824K, used 8865K [0x00000000da950000, 0x00000000de4c0000, 0x00000001053f0000) eden space 30528K, 5% used [0x00000000da950000,0x00000000daadcac0,0x00000000dc720000) from space 7296K, 99% used [0x00000000dc7d0000,0x00000000dceeba10,0x00000000dcef0000) to space 15168K, 0% used [0x00000000dd5f0000,0x00000000dd5f0000,0x00000000de4c0000) PSOldGen total 87424K, used 24898K [0x00000000853f0000, 0x000000008a950000, 0x00000000da950000) object space 87424K, 28% used [0x00000000853f0000,0x0000000086c40a78,0x000000008a950000) PSPermGen total 23360K, used 23287K [0x000000007fff0000, 0x00000000816c0000, 0x00000000853f0000) object space 23360K, 99% used [0x000000007fff0000,0x00000000816add08,0x00000000816c0000) Dynamic libraries: 0x0000000140000000 - 0x000000014001e000 C:\Program Files\Apache Software Foundation\Tomcat 5.5\bin\Tomcat7.exe 0x0000000077ec0000 - 0x0000000077ffb000 C:\WINDOWS\system32\ntdll.dll 0x0000000077d40000 - 0x0000000077eb3000 C:\WINDOWS\system32\kernel32.dll 0x000007ff7fee0000 - 0x000007ff7ffe6000 C:\WINDOWS\system32\ADVAPI32.dll 0x000007ff7fd30000 - 0x000007ff7fec9000 C:\WINDOWS\system32\RPCRT4.dll 0x000007ff7e9c0000 - 0x000007ff7e9e2000 C:\WINDOWS\system32\Secur32.dll 0x000007ff7f190000 - 0x000007ff7fb9b000 C:\WINDOWS\system32\SHELL32.dll 0x000007ff7fc00000 - 0x000007ff7fc86000 C:\WINDOWS\system32\msvcrt.dll 0x000007ff7fc90000 - 0x000007ff7fd2c000 C:\WINDOWS\system32\GDI32.dll 0x0000000077c20000 - 0x0000000077d2c000 C:\WINDOWS\system32\USER32.dll 0x000007ff7ef60000 - 0x000007ff7effb000 C:\WINDOWS\system32\SHLWAPI.dll 0x000007ff7d500000 - 0x000007ff7d539000 C:\WINDOWS\system32\IMM32.DLL 0x000000006fa00000 - 0x000000006fa3f000 C:\PROGRA~2\Sophos\SOPHOS~1\SOPHOS~2.DLL 0x000007ff7e380000 - 0x000007ff7e390000 C:\WINDOWS\system32\PSAPI.DLL 0x000007ff7f000000 - 0x000007ff7f187000 C:\WINDOWS\WinSxS\amd64_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.3790.3959_x-ww_0A7B2435\comctl32.dll 0x000000006d890000 - 0x000000006df61000 C:\Program Files\Java\jdk1.6.0_21\jre\bin\server\jvm.dll 0x000007ff7e240000 - 0x000007ff7e290000 C:\WINDOWS\system32\WINMM.dll 0x000000006d800000 - 0x000000006d80e000 C:\Program Files\Java\jdk1.6.0_21\jre\bin\verify.dll 0x000000006d450000 - 0x000000006d477000 C:\Program Files\Java\jdk1.6.0_21\jre\bin\java.dll 0x000000006d3b0000 - 0x000000006d3ba000 C:\Program Files\Java\jdk1.6.0_21\jre\bin\hpi.dll 0x000000006d850000 - 0x000000006d862000 C:\Program Files\Java\jdk1.6.0_21\jre\bin\zip.dll 0x000000006d5e0000 - 0x000000006d5ea000 C:\Program Files\Java\jdk1.6.0_21\jre\bin\management.dll 0x0000000180000000 - 0x000000018018c000 C:\Program Files\Apache Software Foundation\Tomcat 5.5\bin\tcnative-1.dll 0x000007ff77310000 - 0x000007ff77340000 C:\WINDOWS\system32\WS2_32.dll 0x000007ff77140000 - 0x000007ff7714c000 C:\WINDOWS\system32\WS2HELP.dll 0x000007ff771b0000 - 0x000007ff7722d000 C:\WINDOWS\system32\MSWSOCK.dll 0x0000000068000000 - 0x000000006804c000 C:\WINDOWS\system32\rsaenh.dll 0x000007ff6d200000 - 0x000007ff6d293000 C:\WINDOWS\system32\hnetcfg.dll 0x000007ff77170000 - 0x000007ff7717b000 C:\WINDOWS\System32\wshtcpip.dll 0x000000006d6a0000 - 0x000000006d6b7000 C:\Program Files\Java\jdk1.6.0_21\jre\bin\net.dll 0x000007ff7e8f0000 - 0x000007ff7e93e000 C:\WINDOWS\system32\DNSAPI.dll 0x000007ff7e9f0000 - 0x000007ff7e9fb000 C:\WINDOWS\System32\winrnr.dll 0x000007ff7e950000 - 0x000007ff7e9b6000 C:\WINDOWS\system32\WLDAP32.dll 0x000007ff7ea00000 - 0x000007ff7ea07000 C:\WINDOWS\system32\rasadhlp.dll 0x000000006d0a0000 - 0x000000006d263000 C:\Program Files\Java\jdk1.6.0_21\jre\bin\awt.dll 0x000007ff78f10000 - 0x000007ff78f51000 C:\WINDOWS\system32\WINSPOOL.DRV 0x000007ff57140000 - 0x000007ff573c5000 C:\WINDOWS\system32\ole32.dll 0x000000006d340000 - 0x000000006d3ab000 C:\Program Files\Java\jdk1.6.0_21\jre\bin\fontmanager.dll 0x000000006d6c0000 - 0x000000006d6cb000 C:\Program Files\Java\jdk1.6.0_21\jre\bin\nio.dll 0x000000006d570000 - 0x000000006d5a5000 C:\Program Files\Java\jdk1.6.0_21\jre\bin\jpeg.dll VM Arguments: jvm_args: -Dcatalina.home=C:\Program Files\Apache Software Foundation\Tomcat 5.5 -Dcatalina.base=C:\Program Files\Apache Software Foundation\Tomcat 5.5 -Djava.endorsed.dirs=C:\Program Files\Apache Software Foundation\Tomcat 5.5\endorsed -Djava.io.tmpdir=C:\Program Files\Apache Software Foundation\Tomcat 5.5\temp -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=C:\Program Files\Apache Software Foundation\Tomcat 5.5\conf\logging.properties exit java_command: <unknown> Launcher Type: generic Environment Variables: PATH=C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\Program Files (x86)\Dell\SysMgt\RAC5;C:\Program Files (x86)\Dell\SysMgt\oma\bin;C:\WINDOWS\system32\WindowsPowerShell\v1.0;C:\Program Files (x86)\Common Files\Acronis\SnapAPI\ OS=Windows_NT PROCESSOR_IDENTIFIER=EM64T Family 6 Model 23 Stepping 10, GenuineIntel --------------- S Y S T E M --------------- OS: Windows Server 2003 family Build 3790 Service Pack 2 CPU:total 8 (4 cores per cpu, 1 threads per core) family 6 model 23 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1 Memory: 4k page, physical 8386584k(6335140k free), swap 12121980k(10701736k free) vm_info: Java HotSpot(TM) 64-Bit Server VM (17.0-b17) for windows-amd64 JRE (1.6.0_21-b07), built on Jul 17 2010 01:05:36 by "java_re" with MS VC++ 8.0 (VS2005) time: Tue May 21 13:06:53 2013 elapsed time: 330 seconds -----Original Message----- From: Christopher Schultz [mailto:ch...@christopherschultz.net] Sent: Monday, May 20, 2013 3:56 PM To: Tomcat Users List Subject: Re: Apache Tomcat service has been shutting down/stopping randomly. -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 James, On 5/20/13 2:10 PM, James Snider wrote: > Our application was working prior to the detection being added. > Is there a way to turn of the detection and keep our applications > running? Your application is probably still working. > We may have been having this memory leak issue previously but it > wasn't causing this random service stoppage. Okay, it's time to bring some sanity to this thread. So far, I have seen 3 distinct problems demonstrated: 1. SEGV in tcnative.dll 2. java.lang.IllegalStateException 3. AWT-Windows thread is created causing a memory leak Issues #2 and #3 can be easily handled. To fix issue #3, enable AWTThreadProtection in JreMemoryLeakPreventionListener. (http://tomcat.apache.org/tomcat-7.0-doc/config/listeners.html#JRE_Memory_Leak_Prevention_Listener_-_org.apache.catalina.core.JreMemoryLeakPreventionListener). To fix issue #2, wrap your ImageIO OutputStream in the decorator indicated by Konstantin. > On Monday, May 20, Stever A Harman wrote: > > I am confused. We are not using imageIO in our code and nothing has > changed with our code. Only the TomCat upgrade? Please advise with a > more concrete answer to the issue? Your application obviously /does/ use ImageIO, as you can see in the originally-posted thread: > Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) > > j org.apache.tomcat.jni.Socket.sendbb(JII)I+0 > > j > org.apache.coyote.http11.InternalAprOutputBuffer.flushBuffer()V+22 > > j org.apache.coyote.http11.InternalAprOutputBuffer.flush()V+5 > > J > org.apache.coyote.http11.AbstractHttp11Processor.action(Lorg/apache/co > yote/ActionCode;Ljava/lang/Object;)V > > j > org.apache.coyote.Response.action(Lorg/apache/coyote/ActionCode;Ljava/ > lang/Object;)V+31 > > j org.apache.catalina.connector.OutputBuffer.doFlush(Z)V+97 > > j org.apache.catalina.connector.OutputBuffer.flush()V+2 > > j org.apache.catalina.connector.CoyoteOutputStream.flush()V+4 > > j javax.imageio.stream.FileCacheImageOutputStream.close()V+60 > > j javax.imageio.stream.ImageInputStreamImpl.finalize()V+8 > > v ~StubRoutines::call_stub > > j > java.lang.ref.Finalizer.invokeFinalizeMethod(Ljava/lang/Object;)V+0 > > j java.lang.ref.Finalizer.runFinalizer()V+45 > > j > java.lang.ref.Finalizer.access$100(Ljava/lang/ref/Finalizer;)V+1 > > j java.lang.ref.Finalizer$FinalizerThread.run()V+11 > > v ~StubRoutines::call_stub As for issue #1 (the tcnative one), you are going to have to provide some more information. Is this a repeatable condition? If so, I'll bet Mladen can roll you a debug-enabled library that you can test: he's very quick to identify and fix problems with the win32 build of tcnative. Please, let's focus on one problem at a time. I realize that you guys are probably in "sky is falling" mode, but it's very difficult to figure out what is going on with two people reporting random problems all within the same thread. So let's slow down and get a few things straight. First, Tomcat is more strict about a lot of things in 7.0.x than it was in 6.0.x, which is probably why you are seeing the IllegalStateException. Or, something else may have changed in your configuration that you are not reporting. Either way, the fix is easy (see above). I'm sorry that the fix isn't as easy as "disable IllegalStateException in configuration" or something like that, but you seriously need to fix your web application (really work-around this bug in ImageIO) or your webapp will be less stable than it could be. This is true no matter what application server you use. Second, you are only seeing the *warning* about the AWT thread because those checks weren't being done in your ancient version of Tomcat you were running. If you want to disable the checks (which is stupid because they indicate a problem), then you can disable them. Better yet, you can easily fix the AWT thread problem as described above. Third, let's get some more information about the tcnative thing, as it probably truly represents a bug in tcnative. - -chris -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.17 (Darwin) Comment: GPGTools - http://gpgtools.org Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBCAAGBQJRmn/pAAoJEBzwKT+lPKRYlTgQAKJRyr9zWXZLrJwzlCfibT/s SbcX1r8VYoNoN78RAtuoioJiYi+6TZxbwIxZiAo1QUElNk5vrsnzbvr0e5FHBWoe SoZs5ro/tAMaAPClqlp11WjJnlIEqvg63ebnml7RS6U6NpwGEg/BhslUDIUR9lMP S6T1NCa6WPgFV304RS0wSDn1ibhyZ2Z1Fteo3CHvazeySsfeRydZHeYHMFSXp0CP 927t7gl93cCpvvz6P38lBUYiorKsFPDTlD0gNcZz9GuBE+TjiMFES/OmddAvey8U GNc7oVI+RGiStZCaDggsgqCtFeeIm+QbQV1g0e1Y78BiaH865soudH2k7ric05gv pe9jtQX7S7SWn47vENid/Au/q3UXy/Nj9A4FB4lLMprKGLDMoHuoX/N/2f+3INwK uDUEeCPJ7F7Q1aAJUMfBvGiBEyWxcp2eIt+LgCCuuuSLYc+V1XELhSI62KgIkhbf JmJGYz1bG7maFP2HnQ7oz48bAJVTH/EDlMMU6aatrWjw4pxjZfDbmzdhT4dXewFd qAXQhV5Z/HNBsNJa1PqeOLXWGfteZ2t9cH8ClTO+J5z0k1H75EwRdADTXLEFc5Xu Q4HXIwQihWtVgnNo9yjtplTXOiJ94y8PxdTqr8XhcYoWH7k69k076XTZsoAnycZV EVCaRqBcRUWekNhNEQBR =jyDp -----END PGP SIGNATURE----- --------------------------------------------------------------------- To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org ------------------ CONFIDENTIALITY NOTICE --------------- This message, including any attachments, is for the sole use of the intended recipient(s) and may contain privileged confidential information protected by law. Any unauthorized review, use, disclosure or distribution of this message is prohibited. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of this message. ------------------ CONFIDENTIALITY NOTICE ---------------
