On 25/10/17 11:43, Atanu Pal wrote:
> Hi,
> 
> We have application deployed on tomcat & its working good for most of
> the customer, but recently we installed it for two customers on a
> virtual machine & it looks like tomcat is crashing after few days of
> successful run.
> 
> Machine Details:
> - It is a Virtual Machine
> - Windows Server 2012 R2
> - 64-bit, 8GB RAM
> - Intel Xeon E5-2665 dual processor @2.4GHz
> 
> Both the server crashed with almost exact same crash log.
> 
> As per my google research & if I am reading this crash log right, then
> this issue happened due to APR Module while doing polling.
> 
> We are trying to find root cause of this problem, these are my top suspect:
> 1. Its a VM machine thing.
> 2. Bug in tomcat APR module.

2 is the more likely option.

There have been a number of APR/native bugs that are very timing
dependent. It is quite possible that the move the a VM altering the
timing slightly and did so in such a way that you hit a APR/native bug.

I'd recommend updating to the latest 8.0.x release. Better still, the
latest 8.5.x. (8.5.x should be a drop in replacement for 8.0.x for
nearly all users). Also make sure you are using the latest Tomcat native
1.2.x library.

Mark


> 
> Let me know how should we fix this issue & if its already fixed please
> guide to fixed version.
> 
> I have posted same question on stackoverflow :
> https://stackoverflow.com/questions/46925905/tomcat-8-0-33-crashed-due-to-apr-in-a-virtual-machine
> 
> Copying 1 Crash log below, I have one more very similar to this & two
> memory dump. let me know if you need any of those to help me out here.
> Memory dump is quite big so I can upload it on Google-drive & share it
> with you.
> 
> Crash Log 1:
> ============================================================
> #
> # A fatal error has been detected by the Java Runtime Environment:
> #
> #  EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x23a56eb6, pid=3084, 
> tid=5852
> #
> # JRE version: Java(TM) SE Runtime Environment (8.0_77-b03) (build 
> 1.8.0_77-b03)
> # Java VM: Java HotSpot(TM) Server VM (25.77-b03 mixed mode windows-x86 )
> # Problematic frame:
> # C  [tcnative-1.dll+0x6eb6]
> #
> # Core dump written. Default location: <<Path to Memory dump>>
> #
> # If you would like to submit a bug report, please visit:
> #   http://bugreport.java.com/bugreport/crash.jsp
> # The crash happened outside the Java Virtual Machine in native code.
> # See problematic frame for where to report the bug.
> #
> 
> ---------------  T H R E A D  ---------------
> 
> Current thread (0x24c7ac00):  JavaThread "http-apr-8082-Poller" daemon
> [_thread_in_native, id=5852, stack(0x2b060000,0x2b0d0000)]
> 
> siginfo: ExceptionCode=0xc0000005, reading address 0x3941f0b4
> 
> Registers:
> EAX=0x3941f098, EBX=0x23be18e0, ECX=0x23be27b0, EDX=0x00000000
> ESP=0x2b0cfac4, EBP=0x2b0cfae8, ESI=0x3941f098, EDI=0x00000000
> EIP=0x23a56eb6, EFLAGS=0x00010202
> 
> Top of Stack: (sp=0x2b0cfac4)
> 0x2b0cfac4:   24c7ac00 2b0cfb18 00000000 000000fa
> 0x2b0cfad4:   00000000 838e735e 00055c23 23bdc7a8
> 0x2b0cfae4:   000000db 2b0cfb28 014aad14 24c7ad40
> 0x2b0cfaf4:   2b0cfb18 23be18e0 00000000 000000fa
> 0x2b0cfb04:   00000000 2b0cfb10 00000001 11d94a90
> 0x2b0cfb14:   00002710 11e05348 00000400 f8ce8c91
> 0x2b0cfb24:   01d34b41 000000fa 021c140c 23be18e0
> 0x2b0cfb34:   00000000 000000fa 00000000 11d8e430
> 
> Instructions: (pc=0x23a56eb6)
> 0x23a56e96:   41 0a 8b 71 10 8b 4b 10 99 89 04 0f 89 54 0f 04
> 0x23a56ea6:   8b 4b 10 8b c6 99 89 44 0f 08 89 54 0f 0c 74 59
> 0x23a56eb6:   83 7e 1c 00 74 5f 8b 45 f8 8b 4b 0c 50 51 e8 37
> 0x23a56ec6:   53 01 00 8b 56 1c 8b 02 8b 4e 1c 8b 51 04 89 02
> 
> 
> Register to memory mapping:
> 
> EAX=0x3941f098 is an unknown value
> EBX=0x23be18e0 is an unknown value
> ECX=0x23be27b0 is an unknown value
> EDX=0x00000000 is an unknown value
> ESP=0x2b0cfac4 is pointing into the stack for thread: 0x24c7ac00
> EBP=0x2b0cfae8 is pointing into the stack for thread: 0x24c7ac00
> ESI=0x3941f098 is an unknown value
> EDI=0x00000000 is an unknown value
> 
> 
> Stack: [0x2b060000,0x2b0d0000],  sp=0x2b0cfac4,  free space=446k
> Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native 
> code)
> C  [tcnative-1.dll+0x6eb6]
> J 6544  org.apache.tomcat.jni.Poll.poll(JJ[JZ)I (0 bytes) @ 0x014aad14
> [0x014aac60+0xb4]
> J 8272% C2 org.apache.tomcat.util.net.AprEndpoint$Poller.run()V (2267
> bytes) @ 0x021c140c [0x021c11c0+0x24c]
> j  java.lang.Thread.run()V+11
> v  ~StubRoutines::call_stub
> V  [jvm.dll+0x16db95]
> V  [jvm.dll+0x24047e]
> V  [jvm.dll+0x16dc2e]
> V  [jvm.dll+0x16ddb6]
> V  [jvm.dll+0x16de27]
> V  [jvm.dll+0x10a73f]
> V  [jvm.dll+0x192a7c]
> V  [jvm.dll+0x192b6a]
> V  [jvm.dll+0x1d7356]
> C  [MSVCR100.dll+0x5c556]
> C  [MSVCR100.dll+0x5c600]
> C  [KERNEL32.DLL+0x17c04]
> C  [ntdll.dll+0x5ad2f]
> C  [ntdll.dll+0x5acfa]
> C  0x00000000
> 
> Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
> J 6544  org.apache.tomcat.jni.Poll.poll(JJ[JZ)I (0 bytes) @ 0x014aacd0
> [0x014aac60+0x70]
> J 8272% C2 org.apache.tomcat.util.net.AprEndpoint$Poller.run()V (2267
> bytes) @ 0x021c140c [0x021c11c0+0x24c]
> j  java.lang.Thread.run()V+11
> v  ~StubRoutines::call_stub
> 
> ---------------  P R O C E S S  ---------------
> 
> Java Threads: ( => current thread )
>   0x2315c800 JavaThread "Thread-176703" daemon [_thread_blocked,
> id=5448, stack(0x3d500000,0x3d570000)]
>   0x23160000 JavaThread "Keep-Alive-Timer" daemon [_thread_blocked,
> id=5276, stack(0x3d450000,0x3d4c0000)]
>   0x2315fc00 JavaThread "http-apr-8082-exec-2223" daemon
> [_thread_blocked, id=6724, stack(0x3d3a0000,0x3d410000)]
>   0x2315b400 JavaThread "http-apr-8082-exec-2222" daemon
> [_thread_blocked, id=5016, stack(0x3d2f0000,0x3d360000)]
>   0x2315c000 JavaThread "http-apr-8082-exec-2221" daemon
> [_thread_blocked, id=1772, stack(0x3d240000,0x3d2b0000)]
>   0x2315e800 JavaThread "http-apr-8082-exec-2220" daemon
> [_thread_blocked, id=1904, stack(0x3d190000,0x3d200000)]
>   0x2315bc00 JavaThread "http-apr-8082-exec-2219" daemon
> [_thread_blocked, id=6160, stack(0x3d0e0000,0x3d150000)]
>   0x2d23d400 JavaThread "http-apr-8082-exec-2218" daemon
> [_thread_blocked, id=1972, stack(0x3d030000,0x3d0a0000)]
>   0x2d23dc00 JavaThread "http-apr-8082-exec-2217" daemon
> [_thread_blocked, id=5992, stack(0x3cf80000,0x3cff0000)]
>   0x2d23f400 JavaThread "http-apr-8082-exec-2216" daemon
> [_thread_blocked, id=6552, stack(0x3cd70000,0x3cde0000)]
>   0x2d23f800 JavaThread "http-apr-8082-exec-2215" daemon
> [_thread_blocked, id=6644, stack(0x3ccc0000,0x3cd30000)]
>   0x2d23e800 JavaThread "http-apr-8082-exec-2214" daemon
> [_thread_blocked, id=6244, stack(0x3cc10000,0x3cc80000)]
>   0x2d23ec00 JavaThread "http-apr-8082-exec-2213" daemon
> [_thread_blocked, id=6880, stack(0x3cb60000,0x3cbd0000)]
>   0x2d23e000 JavaThread "http-apr-8082-exec-2212" daemon
> [_thread_blocked, id=6380, stack(0x3cab0000,0x3cb20000)]
>   0x2d239400 JavaThread "http-apr-8082-exec-2211" daemon
> [_thread_blocked, id=5280, stack(0x3ca00000,0x3ca70000)]
>   0x2d23cc00 JavaThread "http-apr-8082-exec-2210" daemon
> [_thread_blocked, id=848, stack(0x3c950000,0x3c9c0000)]
>   0x2d23c000 JavaThread "http-apr-8082-exec-2209" daemon
> [_thread_blocked, id=4896, stack(0x3c8a0000,0x3c910000)]
>   0x2d239000 JavaThread "http-apr-8082-exec-2208" daemon
> [_thread_blocked, id=1964, stack(0x3c7f0000,0x3c860000)]
>   0x2d238400 JavaThread "http-apr-8082-exec-2207" daemon
> [_thread_blocked, id=6452, stack(0x3c740000,0x3c7b0000)]
>   0x2d23b400 JavaThread "MariaDb-bulk-524" daemon [_thread_blocked,
> id=1684, stack(0x3c690000,0x3c700000)]
>   0x2d23b000 JavaThread "MariaDb-bulk-523" daemon [_thread_blocked,
> id=3244, stack(0x3c5e0000,0x3c650000)]
>   0x2d23a800 JavaThread "MariaDb-bulk-522" daemon [_thread_blocked,
> id=5464, stack(0x3c530000,0x3c5a0000)]
>   0x2d238800 JavaThread "MariaDb-bulk-521" daemon [_thread_blocked,
> id=6720, stack(0x3c480000,0x3c4f0000)]
>   0x2d239c00 JavaThread "MariaDb-bulk-520" daemon [_thread_blocked,
> id=5472, stack(0x3c3d0000,0x3c440000)]
>   0x2d23a000 JavaThread "MariaDb-bulk-519" daemon [_thread_blocked,
> id=5264, stack(0x3c320000,0x3c390000)]
>   0x2d23bc00 JavaThread "MariaDb-bulk-518" daemon [_thread_blocked,
> id=4912, stack(0x3c270000,0x3c2e0000)]
>   0x257c4c00 JavaThread "MariaDb-bulk-517" daemon [_thread_blocked,
> id=6120, stack(0x3c1c0000,0x3c230000)]
>   0x257c3400 JavaThread "MariaDb-bulk-515" daemon [_thread_blocked,
> id=1664, stack(0x3c110000,0x3c180000)]
>   0x257c4800 JavaThread "MariaDb-bulk-516" daemon [_thread_blocked,
> id=5164, stack(0x3c060000,0x3c0d0000)]
>   0x257c3000 JavaThread "MariaDb-bulk-514" daemon [_thread_blocked,
> id=6912, stack(0x3bfb0000,0x3c020000)]
>   0x257c2800 JavaThread "MariaDb-bulk-513" daemon [_thread_blocked,
> id=4420, stack(0x3bf00000,0x3bf70000)]
>   0x257c2000 JavaThread "MariaDb-bulk-512" daemon [_thread_blocked,
> id=6392, stack(0x3be50000,0x3bec0000)]
>   0x257c3c00 JavaThread "MariaDb-bulk-511" daemon [_thread_blocked,
> id=4088, stack(0x3bda0000,0x3be10000)]
>   0x257be400 JavaThread "MariaDb-bulk-510" daemon [_thread_blocked,
> id=5268, stack(0x3bcf0000,0x3bd60000)]
>   0x257c1c00 JavaThread "MariaDb-bulk-509" daemon [_thread_blocked,
> id=5760, stack(0x3bc40000,0x3bcb0000)]
>   0x257bdc00 JavaThread "MariaDb-bulk-508" daemon [_thread_blocked,
> id=5328, stack(0x3bb90000,0x3bc00000)]
>   0x257c1400 JavaThread "MariaDb-bulk-507" daemon [_thread_blocked,
> id=3712, stack(0x3bae0000,0x3bb50000)]
>   0x257bd800 JavaThread "MariaDb-bulk-506" daemon [_thread_blocked,
> id=3768, stack(0x3ba30000,0x3baa0000)]
>   0x257c1000 JavaThread "MariaDb-bulk-505" daemon [_thread_blocked,
> id=1436, stack(0x3b980000,0x3b9f0000)]
>   0x257bd000 JavaThread "MariaDb-bulk-504" daemon [_thread_blocked,
> id=2004, stack(0x3b8d0000,0x3b940000)]
>   0x257c0800 JavaThread "MariaDb-bulk-503" daemon [_thread_blocked,
> id=6688, stack(0x3b820000,0x3b890000)]
>   0x257c0400 JavaThread "MariaDb-bulk-502" daemon [_thread_blocked,
> id=6348, stack(0x3b770000,0x3b7e0000)]
>   0x257bfc00 JavaThread "MariaDb-bulk-501" daemon [_thread_blocked,
> id=3916, stack(0x3b6c0000,0x3b730000)]
>   0x257be800 JavaThread "MariaDb-bulk-500" daemon [_thread_blocked,
> id=3452, stack(0x3b610000,0x3b680000)]
>   0x257bf400 JavaThread "MariaDb-bulk-499" daemon [_thread_blocked,
> id=1116, stack(0x3b560000,0x3b5d0000)]
>   0x257b9000 JavaThread "MariaDb-bulk-498" daemon [_thread_blocked,
> id=1280, stack(0x3b4b0000,0x3b520000)]
>   0x257bb800 JavaThread "MariaDb-bulk-497" daemon [_thread_blocked,
> id=5640, stack(0x3b400000,0x3b470000)]
>   0x257bc800 JavaThread "MariaDb-bulk-496" daemon [_thread_blocked,
> id=6684, stack(0x3b350000,0x3b3c0000)]
>   0x257bc400 JavaThread "MariaDb-bulk-495" daemon [_thread_blocked,
> id=2068, stack(0x3b2a0000,0x3b310000)]
>   0x257bb000 JavaThread "MariaDb-bulk-494" daemon [_thread_blocked,
> id=5284, stack(0x3b1f0000,0x3b260000)]
>   0x257bac00 JavaThread "MariaDb-bulk-493" daemon [_thread_blocked,
> id=5952, stack(0x3b140000,0x3b1b0000)]
>   0x257ba400 JavaThread "MariaDb-bulk-492" daemon [_thread_blocked,
> id=5520, stack(0x3b090000,0x3b100000)]
>   0x257b9800 JavaThread "MariaDb-bulk-491" daemon [_thread_blocked,
> id=968, stack(0x3afe0000,0x3b050000)]
>   0x257bbc00 JavaThread "MariaDb-bulk-490" daemon [_thread_blocked,
> id=3948, stack(0x3af30000,0x3afa0000)]
>   0x257b9c00 JavaThread "MariaDb-bulk-489" daemon [_thread_blocked,
> id=5252, stack(0x3ae80000,0x3aef0000)]
>   0x257c5c00 JavaThread "MariaDb-bulk-488" daemon [_thread_blocked,
> id=6872, stack(0x3add0000,0x3ae40000)]
>   0x257c8000 JavaThread "MariaDb-bulk-487" daemon [_thread_blocked,
> id=3936, stack(0x3ad20000,0x3ad90000)]
>   0x257c7400 JavaThread "MariaDb-bulk-486" daemon [_thread_blocked,
> id=5880, stack(0x3ac70000,0x3ace0000)]
>   0x257c6800 JavaThread "MariaDb-bulk-485" daemon [_thread_blocked,
> id=6928, stack(0x3abc0000,0x3ac30000)]
>   0x257c6000 JavaThread "MariaDb-bulk-484" daemon [_thread_blocked,
> id=4244, stack(0x3ab10000,0x3ab80000)]
>   0x257c7800 JavaThread "MariaDb-bulk-483" daemon [_thread_blocked,
> id=4924, stack(0x3aa60000,0x3aad0000)]
>   0x21da6400 JavaThread "MariaDb-bulk-482" daemon [_thread_blocked,
> id=6540, stack(0x3a9b0000,0x3aa20000)]
>   0x21da8800 JavaThread "MariaDb-bulk-481" daemon [_thread_blocked,
> id=1704, stack(0x3a900000,0x3a970000)]
>   0x21da9000 JavaThread "MariaDb-bulk-480" daemon [_thread_blocked,
> id=1924, stack(0x3a850000,0x3a8c0000)]
>   0x21da7c00 JavaThread "MariaDb-bulk-479" daemon [_thread_blocked,
> id=5904, stack(0x38fd0000,0x39040000)]
>   0x21da8400 JavaThread "MariaDb-bulk-478" daemon [_thread_blocked,
> id=1008, stack(0x38f20000,0x38f90000)]
>   0x21da7000 JavaThread "MariaDb-bulk-477" daemon [_thread_blocked,
> id=5012, stack(0x38d70000,0x38de0000)]
>   0x21da7800 JavaThread "MariaDb-bulk-476" daemon [_thread_blocked,
> id=6712, stack(0x38c10000,0x38c80000)]
>   0x21da6800 JavaThread "MariaDb-bulk-475" daemon [_thread_blocked,
> id=7108, stack(0x38ab0000,0x38b20000)]
>   0x21da2400 JavaThread "MariaDb-bulk-474" daemon [_thread_blocked,
> id=5488, stack(0x38a00000,0x38a70000)]
>   0x21da5c00 JavaThread "MariaDb-bulk-473" daemon [_thread_blocked,
> id=5560, stack(0x38950000,0x389c0000)]
>   0x21da5800 JavaThread "MariaDb-bulk-472" daemon [_thread_blocked,
> id=4940, stack(0x388a0000,0x38910000)]
>   0x21da5000 JavaThread "MariaDb-bulk-471" daemon [_thread_blocked,
> id=5512, stack(0x387f0000,0x38860000)]
>   0x21da4c00 JavaThread "MariaDb-bulk-470" daemon [_thread_blocked,
> id=780, stack(0x38740000,0x387b0000)]
>   0x21da4400 JavaThread "MariaDb-bulk-469" daemon [_thread_blocked,
> id=6196, stack(0x38690000,0x38700000)]
>   0x21da3000 JavaThread "MariaDb-bulk-468" daemon [_thread_blocked,
> id=4888, stack(0x385e0000,0x38650000)]
>   0x21da3c00 JavaThread "MariaDb-bulk-467" daemon [_thread_blocked,
> id=5332, stack(0x38530000,0x385a0000)]
>   0x21da3800 JavaThread "MariaDb-bulk-466" daemon [_thread_blocked,
> id=5092, stack(0x38480000,0x384f0000)]
>   0x21da2c00 JavaThread "MariaDb-bulk-465" daemon [_thread_blocked,
> id=6576, stack(0x383d0000,0x38440000)]
>   0x21d9e800 JavaThread "MariaDb-bulk-464" daemon [_thread_blocked,
> id=6940, stack(0x38320000,0x38390000)]
>   0x21da1800 JavaThread "MariaDb-bulk-463" daemon [_thread_blocked,
> id=6028, stack(0x38270000,0x382e0000)]
>   0x21d9f800 JavaThread "MariaDb-bulk-462" daemon [_thread_blocked,
> id=3388, stack(0x381c0000,0x38230000)]
>   0x21d9ec00 JavaThread "MariaDb-bulk-461" daemon [_thread_blocked,
> id=1784, stack(0x38110000,0x38180000)]
>   0x21d9f400 JavaThread "MariaDb-bulk-460" daemon [_thread_blocked,
> id=4628, stack(0x38060000,0x380d0000)]
>   0x21da1000 JavaThread "MariaDb-bulk-459" daemon [_thread_blocked,
> id=280, stack(0x37f00000,0x37f70000)]
>   0x21da0c00 JavaThread "MariaDb-bulk-458" daemon [_thread_blocked,
> id=1680, stack(0x37e50000,0x37ec0000)]
>   0x21da0400 JavaThread "MariaDb-bulk-457" daemon [_thread_blocked,
> id=6732, stack(0x37da0000,0x37e10000)]
>   0x21da0000 JavaThread "MariaDb-bulk-456" daemon [_thread_blocked,
> id=5548, stack(0x37cf0000,0x37d60000)]
>   0x21da2000 JavaThread "MariaDb-bulk-455" daemon [_thread_blocked,
> id=4172, stack(0x36f30000,0x36fa0000)]
>   0x21d9ac00 JavaThread "http-apr-8082-exec-2206" daemon
> [_thread_blocked, id=6768, stack(0x37c40000,0x37cb0000)]
>   0x21d9a800 JavaThread "http-apr-8082-exec-2205" daemon
> [_thread_blocked, id=852, stack(0x37b90000,0x37c00000)]
>   0x21d9e000 JavaThread "http-apr-8082-exec-2204" daemon
> [_thread_blocked, id=2620, stack(0x37ae0000,0x37b50000)]
>   0x21d9a000 JavaThread "http-apr-8082-exec-2203" daemon
> [_thread_blocked, id=5396, stack(0x37a30000,0x37aa0000)]
>   0x21d9cc00 JavaThread "http-apr-8082-exec-2202" daemon
> [_thread_blocked, id=592, stack(0x37980000,0x379f0000)]
>   0x21d9c000 JavaThread "http-apr-8082-exec-2201" daemon
> [_thread_blocked, id=6300, stack(0x378d0000,0x37940000)]
>   0x21d99c00 JavaThread "http-apr-8082-exec-2200" daemon
> [_thread_blocked, id=4772, stack(0x37820000,0x37890000)]
>   0x21d9b400 JavaThread "http-apr-8082-exec-2199" daemon
> [_thread_blocked, id=6624, stack(0x37770000,0x377e0000)]
>   0x2302c400 JavaThread "http-apr-8082-exec-2198" daemon
> [_thread_blocked, id=1316, stack(0x376c0000,0x37730000)]
>   0x23029c00 JavaThread "http-apr-8082-exec-2197" daemon
> [_thread_blocked, id=5564, stack(0x37610000,0x37680000)]
>   0x2302a400 JavaThread "http-apr-8082-exec-2196" daemon
> [_thread_blocked, id=6460, stack(0x37560000,0x375d0000)]
>   0x2302b800 JavaThread "http-apr-8082-exec-2195" daemon
> [_thread_blocked, id=5968, stack(0x374b0000,0x37520000)]
>   0x2302b000 JavaThread "http-apr-8082-exec-2194" daemon
> [_thread_blocked, id=6316, stack(0x37400000,0x37470000)]
>   0x2302ac00 JavaThread "http-apr-8082-exec-2193" daemon
> [_thread_blocked, id=7140, stack(0x37350000,0x373c0000)]
>   0x23029800 JavaThread "http-apr-8082-exec-2192" daemon
> [_thread_blocked, id=308, stack(0x372a0000,0x37310000)]
>   0x23025800 JavaThread "http-apr-8082-exec-2191" daemon
> [_thread_blocked, id=3980, stack(0x371f0000,0x37260000)]
>   0x23029000 JavaThread "http-apr-8082-exec-2190" daemon
> [_thread_blocked, id=4584, stack(0x37140000,0x371b0000)]
>   0x23025400 JavaThread "http-apr-8082-exec-2189" daemon
> [_thread_blocked, id=596, stack(0x37090000,0x37100000)]
>   0x23028c00 JavaThread "http-apr-8082-exec-2188" daemon
> [_thread_blocked, id=5436, stack(0x36fe0000,0x37050000)]
>   0x23028400 JavaThread "http-apr-8082-exec-2187" daemon
> [_thread_blocked, id=5820, stack(0x36e80000,0x36ef0000)]
>   0x23026000 JavaThread "http-apr-8082-exec-2186" daemon
> [_thread_blocked, id=1244, stack(0x36dd0000,0x36e40000)]
>   0x23024400 JavaThread "http-apr-8082-exec-2185" daemon
> [_thread_blocked, id=5752, stack(0x36d20000,0x36d90000)]
>   0x23028000 JavaThread "http-apr-8082-exec-2184" daemon
> [_thread_blocked, id=2972, stack(0x36c70000,0x36ce0000)]
>   0x23027800 JavaThread "http-apr-8082-exec-2183" daemon
> [_thread_blocked, id=1040, stack(0x36b10000,0x36b80000)]
>   0x23024000 JavaThread "http-apr-8082-exec-2182" daemon
> [_thread_blocked, id=1236, stack(0x36a60000,0x36ad0000)]
>   0x23027000 JavaThread "http-apr-8082-exec-2181" daemon
> [_thread_blocked, id=5696, stack(0x369b0000,0x36a20000)]
>   0x23026c00 JavaThread "http-apr-8082-exec-2180" daemon
> [_thread_blocked, id=5308, stack(0x36900000,0x36970000)]
>   0x23026400 JavaThread "http-apr-8082-exec-2179" daemon
> [_thread_blocked, id=1948, stack(0x36850000,0x368c0000)]
>   0x23020000 JavaThread "http-apr-8082-exec-2178" daemon
> [_thread_blocked, id=3788, stack(0x367a0000,0x36810000)]
>   0x23023800 JavaThread "http-apr-8082-exec-2177" daemon
> [_thread_blocked, id=124, stack(0x366f0000,0x36760000)]
>   0x23023400 JavaThread "http-apr-8082-exec-2176" daemon
> [_thread_blocked, id=1956, stack(0x36640000,0x366b0000)]
>   0x2301f400 JavaThread "http-apr-8082-exec-2175" daemon
> [_thread_blocked, id=4632, stack(0x36590000,0x36600000)]
>   0x23022c00 JavaThread "http-apr-8082-exec-2174" daemon
> [_thread_blocked, id=6740, stack(0x364e0000,0x36550000)]
>   0x23020c00 JavaThread "http-apr-8082-exec-2173" daemon
> [_thread_blocked, id=6200, stack(0x36430000,0x364a0000)]
>   0x2301ec00 JavaThread "http-apr-8082-exec-2172" daemon
> [_thread_blocked, id=3516, stack(0x36380000,0x363f0000)]
>   0x23022800 JavaThread "http-apr-8082-exec-2171" daemon
> [_thread_blocked, id=6520, stack(0x36220000,0x36290000)]
>   0x23022000 JavaThread "http-apr-8082-exec-2170" daemon
> [_thread_blocked, id=5208, stack(0x36170000,0x361e0000)]
>   0x23021400 JavaThread "http-apr-8082-exec-2169" daemon
> [_thread_blocked, id=3220, stack(0x360c0000,0x36130000)]
>   0x23021800 JavaThread "http-apr-8082-exec-2168" daemon
> [_thread_blocked, id=5348, stack(0x36010000,0x36080000)]
>   0x23020800 JavaThread "http-apr-8082-exec-2167" daemon
> [_thread_blocked, id=1044, stack(0x35e00000,0x35e70000)]
>   0x2301dc00 JavaThread "http-apr-8082-exec-2166" daemon
> [_thread_blocked, id=7116, stack(0x35d50000,0x35dc0000)]
>   0x2301e800 JavaThread "http-apr-8082-exec-2165" daemon
> [_thread_blocked, id=1572, stack(0x35ca0000,0x35d10000)]
>   0x2301d400 JavaThread "http-apr-8082-exec-2164" daemon
> [_thread_blocked, id=5336, stack(0x35b40000,0x35bb0000)]
>   0x2301e000 JavaThread "http-apr-8082-exec-2163" daemon
> [_thread_blocked, id=3688, stack(0x35a90000,0x35b00000)]
>   0x266abc00 JavaThread "http-apr-8082-exec-2162" daemon
> [_thread_blocked, id=5428, stack(0x359e0000,0x35a50000)]
>   0x266ab000 JavaThread "http-apr-8082-exec-2161" daemon
> [_thread_blocked, id=1920, stack(0x35930000,0x359a0000)]
>   0x266ac800 JavaThread "http-apr-8082-exec-2160" daemon
> [_thread_blocked, id=496, stack(0x35880000,0x358f0000)]
>   0x266aa800 JavaThread "http-apr-8082-exec-2159" daemon
> [_thread_blocked, id=7028, stack(0x357d0000,0x35840000)]
>   0x266acc00 JavaThread "http-apr-8082-exec-2158" daemon
> [_thread_blocked, id=4392, stack(0x35720000,0x35790000)]
>   0x266ab400 JavaThread "http-apr-8082-exec-2157" daemon
> [_thread_blocked, id=100, stack(0x35670000,0x356e0000)]
>   0x266ac000 JavaThread "http-apr-8082-exec-2156" daemon
> [_thread_blocked, id=6488, stack(0x355c0000,0x35630000)]
>   0x266ad400 JavaThread "http-apr-8082-exec-2155" daemon
> [_thread_blocked, id=588, stack(0x35510000,0x35580000)]
>   0x266a8400 JavaThread "http-apr-8082-exec-2154" daemon
> [_thread_blocked, id=860, stack(0x353b0000,0x35420000)]
>   0x266a7400 JavaThread "http-apr-8082-exec-2153" daemon
> [_thread_blocked, id=6536, stack(0x35300000,0x35370000)]
>   0x266a9000 JavaThread "http-apr-8082-exec-2152" daemon
> [_thread_blocked, id=5124, stack(0x35250000,0x352c0000)]
>   0x266a6800 JavaThread "http-apr-8082-exec-2151" daemon
> [_thread_blocked, id=6312, stack(0x351a0000,0x35210000)]
>   0x266a9c00 JavaThread "http-apr-8082-exec-2150" daemon
> [_thread_blocked, id=1876, stack(0x350f0000,0x35160000)]
>   0x266a7000 JavaThread "http-apr-8082-exec-2149" daemon
> [_thread_blocked, id=4092, stack(0x35040000,0x350b0000)]
>   0x266a8800 JavaThread "http-apr-8082-exec-2148" daemon
> [_thread_blocked, id=6464, stack(0x34f90000,0x35000000)]
>   0x266aa000 JavaThread "http-apr-8082-exec-2147" daemon
> [_thread_blocked, id=6364, stack(0x34ee0000,0x34f50000)]
>   0x266a9400 JavaThread "http-apr-8082-exec-2146" daemon
> [_thread_blocked, id=2020, stack(0x34e30000,0x34ea0000)]
>   0x266a4400 JavaThread "http-apr-8082-exec-2145" daemon
> [_thread_blocked, id=1216, stack(0x34d80000,0x34df0000)]
>   0x266a7c00 JavaThread "http-apr-8082-exec-2144" daemon
> [_thread_blocked, id=4536, stack(0x34cd0000,0x34d40000)]
>   0x266a6400 JavaThread "http-apr-8082-exec-2143" daemon
> [_thread_blocked, id=1744, stack(0x34c20000,0x34c90000)]
>   0x266a2400 JavaThread "http-apr-8082-exec-2142" daemon
> [_thread_blocked, id=5516, stack(0x34b70000,0x34be0000)]
>   0x266a4800 JavaThread "http-apr-8082-exec-2141" daemon
> [_thread_blocked, id=6856, stack(0x34ac0000,0x34b30000)]
>   0x266a1c00 JavaThread "http-apr-8082-exec-2140" daemon
> [_thread_blocked, id=6604, stack(0x34a10000,0x34a80000)]
>   0x266a5800 JavaThread "http-apr-8082-exec-2139" daemon
> [_thread_blocked, id=1868, stack(0x34960000,0x349d0000)]
>   0x266a1800 JavaThread "http-apr-8082-exec-2138" daemon
> [_thread_blocked, id=3396, stack(0x348b0000,0x34920000)]
>   0x266a3c00 JavaThread "http-apr-8082-exec-2137" daemon
> [_thread_blocked, id=4784, stack(0x34800000,0x34870000)]
>   0x266a3800 JavaThread "http-apr-8082-exec-2136" daemon
> [_thread_blocked, id=6448, stack(0x34750000,0x347c0000)]
>   0x266a5000 JavaThread "http-apr-8082-exec-2135" daemon
> [_thread_blocked, id=1800, stack(0x346a0000,0x34710000)]
>   0x266a3000 JavaThread "http-apr-8082-exec-2134" daemon
> [_thread_blocked, id=6172, stack(0x345f0000,0x34660000)]
>   0x266a2c00 JavaThread "http-apr-8082-exec-2133" daemon
> [_thread_blocked, id=584, stack(0x34540000,0x345b0000)]
>   0x266adc00 JavaThread "http-apr-8082-exec-2132" daemon
> [_thread_blocked, id=5300, stack(0x34490000,0x34500000)]
>   0x266ae000 JavaThread "http-apr-8082-exec-2131" daemon
> [_thread_blocked, id=832, stack(0x343e0000,0x34450000)]
>   0x266aec00 JavaThread "http-apr-8082-exec-2130" daemon
> [_thread_blocked, id=6968, stack(0x34330000,0x343a0000)]
>   0x266ae800 JavaThread "http-apr-8082-exec-2129" daemon
> [_thread_blocked, id=7120, stack(0x34280000,0x342f0000)]
>   0x266b0800 JavaThread "http-apr-8082-exec-2128" daemon
> [_thread_blocked, id=7144, stack(0x341d0000,0x34240000)]
>   0x266b0000 JavaThread "http-apr-8082-exec-2127" daemon
> [_thread_blocked, id=5980, stack(0x34120000,0x34190000)]
>   0x266af400 JavaThread "http-apr-8082-exec-2126" daemon
> [_thread_blocked, id=2028, stack(0x34070000,0x340e0000)]
>   0x266af800 JavaThread "http-apr-8082-exec-2125" daemon
> [_thread_blocked, id=6980, stack(0x33fc0000,0x34030000)]
>   0x25106800 JavaThread "http-apr-8082-exec-2124" daemon
> [_thread_blocked, id=7092, stack(0x33f10000,0x33f80000)]
>   0x25105c00 JavaThread "http-apr-8082-exec-2123" daemon
> [_thread_blocked, id=6252, stack(0x33e60000,0x33ed0000)]
>   0x25105400 JavaThread "http-apr-8082-exec-2122" daemon
> [_thread_blocked, id=4412, stack(0x33db0000,0x33e20000)]
>   0x25105000 JavaThread "http-apr-8082-exec-2121" daemon
> [_thread_blocked, id=76, stack(0x33d00000,0x33d70000)]
>   0x25104800 JavaThread "http-apr-8082-exec-2120" daemon
> [_thread_blocked, id=1340, stack(0x33c50000,0x33cc0000)]
>   0x25104000 JavaThread "http-apr-8082-exec-2119" daemon
> [_thread_blocked, id=6192, stack(0x33ba0000,0x33c10000)]
>   0x25106c00 JavaThread "http-apr-8082-exec-2118" daemon
> [_thread_blocked, id=6752, stack(0x33af0000,0x33b60000)]
>   0x25100800 JavaThread "http-apr-8082-exec-2117" daemon
> [_thread_blocked, id=4416, stack(0x33a40000,0x33ab0000)]
>   0x25100400 JavaThread "http-apr-8082-exec-2116" daemon
> [_thread_blocked, id=292, stack(0x33990000,0x33a00000)]
>   0x25102400 JavaThread "http-apr-8082-exec-2115" daemon
> [_thread_blocked, id=160, stack(0x338e0000,0x33950000)]
>   0x25101c00 JavaThread "http-apr-8082-exec-2114" daemon
> [_thread_blocked, id=6208, stack(0x33830000,0x338a0000)]
>   0x25101400 JavaThread "http-apr-8082-exec-2113" daemon
> [_thread_blocked, id=4008, stack(0x33780000,0x337f0000)]
>   0x25103c00 JavaThread "http-apr-8082-exec-2112" daemon
> [_thread_blocked, id=4168, stack(0x336d0000,0x33740000)]
>   0x250ffc00 JavaThread "http-apr-8082-exec-2111" daemon
> [_thread_blocked, id=5604, stack(0x33620000,0x33690000)]
>   0x25103000 JavaThread "http-apr-8082-exec-2110" daemon
> [_thread_blocked, id=6216, stack(0x33570000,0x335e0000)]
>   0x25102800 JavaThread "http-apr-8082-exec-2109" daemon
> [_thread_blocked, id=7152, stack(0x334c0000,0x33530000)]
>   0x25101000 JavaThread "http-apr-8082-exec-2108" daemon
> [_thread_blocked, id=5044, stack(0x33410000,0x33480000)]
>   0x250fcc00 JavaThread "http-apr-8082-exec-2107" daemon
> [_thread_blocked, id=856, stack(0x33360000,0x333d0000)]
>   0x250ff800 JavaThread "http-apr-8082-exec-2106" daemon
> [_thread_blocked, id=5612, stack(0x332b0000,0x33320000)]
>   0x250ff000 JavaThread "http-apr-8082-exec-2105" daemon
> [_thread_blocked, id=1612, stack(0x33200000,0x33270000)]
>   0x250fb800 JavaThread "http-apr-8082-exec-2104" daemon
> [_thread_blocked, id=1404, stack(0x33150000,0x331c0000)]
>   0x250fc400 JavaThread "http-apr-8082-exec-2103" daemon
> [_thread_blocked, id=5304, stack(0x330a0000,0x33110000)]
>   0x250fe800 JavaThread "http-apr-8082-exec-2102" daemon
> [_thread_blocked, id=7160, stack(0x32ff0000,0x33060000)]
>   0x250fe400 JavaThread "http-apr-8082-exec-2101" daemon
> [_thread_blocked, id=5772, stack(0x32f40000,0x32fb0000)]
>   0x250fac00 JavaThread "http-apr-8082-exec-2100" daemon
> [_thread_blocked, id=1148, stack(0x32e90000,0x32f00000)]
>   0x250fd000 JavaThread "http-apr-8082-exec-2099" daemon
> [_thread_blocked, id=2908, stack(0x32de0000,0x32e50000)]
>   0x250fa400 JavaThread "http-apr-8082-exec-2098" daemon
> [_thread_blocked, id=5996, stack(0x32d30000,0x32da0000)]
>   0x250f9800 JavaThread "http-apr-8082-exec-2097" daemon
> [_thread_blocked, id=6952, stack(0x32c80000,0x32cf0000)]
>   0x250fa000 JavaThread "http-apr-8082-exec-2096" daemon
> [_thread_blocked, id=2732, stack(0x32bd0000,0x32c40000)]
>   0x250f5800 JavaThread "http-apr-8082-exec-2095" daemon
> [_thread_blocked, id=5368, stack(0x32b20000,0x32b90000)]
>   0x250f9000 JavaThread "http-apr-8082-exec-2094" daemon
> [_thread_blocked, id=5840, stack(0x32a70000,0x32ae0000)]
>   0x250f5400 JavaThread "http-apr-8082-exec-2093" daemon
> [_thread_blocked, id=6848, stack(0x329c0000,0x32a30000)]
>   0x250f8c00 JavaThread "http-apr-8082-exec-2092" daemon
> [_thread_blocked, id=6916, stack(0x32910000,0x32980000)]
>   0x250f4c00 JavaThread "http-apr-8082-exec-2091" daemon
> [_thread_blocked, id=4996, stack(0x32860000,0x328d0000)]
>   0x250f8400 JavaThread "http-apr-8082-exec-2090" daemon
> [_thread_blocked, id=5404, stack(0x327b0000,0x32820000)]
>   0x250f6400 JavaThread "http-apr-8082-exec-2089" daemon
> [_thread_blocked, id=948, stack(0x32700000,0x32770000)]
>   0x250f6000 JavaThread "http-apr-8082-exec-2088" daemon
> [_thread_blocked, id=6260, stack(0x32650000,0x326c0000)]
>   0x250f4800 JavaThread "http-apr-8082-exec-2087" daemon
> [_thread_blocked, id=7088, stack(0x325a0000,0x32610000)]
>   0x250f8000 JavaThread "http-apr-8082-exec-2086" daemon
> [_thread_blocked, id=5380, stack(0x324f0000,0x32560000)]
>   0x250f7800 JavaThread "http-apr-8082-exec-2085" daemon
> [_thread_blocked, id=4212, stack(0x32440000,0x324b0000)]
>   0x250f6c00 JavaThread "http-apr-8082-exec-2084" daemon
> [_thread_blocked, id=1780, stack(0x32390000,0x32400000)]
>   0x250f7400 JavaThread "http-apr-8082-exec-2083" daemon
> [_thread_blocked, id=6820, stack(0x322e0000,0x32350000)]
>   0x250f0800 JavaThread "http-apr-8082-exec-2082" daemon
> [_thread_blocked, id=6356, stack(0x32230000,0x322a0000)]
>   0x250f2000 JavaThread "http-apr-8082-exec-2081" daemon
> [_thread_blocked, id=6388, stack(0x32180000,0x321f0000)]
>   0x250f3800 JavaThread "http-apr-8082-exec-2080" daemon
> [_thread_blocked, id=1892, stack(0x320d0000,0x32140000)]
>   0x250f4000 JavaThread "http-apr-8082-exec-2079" daemon
> [_thread_blocked, id=5808, stack(0x32020000,0x32090000)]
>   0x250efc00 JavaThread "http-apr-8082-exec-2078" daemon
> [_thread_blocked, id=3988, stack(0x31f70000,0x31fe0000)]
>   0x250f3400 JavaThread "http-apr-8082-exec-2077" daemon
> [_thread_blocked, id=5624, stack(0x31ec0000,0x31f30000)]
>   0x250f0000 JavaThread "http-apr-8082-exec-2076" daemon
> [_thread_blocked, id=4820, stack(0x31e10000,0x31e80000)]
>   0x250f2c00 JavaThread "MariaDb-bulk-454" daemon [_thread_blocked,
> id=5356, stack(0x31d60000,0x31dd0000)]
>   0x250f1c00 JavaThread "MariaDb-bulk-453" daemon [_thread_blocked,
> id=420, stack(0x31cb0000,0x31d20000)]
>   0x250ef400 JavaThread "MariaDb-bulk-452" daemon [_thread_blocked,
> id=5780, stack(0x31c00000,0x31c70000)]
>   0x250f1400 JavaThread "MariaDb-bulk-451" daemon [_thread_blocked,
> id=6864, stack(0x31b50000,0x31bc0000)]
>   0x250f2800 JavaThread "MariaDb-bulk-450" daemon [_thread_blocked,
> id=6320, stack(0x31aa0000,0x31b10000)]
>   0x250ee800 JavaThread "MariaDb-bulk-446" daemon [_thread_blocked,
> id=5444, stack(0x319f0000,0x31a60000)]
>   0x250ee000 JavaThread "MariaDb-bulk-449" daemon [_thread_blocked,
> id=432, stack(0x31940000,0x319b0000)]
>   0x250ef000 JavaThread "MariaDb-bulk-448" daemon [_thread_blocked,
> id=312, stack(0x31890000,0x31900000)]
>   0x250f0c00 JavaThread "MariaDb-bulk-447" daemon [_thread_blocked,
> id=6132, stack(0x317e0000,0x31850000)]
>   0x2510d400 JavaThread "MariaDb-bulk-445" daemon [_thread_blocked,
> id=5372, stack(0x31730000,0x317a0000)]
>   0x2510cc00 JavaThread "MariaDb-bulk-444" daemon [_thread_blocked,
> id=1564, stack(0x31680000,0x316f0000)]
>   0x2510c400 JavaThread "Thread-176700" daemon [_thread_blocked,
> id=4776, stack(0x315d0000,0x31640000)]
>   0x2510d800 JavaThread "MariaDb-bulk-443" daemon [_thread_blocked,
> id=6136, stack(0x31520000,0x31590000)]
>   0x25108800 JavaThread "MariaDb-bulk-442" daemon [_thread_blocked,
> id=2904, stack(0x31470000,0x314e0000)]
>   0x2510c000 JavaThread "MariaDb-bulk-441" daemon [_thread_blocked,
> id=6500, stack(0x313c0000,0x31430000)]
>   0x2510a000 JavaThread "MariaDb-bulk-440" daemon [_thread_blocked,
> id=5824, stack(0x2c190000,0x2c200000)]
>   0x25108000 JavaThread "http-apr-8082-exec-2075" daemon
> [_thread_blocked, id=5224, stack(0x2c440000,0x2c4b0000)]
>   0x25109800 JavaThread "http-apr-8082-exec-2074" daemon
> [_thread_blocked, id=5844, stack(0x31310000,0x31380000)]
>   0x25108c00 JavaThread "http-apr-8082-exec-2073" daemon
> [_thread_in_native, id=3512, stack(0x31260000,0x312d0000)]
>   0x2510b400 JavaThread "http-apr-8082-exec-2072" daemon
> [_thread_blocked, id=7040, stack(0x311b0000,0x31220000)]
>   0x2510b800 JavaThread "http-apr-8082-exec-2071" daemon
> [_thread_blocked, id=2240, stack(0x30d00000,0x30d70000)]
>   0x25107c00 JavaThread "http-apr-8082-exec-2070" daemon
> [_thread_blocked, id=5888, stack(0x30c50000,0x30cc0000)]
>   0x25109400 JavaThread "http-apr-8082-exec-2069" daemon
> [_thread_blocked, id=5748, stack(0x30ba0000,0x30c10000)]
>   0x25107400 JavaThread "http-apr-8082-exec-2068" daemon
> [_thread_blocked, id=1056, stack(0x30af0000,0x30b60000)]
>   0x2510ac00 JavaThread "http-apr-8082-exec-2067" daemon
> [_thread_blocked, id=1260, stack(0x30a40000,0x30ab0000)]
>   0x2510a800 JavaThread "http-apr-8082-exec-2066" daemon
> [_thread_blocked, id=5460, stack(0x30990000,0x30a00000)]
>   0x22ff4c00 JavaThread "http-apr-8082-exec-2065" daemon
> [_thread_blocked, id=5568, stack(0x308e0000,0x30950000)]
>   0x22ff5800 JavaThread "http-apr-8082-exec-2064" daemon
> [_thread_blocked, id=3308, stack(0x30830000,0x308a0000)]
>   0x22ff7800 JavaThread "http-apr-8082-exec-2063" daemon
> [_thread_blocked, id=6508, stack(0x30780000,0x307f0000)]
>   0x22ff6c00 JavaThread "http-apr-8082-exec-2062" daemon
> [_thread_blocked, id=1808, stack(0x306d0000,0x30740000)]
>   0x22ff6400 JavaThread "http-apr-8082-exec-2061" daemon
> [_thread_blocked, id=4664, stack(0x30620000,0x30690000)]
>   0x22ff5c00 JavaThread "http-apr-8082-exec-2060" daemon
> [_thread_blocked, id=876, stack(0x30570000,0x305e0000)]
>   0x22ff5000 JavaThread "http-apr-8082-exec-2059" daemon
> [_thread_blocked, id=5320, stack(0x304c0000,0x30530000)]
>   0x22ff7000 JavaThread "http-apr-8082-exec-2058" daemon
> [_thread_blocked, id=7068, stack(0x30360000,0x303d0000)]
>   0x22ff4400 JavaThread "http-apr-8082-exec-2057" daemon
> [_thread_blocked, id=6948, stack(0x302b0000,0x30320000)]
>   0x22ff4000 JavaThread "http-apr-8082-exec-2056" daemon
> [_thread_blocked, id=5492, stack(0x30200000,0x30270000)]
>   0x22ff0000 JavaThread "http-apr-8082-exec-2055" daemon
> [_thread_blocked, id=5776, stack(0x30150000,0x301c0000)]
>   0x22ff0400 JavaThread "http-apr-8082-exec-2054" daemon
> [_thread_blocked, id=1136, stack(0x300a0000,0x30110000)]
>   0x22ff3800 JavaThread "http-apr-8082-exec-2053" daemon
> [_thread_blocked, id=4768, stack(0x2fff0000,0x30060000)]
>   0x22fef800 JavaThread "http-apr-8082-exec-2052" daemon
> [_thread_blocked, id=1832, stack(0x2ff40000,0x2ffb0000)]
>   0x22ff3000 JavaThread "http-apr-8082-exec-2051" daemon
> [_thread_blocked, id=2628, stack(0x2fe90000,0x2ff00000)]
>   0x22ff1400 JavaThread "http-apr-8082-exec-2050" daemon
> [_thread_blocked, id=3796, stack(0x2fde0000,0x2fe50000)]
>   0x22ff2000 JavaThread "http-apr-8082-exec-2049" daemon
> [_thread_blocked, id=6404, stack(0x2fd30000,0x2fda0000)]
>   0x22ff2c00 JavaThread "http-apr-8082-exec-2048" daemon
> [_thread_blocked, id=628, stack(0x2fc80000,0x2fcf0000)]
>   0x22ff2400 JavaThread "http-apr-8082-exec-2047" daemon
> [_thread_blocked, id=7016, stack(0x2fbd0000,0x2fc40000)]
>   0x22ff1800 JavaThread "http-apr-8082-exec-2046" daemon
> [_thread_blocked, id=6204, stack(0x2fb20000,0x2fb90000)]
>   0x22ff0c00 JavaThread "http-apr-8082-exec-2045" daemon
> [_thread_blocked, id=5976, stack(0x2fa70000,0x2fae0000)]
>   0x22fee800 JavaThread "http-apr-8082-exec-2044" daemon
> [_thread_blocked, id=1336, stack(0x2f9c0000,0x2fa30000)]
>   0x22fee000 JavaThread "http-apr-8082-exec-2043" daemon
> [_thread_blocked, id=6232, stack(0x2f910000,0x2f980000)]
>   0x22fef400 JavaThread "http-apr-8082-exec-2042" daemon
> [_thread_blocked, id=4656, stack(0x2f7b0000,0x2f820000)]
>   0x22feec00 JavaThread "http-apr-8082-exec-2041" daemon
> [_thread_blocked, id=5984, stack(0x2f700000,0x2f770000)]
>   0x22fecc00 JavaThread "http-apr-8082-exec-2040" daemon
> [_thread_blocked, id=4916, stack(0x2f4f0000,0x2f560000)]
>   0x22fea000 JavaThread "http-apr-8082-exec-2039" daemon
> [_thread_blocked, id=3864, stack(0x2f440000,0x2f4b0000)]
>   0x22fed400 JavaThread "http-apr-8082-exec-2038" daemon
> [_thread_blocked, id=936, stack(0x2f2e0000,0x2f350000)]
>   0x22fec800 JavaThread "http-apr-8082-exec-2037" daemon
> [_thread_blocked, id=5108, stack(0x2f230000,0x2f2a0000)]
>   0x22fe8400 JavaThread "http-apr-8082-exec-2036" daemon
> [_thread_blocked, id=2024, stack(0x2f180000,0x2f1f0000)]
>   0x22febc00 JavaThread "http-apr-8082-exec-2035" daemon
> [_thread_blocked, id=1916, stack(0x2f020000,0x2f090000)]
>   0x22fe9c00 JavaThread "http-apr-8082-exec-2034" daemon
> [_thread_blocked, id=3080, stack(0x2ef70000,0x2efe0000)]
>   0x22fea800 JavaThread "Thread-176632" daemon [_thread_blocked,
> id=3480, stack(0x2c5a0000,0x2c610000)]
>   0x22feb400 JavaThread "Thread-176548" daemon [_thread_blocked,
> id=992, stack(0x2bb50000,0x2bbc0000)]
>   0x2301d000 JavaThread "http-apr-8082-exec-2010" daemon
> [_thread_blocked, id=6572, stack(0x36bc0000,0x36c30000)]
>   0x257c6c00 JavaThread "http-apr-8082-exec-2000" daemon
> [_thread_blocked, id=2032, stack(0x362d0000,0x36340000)]
>   0x257c8800 JavaThread "http-apr-8082-exec-1995" daemon
> [_thread_blocked, id=5988, stack(0x35f60000,0x35fd0000)]
>   0x257c5400 JavaThread "http-apr-8082-exec-1994" daemon
> [_thread_blocked, id=6288, stack(0x35eb0000,0x35f20000)]
>   0x257c4000 JavaThread "http-apr-8082-exec-1991" daemon
> [_thread_blocked, id=2828, stack(0x35bf0000,0x35c60000)]
>   0x257bf000 JavaThread "http-apr-8082-exec-1981" daemon
> [_thread_blocked, id=3192, stack(0x35460000,0x354d0000)]
>   0x25106000 JavaThread "http-apr-8082-exec-1878" daemon
> [_thread_blocked, id=3764, stack(0x30410000,0x30480000)]
>   0x25103400 JavaThread "http-apr-8082-exec-1861" daemon
> [_thread_in_native, id=684, stack(0x2f650000,0x2f6c0000)]
>   0x250fbc00 JavaThread "http-apr-8082-exec-1860" daemon
> [_thread_blocked, id=3680, stack(0x2f5a0000,0x2f610000)]
>   0x250fdc00 JavaThread "http-apr-8082-exec-1854" daemon
> [_thread_blocked, id=7100, stack(0x2f0d0000,0x2f140000)]
>   0x250fd800 JavaThread "MariaDb-bulk-424" daemon [_thread_blocked,
> id=316, stack(0x3ced0000,0x3cf40000)]
>   0x250fb000 JavaThread "MariaDb-bulk-423" daemon [_thread_blocked,
> id=7032, stack(0x3ce20000,0x3ce90000)]
>   0x2523d800 JavaThread "MariaDb-bulk-367" daemon [_thread_blocked,
> id=6152, stack(0x38cc0000,0x38d30000)]
>   0x25859800 JavaThread "MariaDb-bulk-365" daemon [_thread_blocked,
> id=2832, stack(0x38b60000,0x38bd0000)]
>   0x2315f400 JavaThread "MariaDb-bulk-349" daemon [_thread_blocked,
> id=5540, stack(0x37fb0000,0x38020000)]
>   0x21d9bc00 JavaThread "Thread-157800" daemon [_thread_blocked,
> id=6660, stack(0x2c650000,0x2c6c0000)]
>   0x21d9d800 JavaThread "Thread-156087" daemon [_thread_blocked,
> id=6516, stack(0x2c4f0000,0x2c560000)]
>   0x21d9c800 JavaThread "Thread-150368" daemon [_thread_blocked,
> id=4504, stack(0x2a680000,0x2a6f0000)]
>   0x21d9d400 JavaThread "Thread-148610" daemon [_thread_blocked,
> id=6596, stack(0x2bc00000,0x2bc70000)]
>   0x2302bc00 JavaThread "Thread-143511" daemon [_thread_blocked,
> id=792, stack(0x2c0e0000,0x2c150000)]
>   0x22fe8800 JavaThread "Thread-124008" daemon [_thread_blocked,
> id=6308, stack(0x2a470000,0x2a4e0000)]
>   0x22fe9400 JavaThread "Thread-119664" daemon [_thread_blocked,
> id=5600, stack(0x2a5d0000,0x2a640000)]
>   0x22fec000 JavaThread "Thread-113109" daemon [_thread_blocked,
> id=4040, stack(0x2b530000,0x2b5a0000)]
>   0x22fedc00 JavaThread "Thread-111918" daemon [_thread_blocked,
> id=7052, stack(0x2a730000,0x2a7a0000)]
>   0x266a5c00 JavaThread "Thread-78544" daemon [_thread_blocked,
> id=2500, stack(0x2b480000,0x2b4f0000)]
>   0x266a1000 JavaThread "Thread-78134" daemon [_thread_blocked,
> id=7020, stack(0x2b890000,0x2b900000)]
>   0x22fe9000 JavaThread "Thread-62105" daemon [_thread_blocked,
> id=7076, stack(0x2a520000,0x2a590000)]
>   0x2315a400 JavaThread "Thread-6434" daemon [_thread_blocked,
> id=6496, stack(0x007b0000,0x00820000)]
>   0x23160800 JavaThread "Thread-6428" daemon [_thread_blocked,
> id=7080, stack(0x2f8a0000,0x2f910000)]
>   0x2315ec00 JavaThread "Thread-6420" daemon [_thread_blocked,
> id=3588, stack(0x2f3d0000,0x2f440000)]
>   0x2315a800 JavaThread "Thread-6382" daemon [_thread_blocked,
> id=4600, stack(0x2eae0000,0x2eb50000)]
>   0x264ca800 JavaThread "Thread-5926" daemon [_thread_blocked,
> id=6852, stack(0x2bed0000,0x2bf40000)]
>   0x264c8800 JavaThread "Thread-5452" daemon [_thread_blocked,
> id=5028, stack(0x2cd70000,0x2cde0000)]
>   0x264cb800 JavaThread "Thread-5395" daemon [_thread_blocked,
> id=5960, stack(0x2cb10000,0x2cb80000)]
>   0x25858c00 JavaThread "Thread-4807" daemon [_thread_blocked,
> id=4876, stack(0x2c030000,0x2c0a0000)]
>   0x264c7c00 JavaThread "Thread-3204" daemon [_thread_blocked,
> id=6708, stack(0x2ec40000,0x2ecb0000)]
>   0x264ca000 JavaThread "Thread-3202" daemon [_thread_blocked,
> id=6272, stack(0x2c7b0000,0x2c820000)]
>   0x264c7400 JavaThread "File Reaper" daemon [_thread_blocked,
> id=6128, stack(0x2ce20000,0x2ce90000)]
>   0x2585ac00 JavaThread "Thread-2929" daemon [_thread_blocked,
> id=6220, stack(0x2ecf0000,0x2ed60000)]
>   0x2585c400 JavaThread "Thread-2665" daemon [_thread_blocked,
> id=5616, stack(0x2ef00000,0x2ef70000)]
>   0x264cb400 JavaThread "Thread-2652" daemon [_thread_blocked,
> id=2516, stack(0x2eb90000,0x2ec00000)]
>   0x264c6000 JavaThread "Thread-2649" daemon [_thread_blocked,
> id=4560, stack(0x2ccc0000,0x2cd30000)]
>   0x264c8000 JavaThread "Thread-2593" daemon [_thread_blocked,
> id=6432, stack(0x2ea70000,0x2eae0000)]
>   0x264c8c00 JavaThread "Thread-2433" daemon [_thread_blocked,
> id=1508, stack(0x2e770000,0x2e7e0000)]
>   0x264c7000 JavaThread "Thread-2367" daemon [_thread_blocked,
> id=3216, stack(0x2ced0000,0x2cf40000)]
>   0x264c5c00 JavaThread "Thread-2350" daemon [_thread_blocked,
> id=4512, stack(0x2e200000,0x2e270000)]
>   0x264c6800 JavaThread "Thread-2321" daemon [_thread_blocked,
> id=4636, stack(0x2cf80000,0x2cff0000)]
>   0x264c5400 JavaThread "pool-7-thread-1" [_thread_blocked, id=3272,
> stack(0x2d130000,0x2d1a0000)]
>   0x2585c000 JavaThread "Thread-60" daemon [_thread_blocked, id=5072,
> stack(0x2be20000,0x2be90000)]
>   0x25856c00 JavaThread "Thread-29" daemon [_thread_blocked, id=5928,
> stack(0x2c860000,0x2c8d0000)]
>   0x25856800 JavaThread "Thread-27" daemon [_thread_blocked, id=5940,
> stack(0x2c700000,0x2c770000)]
>   0x25859400 JavaThread "Thread-20" daemon [_thread_blocked, id=5936,
> stack(0x2bfc0000,0x2c030000)]
>   0x2269cc00 JavaThread "Thread-18" daemon [_thread_blocked, id=5920,
> stack(0x2bdb0000,0x2be20000)]
>   0x24c81800 JavaThread "ajp-apr-8009-AsyncTimeout" daemon
> [_thread_blocked, id=5900, stack(0x2baa0000,0x2bb10000)]
>   0x24c81000 JavaThread "ajp-apr-8009-Acceptor-0" daemon
> [_thread_in_native, id=5896, stack(0x2b9f0000,0x2ba60000)]
>   0x24c80400 JavaThread "ajp-apr-8009-Poller" daemon [_thread_blocked,
> id=5892, stack(0x2b940000,0x2b9b0000)]
>   0x24c7d000 JavaThread "http-nio-8083-Acceptor-0" daemon
> [_thread_in_native, id=5884, stack(0x2b5e0000,0x2b650000)]
>   0x24c7e400 JavaThread "http-nio-8083-ClientPoller-1" daemon
> [_thread_in_native, id=5872, stack(0x2b3d0000,0x2b440000)]
>   0x24c7fc00 JavaThread "http-nio-8083-ClientPoller-0" daemon
> [_thread_in_native, id=5868, stack(0x2b320000,0x2b390000)]
>   0x24c7f800 JavaThread "http-apr-8082-AsyncTimeout" daemon
> [_thread_blocked, id=5864, stack(0x2b270000,0x2b2e0000)]
>   0x24c7c000 JavaThread "http-apr-8082-Acceptor-0" daemon
> [_thread_in_native, id=5860, stack(0x2b1c0000,0x2b230000)]
>   0x24c7ec00 JavaThread "http-apr-8082-Sendfile" daemon
> [_thread_blocked, id=5856, stack(0x2b110000,0x2b180000)]
> =>0x24c7ac00 JavaThread "http-apr-8082-Poller" daemon
> [_thread_in_native, id=5852, stack(0x2b060000,0x2b0d0000)]
>   0x24c7d800 JavaThread
> "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon
> [_thread_blocked, id=5848, stack(0x271f0000,0x27260000)]
>   0x24c7cc00 JavaThread "Timer-2" daemon [_thread_blocked, id=5716,
> stack(0x2afb0000,0x2b020000)]
>   0x24c7b800 JavaThread "Timer-1" daemon [_thread_blocked, id=5672,
> stack(0x2ae40000,0x2aeb0000)]
>   0x2523a400 JavaThread "Thread-12" daemon [_thread_blocked, id=5360,
> stack(0x2a2c0000,0x2a330000)]
>   0x25239800 JavaThread "nioEventLoopGroup-6-1" [_thread_in_native,
> id=5240, stack(0x2a010000,0x2a080000)]
>   0x2523d000 JavaThread "nioEventLoopGroup-5-1" [_thread_in_native,
> id=5212, stack(0x29f60000,0x29fd0000)]
>   0x2523c800 JavaThread "nioEventLoopGroup-4-1" [_thread_in_native,
> id=5204, stack(0x28e90000,0x28f00000)]
>   0x25238c00 JavaThread "threadDeathWatcher-3-1" daemon
> [_thread_blocked, id=5192, stack(0x27bd0000,0x27c40000)]
>   0x2523c400 JavaThread "nioEventLoopGroup-2-1" [_thread_in_native,
> id=5188, stack(0x27b20000,0x27b90000)]
>   0x25239c00 JavaThread "pool-5-thread-1" [_thread_blocked, id=892,
> stack(0x27870000,0x278e0000)]
>   0x25238400 JavaThread "Thread-11" daemon [_thread_blocked, id=1112,
> stack(0x27710000,0x27780000)]
>   0x2523bc00 JavaThread "Smack Listener Processor (0)" daemon
> [_thread_blocked, id=5104, stack(0x27660000,0x276d0000)]
>   0x25239000 JavaThread "Smack Keepalive" daemon [_thread_blocked,
> id=816, stack(0x275b0000,0x27620000)]
>   0x2523b800 JavaThread "Smack Packet Reader (0)" daemon
> [_thread_in_native, id=1728, stack(0x27500000,0x27570000)]
>   0x2523ac00 JavaThread "Smack Packet Writer (0)" daemon
> [_thread_blocked, id=1820, stack(0x27450000,0x274c0000)]
>   0x2523b000 JavaThread "Thread-8" daemon [_thread_in_native, id=1936,
> stack(0x272a0000,0x27310000)]
>   0x2269d400 JavaThread
> "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2"
> daemon [_thread_in_native, id=3888, stack(0x26e40000,0x26eb0000)]
>   0x23545400 JavaThread
> "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1"
> daemon [_thread_in_native, id=3884, stack(0x26d90000,0x26e00000)]
>   0x23545000 JavaThread
> "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0"
> daemon [_thread_in_native, id=1912, stack(0x26ce0000,0x26d50000)]
>   0x22d18000 JavaThread "Timer-0" daemon [_thread_blocked, id=1384,
> stack(0x26b30000,0x26ba0000)]
>   0x22d88800 JavaThread "NioBlockingSelector.BlockPoller-1" daemon
> [_thread_in_native, id=4796, stack(0x24390000,0x24400000)]
>   0x22b9a000 JavaThread "GC Daemon" daemon [_thread_blocked, id=4556,
> stack(0x23ee0000,0x23f50000)]
>   0x21d0bc00 JavaThread "AsyncFileHandlerWriter-32753077" daemon
> [_thread_blocked, id=3716, stack(0x22110000,0x22180000)]
>   0x2144c400 JavaThread "Service Thread" daemon [_thread_blocked,
> id=3540, stack(0x21ba0000,0x21c10000)]
>   0x21448000 JavaThread "C1 CompilerThread2" daemon [_thread_blocked,
> id=3536, stack(0x21af0000,0x21b60000)]
>   0x21446800 JavaThread "C2 CompilerThread1" daemon [_thread_blocked,
> id=3532, stack(0x21a40000,0x21ab0000)]
>   0x21444c00 JavaThread "C2 CompilerThread0" daemon [_thread_blocked,
> id=3528, stack(0x21990000,0x21a00000)]
>   0x2143fc00 JavaThread "Attach Listener" daemon [_thread_blocked,
> id=3524, stack(0x218e0000,0x21950000)]
>   0x2143f000 JavaThread "Signal Dispatcher" daemon [_thread_blocked,
> id=3520, stack(0x21830000,0x218a0000)]
>   0x21428800 JavaThread "Finalizer" daemon [_thread_blocked, id=3436,
> stack(0x21690000,0x21700000)]
>   0x21424400 JavaThread "Reference Handler" daemon [_thread_blocked,
> id=3432, stack(0x215e0000,0x21650000)]
>   0x00dfd000 JavaThread "main" [_thread_blocked, id=3200,
> stack(0x00c90000,0x00d00000)]
> 
> Other Threads:
>   0x2141f000 VMThread [stack: 0x21530000,0x215a0000] [id=3400]
>   0x214d8400 WatcherThread [stack: 0x21c60000,0x21cd0000] [id=3568]
> 
> VM state:not at safepoint (normal execution)
> 
> VM Mutex/Monitor currently owned by a thread: None
> 
> Heap:
>  PSYoungGen      total 43008K, used 31226K [0x1aec0000, 0x1e100000, 
> 0x20400000)
>   eden space 38144K, 69% used [0x1aec0000,0x1c8827d0,0x1d400000)
>   from space 4864K, 99% used [0x1d4c0000,0x1d97c220,0x1d980000)
>   to   space 6656K, 0% used [0x1da80000,0x1da80000,0x1e100000)
>  ParOldGen       total 125696K, used 81548K [0x10400000, 0x17ec0000, 
> 0x1aec0000)
>   object space 125696K, 64% used [0x10400000,0x153a30b0,0x17ec0000)
>  Metaspace       used 49817K, capacity 50719K, committed 50816K, reserved 
> 51584K
> 
> Card table byte_map: [0x00d00000,0x00d90000] byte_map_base: 0x00c7e000
> 
> Marking Bits: (ParMarkBitMap*) 0x711596f0
>  Begin Bits: [0x20590000, 0x20990000)
>  End Bits:   [0x20990000, 0x20d90000)
> 
> Polling page: 0x005f0000
> 
> CodeCache: size=245760Kb used=45817Kb max_used=45899Kb free=199942Kb
>  bounds [0x00f00000, 0x03c50000, 0x0ff00000]
>  total_blobs=14280 nmethods=14027 adapters=164
>  compilation: enabled
> 
> Compilation events (10 events):
> Event: 859988.200 Thread 0x21448000 20240       3
> java.security.Provider$Service::supportsParameter (147 bytes)
> Event: 859988.201 Thread 0x21448000 nmethod 20240 0x0136bec8 code
> [0x0136c1a0, 0x0136d588]
> Event: 859988.201 Thread 0x21448000 20242       3
> java.util.Vector::elements (9 bytes)
> Event: 859988.202 Thread 0x21448000 nmethod 20242 0x012e6448 code
> [0x012e6560, 0x012e6720]
> Event: 874636.867 Thread 0x21448000 20243       3
> com.fasterxml.jackson.databind.ser.impl.ReadOnlyClassToSerializerMap$Bucket::matchesTyped
> (21 bytes)
> Event: 874636.868 Thread 0x21448000 nmethod 20243 0x038f0288 code
> [0x038f03a0, 0x038f04e0]
> Event: 880908.405 Thread 0x21444c00 20244       4
> io.netty.buffer.WrappedByteBuf::forEachByte (11 bytes)
> Event: 880908.416 Thread 0x21444c00 nmethod 20244 0x02d22a48 code
> [0x02d22b80, 0x02d230bc]
> Event: 885373.532 Thread 0x21446800 20245       4
> sun.nio.cs.ThreadLocalCoders$Cache::moveToFront (33 bytes)
> Event: 885373.535 Thread 0x21446800 nmethod 20245 0x010b4ec8 code
> [0x010b4fc0, 0x010b50f0]
> 
> GC Heap History (10 events):
> Event: 885127.618 GC heap before
> {Heap before GC invocations=6071 (full 6):
>  PSYoungGen      total 41984K, used 41608K [0x1aec0000, 0x1d940000, 
> 0x20400000)
>   eden space 40960K, 100% used [0x1aec0000,0x1d6c0000,0x1d6c0000)
>   from space 1024K, 63% used [0x1d840000,0x1d8e20e0,0x1d940000)
>   to   space 1280K, 0% used [0x1d6c0000,0x1d6c0000,0x1d800000)
>  ParOldGen       total 125696K, used 70263K [0x10400000, 0x17ec0000, 
> 0x1aec0000)
>   object space 125696K, 55% used [0x10400000,0x1489de48,0x17ec0000)
>  Metaspace       used 49817K, capacity 50719K, committed 50816K, reserved 
> 51584K
> Event: 885127.622 GC heap after
> Heap after GC invocations=6071 (full 6):
>  PSYoungGen      total 42240K, used 704K [0x1aec0000, 0x1d940000, 0x20400000)
>   eden space 40960K, 0% used [0x1aec0000,0x1aec0000,0x1d6c0000)
>   from space 1280K, 55% used [0x1d6c0000,0x1d770070,0x1d800000)
>   to   space 1280K, 0% used [0x1d800000,0x1d800000,0x1d940000)
>  ParOldGen       total 125696K, used 70271K [0x10400000, 0x17ec0000, 
> 0x1aec0000)
>   object space 125696K, 55% used [0x10400000,0x1489fe48,0x17ec0000)
>  Metaspace       used 49817K, capacity 50719K, committed 50816K, reserved 
> 51584K
> }
> Event: 885350.880 GC heap before
> {Heap before GC invocations=6072 (full 6):
>  PSYoungGen      total 42240K, used 41664K [0x1aec0000, 0x1d940000, 
> 0x20400000)
>   eden space 40960K, 100% used [0x1aec0000,0x1d6c0000,0x1d6c0000)
>   from space 1280K, 55% used [0x1d6c0000,0x1d770070,0x1d800000)
>   to   space 1280K, 0% used [0x1d800000,0x1d800000,0x1d940000)
>  ParOldGen       total 125696K, used 70271K [0x10400000, 0x17ec0000, 
> 0x1aec0000)
>   object space 125696K, 55% used [0x10400000,0x1489fe48,0x17ec0000)
>  Metaspace       used 49817K, capacity 50719K, committed 50816K, reserved 
> 51584K
> Event: 885350.884 GC heap after
> Heap after GC invocations=6072 (full 6):
>  PSYoungGen      total 42496K, used 744K [0x1aec0000, 0x1d940000, 0x20400000)
>   eden space 41216K, 0% used [0x1aec0000,0x1aec0000,0x1d700000)
>   from space 1280K, 58% used [0x1d800000,0x1d8ba0e0,0x1d940000)
>   to   space 1024K, 0% used [0x1d700000,0x1d700000,0x1d800000)
>  ParOldGen       total 125696K, used 70295K [0x10400000, 0x17ec0000, 
> 0x1aec0000)
>   object space 125696K, 55% used [0x10400000,0x148a5e48,0x17ec0000)
>  Metaspace       used 49817K, capacity 50719K, committed 50816K, reserved 
> 51584K
> }
> Event: 885369.656 GC heap before
> {Heap before GC invocations=6073 (full 6):
>  PSYoungGen      total 42496K, used 41960K [0x1aec0000, 0x1d940000, 
> 0x20400000)
>   eden space 41216K, 100% used [0x1aec0000,0x1d700000,0x1d700000)
>   from space 1280K, 58% used [0x1d800000,0x1d8ba0e0,0x1d940000)
>   to   space 1024K, 0% used [0x1d700000,0x1d700000,0x1d800000)
>  ParOldGen       total 125696K, used 70295K [0x10400000, 0x17ec0000, 
> 0x1aec0000)
>   object space 125696K, 55% used [0x10400000,0x148a5e48,0x17ec0000)
>  Metaspace       used 49817K, capacity 50719K, committed 50816K, reserved 
> 51584K
> Event: 885369.663 GC heap after
> Heap after GC invocations=6073 (full 6):
>  PSYoungGen      total 41472K, used 1008K [0x1aec0000, 0x1dcc0000, 0x20400000)
>   eden space 40448K, 0% used [0x1aec0000,0x1aec0000,0x1d640000)
>   from space 1024K, 98% used [0x1d700000,0x1d7fc040,0x1d800000)
>   to   space 3328K, 0% used [0x1d980000,0x1d980000,0x1dcc0000)
>  ParOldGen       total 125696K, used 76055K [0x10400000, 0x17ec0000, 
> 0x1aec0000)
>   object space 125696K, 60% used [0x10400000,0x14e45c78,0x17ec0000)
>  Metaspace       used 49817K, capacity 50719K, committed 50816K, reserved 
> 51584K
> }
> Event: 885373.470 GC heap before
> {Heap before GC invocations=6074 (full 6):
>  PSYoungGen      total 41472K, used 41456K [0x1aec0000, 0x1dcc0000, 
> 0x20400000)
>   eden space 40448K, 100% used [0x1aec0000,0x1d640000,0x1d640000)
>   from space 1024K, 98% used [0x1d700000,0x1d7fc040,0x1d800000)
>   to   space 3328K, 0% used [0x1d980000,0x1d980000,0x1dcc0000)
>  ParOldGen       total 125696K, used 76055K [0x10400000, 0x17ec0000, 
> 0x1aec0000)
>   object space 125696K, 60% used [0x10400000,0x14e45c78,0x17ec0000)
>  Metaspace       used 49817K, capacity 50719K, committed 50816K, reserved 
> 51584K
> Event: 885373.479 GC heap after
> Heap after GC invocations=6074 (full 6):
>  PSYoungGen      total 42240K, used 3312K [0x1aec0000, 0x1df00000, 0x20400000)
>   eden space 38912K, 0% used [0x1aec0000,0x1aec0000,0x1d4c0000)
>   from space 3328K, 99% used [0x1d980000,0x1dcbc040,0x1dcc0000)
>   to   space 4864K, 0% used [0x1d4c0000,0x1d4c0000,0x1d980000)
>  ParOldGen       total 125696K, used 78461K [0x10400000, 0x17ec0000, 
> 0x1aec0000)
>   object space 125696K, 62% used [0x10400000,0x1509f668,0x17ec0000)
>  Metaspace       used 49817K, capacity 50719K, committed 50816K, reserved 
> 51584K
> }
> Event: 885378.152 GC heap before
> {Heap before GC invocations=6075 (full 6):
>  PSYoungGen      total 42240K, used 42224K [0x1aec0000, 0x1df00000, 
> 0x20400000)
>   eden space 38912K, 100% used [0x1aec0000,0x1d4c0000,0x1d4c0000)
>   from space 3328K, 99% used [0x1d980000,0x1dcbc040,0x1dcc0000)
>   to   space 4864K, 0% used [0x1d4c0000,0x1d4c0000,0x1d980000)
>  ParOldGen       total 125696K, used 78461K [0x10400000, 0x17ec0000, 
> 0x1aec0000)
>   object space 125696K, 62% used [0x10400000,0x1509f668,0x17ec0000)
>  Metaspace       used 49817K, capacity 50719K, committed 50816K, reserved 
> 51584K
> Event: 885378.163 GC heap after
> Heap after GC invocations=6075 (full 6):
>  PSYoungGen      total 43008K, used 4848K [0x1aec0000, 0x1e100000, 0x20400000)
>   eden space 38144K, 0% used [0x1aec0000,0x1aec0000,0x1d400000)
>   from space 4864K, 99% used [0x1d4c0000,0x1d97c220,0x1d980000)
>   to   space 6656K, 0% used [0x1da80000,0x1da80000,0x1e100000)
>  ParOldGen       total 125696K, used 81548K [0x10400000, 0x17ec0000, 
> 0x1aec0000)
>   object space 125696K, 64% used [0x10400000,0x153a30b0,0x17ec0000)
>  Metaspace       used 49817K, capacity 50719K, committed 50816K, reserved 
> 51584K
> }
> 
> Deoptimization events (10 events):
> Event: 600440.992 Thread 0x2523bc00 Uncommon trap: reason=unstable_if
> action=reinterpret pc=0x02e3698c
> method=xmppengine.listener.EmessRosterListener.presenceChanged(Lorg/jivesoftware/smack/packet/Presence;)V
> @ 129
> Event: 600441.471 Thread 0x2523bc00 Uncommon trap: reason=null_check
> action=make_not_entrant pc=0x0227b4c0
> method=sun.reflect.GeneratedMethodAccessor223.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
> @ 37
> Event: 600441.550 Thread 0x2523bc00 Uncommon trap: reason=unstable_if
> action=reinterpret pc=0x03a6f0a8
> method=sun.net.www.protocol.http.HttpURLConnection.followRedirect()Z @
> 18
> Event: 600497.909 Thread 0x2523bc00 Uncommon trap: reason=unstable_if
> action=reinterpret pc=0x037e36e0
> method=xmppengine.listener.EmessMessageListner.processMessage(Lorg/jivesoftware/smack/Chat;Lorg/jivesoftware/smack/packet/Message;)V
> @ 21
> Event: 616208.652 Thread 0x2301d000 Uncommon trap: reason=unstable_if
> action=reinterpret pc=0x03afab98
> method=java.util.concurrent.locks.ReentrantReadWriteLock$Sync.tryAcquireShared(I)I
> @ 36
> Event: 616208.675 Thread 0x24c7ac00 Uncommon trap: reason=unstable_if
> action=reinterpret pc=0x01835524
> method=org.apache.tomcat.util.net.AprEndpoint$Poller.addToPoller(JI)Z
> @ 23
> Event: 616208.941 Thread 0x23024400 Uncommon trap: reason=unstable_if
> action=reinterpret pc=0x0297e554
> method=com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource(J)Ljava/lang/Object;
> @ 31
> Event: 725570.715 Thread 0x22fed400 Uncommon trap: reason=unstable_if
> action=reinterpret pc=0x024bfa8c
> method=org.mariadb.jdbc.internal.packet.read.ReadPacketFetcher.getPacket()Lorg/mariadb/jdbc/internal/util/buffer/Buffer;
> @ 206
> Event: 785298.317 Thread 0x25238400 Uncommon trap: reason=unstable_if
> action=reinterpret pc=0x036d7450
> method=org.apache.catalina.webresources.CachedResource.validateResources(Z)Z
> @ 20
> Event: 859954.843 Thread 0x2523c800 Uncommon trap: reason=class_check
> action=maybe_recompile pc=0x0286aa64
> method=io.netty.handler.codec.http2.HpackDecoder.decode(ILio/netty/buffer/ByteBuf;Lio/netty/handler/codec/http2/Http2Headers;)V
> @ 446
> 
> Internal exceptions (10 events):
> Event: 876129.067 Thread 0x2523bc00 Exception <a
> 'java/net/SocketException': Socket closed> (0x1b10ddc8) thrown at
> [C:\workspace\8-2-build-windows-i586-cygwin\jdk8u77\6540\hotspot\src\share\vm\prims\jni.cpp,
> line 735]
> Event: 878201.753 Thread 0x25238400 Exception <a
> 'java/net/SocketException': Socket closed> (0x1af0c320) thrown at
> [C:\workspace\8-2-build-windows-i586-cygwin\jdk8u77\6540\hotspot\src\share\vm\prims\jni.cpp,
> line 735]
> Event: 878201.753 Thread 0x25238400 Exception <a
> 'java/net/SocketException': Socket closed> (0x1af0c758) thrown at
> [C:\workspace\8-2-build-windows-i586-cygwin\jdk8u77\6540\hotspot\src\share\vm\prims\jni.cpp,
> line 735]
> Event: 878201.753 Thread 0x25238400 Exception <a
> 'java/net/SocketException': Socket closed> (0x1af0cb90) thrown at
> [C:\workspace\8-2-build-windows-i586-cygwin\jdk8u77\6540\hotspot\src\share\vm\prims\jni.cpp,
> line 735]
> Event: 880332.859 Thread 0x25238400 Exception <a
> 'java/net/SocketException': Socket closed> (0x1afd37a8) thrown at
> [C:\workspace\8-2-build-windows-i586-cygwin\jdk8u77\6540\hotspot\src\share\vm\prims\jni.cpp,
> line 735]
> Event: 880332.859 Thread 0x25238400 Exception <a
> 'java/net/SocketException': Socket closed> (0x1afd3be0) thrown at
> [C:\workspace\8-2-build-windows-i586-cygwin\jdk8u77\6540\hotspot\src\share\vm\prims\jni.cpp,
> line 735]
> Event: 880332.859 Thread 0x25238400 Exception <a
> 'java/net/SocketException': Socket closed> (0x1afd4018) thrown at
> [C:\workspace\8-2-build-windows-i586-cygwin\jdk8u77\6540\hotspot\src\share\vm\prims\jni.cpp,
> line 735]
> Event: 880996.836 Thread 0x23545000 Exception <a
> 'java/net/SocketTimeoutException': Read timed out> (0x1b9f06f8) thrown
> at 
> [C:\workspace\8-2-build-windows-i586-cygwin\jdk8u77\6540\hotspot\src\share\vm\prims\jni.cpp,
> line 735]
> Event: 885377.284 Thread 0x23545000 Exception <a
> 'java/net/SocketTimeoutException': Read timed out> (0x1bbfd400) thrown
> at 
> [C:\workspace\8-2-build-windows-i586-cygwin\jdk8u77\6540\hotspot\src\share\vm\prims\jni.cpp,
> line 735]
> Event: 885377.285 Thread 0x23545400 Exception <a
> 'java/net/SocketTimeoutException': Read timed out> (0x1bcb9b10) thrown
> at 
> [C:\workspace\8-2-build-windows-i586-cygwin\jdk8u77\6540\hotspot\src\share\vm\prims\jni.cpp,
> line 735]
> 
> Events (10 events):
> Event: 885377.447 Executing VM operation: RevokeBias
> Event: 885377.448 Executing VM operation: RevokeBias done
> Event: 885377.473 Executing VM operation: RevokeBias
> Event: 885377.474 Executing VM operation: RevokeBias done
> Event: 885377.474 Thread 0x2315dc00 Thread exited: 0x2315dc00
> Event: 885377.537 Thread 0x2315c800 Thread added: 0x2315c800
> Event: 885377.659 Thread 0x2315d000 Thread added: 0x2315d000
> Event: 885378.150 Executing VM operation: ParallelGCFailedAllocation
> Event: 885378.163 Executing VM operation: ParallelGCFailedAllocation done
> Event: 885378.659 Thread 0x2315d000 Thread exited: 0x2315d000
> 
> 
> Dynamic libraries:
> 0x00400000 - 0x00418000 C:\Program Files (x86)\Status Solutions
> eMessenger Application\tomcat\bin\etomcat8.exe
> 0x770f0000 - 0x7725f000 C:\Windows\SYSTEM32\ntdll.dll
> 0x74ee0000 - 0x75020000 C:\Windows\SYSTEM32\KERNEL32.DLL
> 0x74df0000 - 0x74ec7000 C:\Windows\SYSTEM32\KERNELBASE.dll
> 0x754c0000 - 0x7553c000 C:\Windows\SYSTEM32\ADVAPI32.dll
> 0x75540000 - 0x767fb000 C:\Windows\SYSTEM32\SHELL32.dll
> 0x75020000 - 0x75173000 C:\Windows\SYSTEM32\USER32.dll
> 0x76cf0000 - 0x76db3000 C:\Windows\SYSTEM32\msvcrt.dll
> 0x74c00000 - 0x74c41000 C:\Windows\SYSTEM32\sechost.dll
> 0x748e0000 - 0x7499a000 C:\Windows\SYSTEM32\RPCRT4.dll
> 0x769d0000 - 0x76b4d000 C:\Windows\SYSTEM32\combase.dll
> 0x76800000 - 0x76845000 C:\Windows\SYSTEM32\SHLWAPI.dll
> 0x76f00000 - 0x7700c000 C:\Windows\SYSTEM32\GDI32.dll
> 0x76dc0000 - 0x76dde000 C:\Windows\SYSTEM32\SspiCli.dll
> 0x748d0000 - 0x748da000 C:\Windows\SYSTEM32\CRYPTBASE.dll
> 0x74870000 - 0x748c4000 C:\Windows\SYSTEM32\bcryptPrimitives.dll
> 0x746e0000 - 0x7476b000 C:\Windows\SYSTEM32\shcore.dll
> 0x70bb0000 - 0x711cc000 C:\Program Files (x86)\Status Solutions
> eMessenger Application\Java\jdk1.8.0_77\jre\bin\server\jvm.dll
> 0x74510000 - 0x74518000 C:\Windows\SYSTEM32\WSOCK32.dll
> 0x743b0000 - 0x743d3000 C:\Windows\SYSTEM32\WINMM.dll
> 0x74000000 - 0x74008000 C:\Windows\SYSTEM32\VERSION.dll
> 0x752e0000 - 0x752e6000 C:\Windows\SYSTEM32\PSAPI.DLL
> 0x740e0000 - 0x7419f000 C:\Windows\SYSTEM32\MSVCR100.dll
> 0x74c60000 - 0x74caf000 C:\Windows\SYSTEM32\WS2_32.dll
> 0x74380000 - 0x743a3000 C:\Windows\SYSTEM32\WINMMBASE.dll
> 0x74ed0000 - 0x74ed7000 C:\Windows\SYSTEM32\NSI.dll
> 0x75480000 - 0x754bc000 C:\Windows\SYSTEM32\cfgmgr32.dll
> 0x740b0000 - 0x740d1000 C:\Windows\SYSTEM32\DEVOBJ.dll
> 0x72100000 - 0x7210c000 C:\Program Files (x86)\Status Solutions
> eMessenger Application\Java\jdk1.8.0_77\jre\bin\verify.dll
> 0x72040000 - 0x72061000 C:\Program Files (x86)\Status Solutions
> eMessenger Application\Java\jdk1.8.0_77\jre\bin\java.dll
> 0x720e0000 - 0x720f3000 C:\Program Files (x86)\Status Solutions
> eMessenger Application\Java\jdk1.8.0_77\jre\bin\zip.dll
> 0x73de0000 - 0x73def000 C:\Windows\SYSTEM32\profapi.dll
> 0x71b30000 - 0x71b3a000 C:\Program Files (x86)\Status Solutions
> eMessenger Application\Java\jdk1.8.0_77\jre\bin\management.dll
> 0x71a40000 - 0x71a56000 C:\Program Files (x86)\Status Solutions
> eMessenger Application\Java\jdk1.8.0_77\jre\bin\net.dll
> 0x74770000 - 0x747bb000 C:\Windows\system32\mswsock.dll
> 0x71af0000 - 0x71aff000 C:\Program Files (x86)\Status Solutions
> eMessenger Application\Java\jdk1.8.0_77\jre\bin\nio.dll
> 0x23a50000 - 0x23b90000 C:\Program Files (x86)\Status Solutions
> eMessenger Application\tomcat\bin\tcnative-1.dll
> 0x73bf0000 - 0x73c09000 C:\Windows\SYSTEM32\CRYPTSP.dll
> 0x73bc0000 - 0x73bf0000 C:\Windows\system32\rsaenh.dll
> 0x73ba0000 - 0x73bbe000 C:\Windows\SYSTEM32\bcrypt.dll
> 0x71a20000 - 0x71a40000 C:\Program Files (x86)\Status Solutions
> eMessenger Application\Java\jdk1.8.0_77\jre\bin\sunec.dll
> 0x71a10000 - 0x71a19000 C:\Program Files (x86)\Status Solutions
> eMessenger Application\Java\jdk1.8.0_77\jre\bin\sunmscapi.dll
> 0x752f0000 - 0x75478000 C:\Windows\SYSTEM32\CRYPT32.dll
> 0x74c50000 - 0x74c5e000 C:\Windows\SYSTEM32\MSASN1.dll
> 0x74690000 - 0x746b0000 C:\Windows\SYSTEM32\IPHLPAPI.DLL
> 0x74680000 - 0x74688000 C:\Windows\SYSTEM32\WINNSI.DLL
> 0x72f40000 - 0x72f53000 C:\Windows\SYSTEM32\dhcpcsvc6.DLL
> 0x74520000 - 0x74534000 C:\Windows\SYSTEM32\dhcpcsvc.DLL
> 0x73c30000 - 0x73c41000 C:\Windows\system32\napinsp.dll
> 0x73c10000 - 0x73c24000 C:\Windows\system32\NLAapi.dll
> 0x73950000 - 0x739ce000 C:\Windows\SYSTEM32\DNSAPI.dll
> 0x73940000 - 0x7394a000 C:\Windows\System32\winrnr.dll
> 0x738a0000 - 0x738e6000 C:\Windows\System32\fwpuclnt.dll
> 0x73890000 - 0x73898000 C:\Windows\System32\rasadhlp.dll
> 0x717a0000 - 0x718e1000 C:\Windows\system32\DBGHELP.DLL
> 
> VM Arguments:
> jvm_args: -Dcatalina.home=C:\Program Files (x86)\Status Solutions
> eMessenger Application\tomcat -Dcatalina.base=C:\Program Files
> (x86)\Status Solutions eMessenger Application\tomcat
> -Djava.endorsed.dirs=C:\Program Files (x86)\Status Solutions
> eMessenger Application\tomcat\endorsed -Djava.io.tmpdir=C:\Program
> Files (x86)\Status Solutions eMessenger Application\tomcat\temp
> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
> -Djava.util.logging.config.file=C:\Program Files (x86)\Status
> Solutions eMessenger Application\tomcat\conf\logging.properties
> -Djava.net.preferIPv4Stack=true
> -Dsmack.debuggerClass=org.jivesoftware.smack.debugger.ConsoleDebugger
> -Xbootclasspath/p:C:\Program Files (x86)\Status Solutions eMessenger
> Application\tomcat\lib\alpn-boot-8.1.7.v20160121.jar exit -Xms128m
> -Xmx256m
> java_command: <unknown>
> java_class_path (initial): C:\Program Files (x86)\Status Solutions
> eMessenger Application\tomcat\bin\bootstrap.jar;C:\Program Files
> (x86)\Status Solutions eMessenger
> Application\tomcat\bin\tomcat-juli.jar
> Launcher Type: generic
> 
> Environment Variables:
> PATH=C:\ProgramData\Oracle\Java\javapath;C:\Program Files
> (x86)\Speechify\bin;C:\Program Files (x86)\Dialogic\bin;C:\Program
> Files 
> (x86)\Dialogic\lib;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program
> Files\nodejs\;
> USERNAME=DCSARDB01$
> OS=Windows_NT
> PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 26 Stepping 4, GenuineIntel
> 
> 
> 
> ---------------  S Y S T E M  ---------------
> 
> OS: Windows Server 2012 R2 , 64 bit Build 9600 (6.3.9600.17415)
> 
> CPU:total 4 (2 cores per cpu, 1 threads per core) family 6 model 26
> stepping 4, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1,
> sse4.2, popcnt, tsc, tscinvbit, tscinv
> 
> Memory: 4k page, physical 8388148k(4037132k free), swap 9698868k(5424844k 
> free)
> 
> vm_info: Java HotSpot(TM) Server VM (25.77-b03) for windows-x86 JRE
> (1.8.0_77-b03), built on Mar 20 2016 21:57:58 by "java_re" with MS
> VC++ 10.0 (VS2010)
> 
> time: Sun Oct 22 10:28:07 2017
> elapsed time: 885383 seconds (10d 5h 56m 23s)
> ============================================================
> 
> Thanks and Regards
> Atanu Pal
> E2Infosystems - Chennai
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org
> For additional commands, e-mail: users-h...@tomcat.apache.org
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org
For additional commands, e-mail: users-h...@tomcat.apache.org

Reply via email to