On 13/11/2023 07:52, Øyvind Flatval wrote:
Greetings!
We are currently experiencing a very vague problem with our Tomcat 10.1
instance, where the JVM will crash almost instantly after Tomcat is done
starting up.
The problem happens somewhat regularly, and only happens within the first
minute after starting Tomcat. The solution is always to just attempt to restart
Tomcat and this usually only take 1 attempt.
Tomcat is running a single web application, that sees traffic over both
Websocket (several 100 clients) and Https (maybe 20-40 users during peak + a
few API clients)
Our setup is a somewhat old VM.
Windows Server 2016 Standard 1607, buil 14343.6351
Intel Xeon E5-2680 v4 @ 2.40 GHz
4 x Cores
8 GB Memory
JRE version: OpenJDK Runtime Environment Temurin-17.0.8.1+1 (17.0.8.1+1) (build
17.0.8.1+1)
Java VM: OpenJDK 64-Bit Server VM Temurin-17.0.8.1+1 (17.0.8.1+1, mixed mode,
sharing, tiered, compressed oops, compressed class ptrs, g1 gc, windows-amd64)
Tomcat version is 10.1.15 64 bit
The company we rent our VM servers from has installed Sentinel One that
connects to the JVM through an agent. I have very little knowledge of what if
anything this can do. Since this is the only thing out of the ordinary running
on this setup, my fear is that this might be causing the crashes.
Some web searching suggests that is certainly likely.
I include a partial example of the exception log here, some data may have been
removed for privacy reasons. Please let med know if I should include the full
file, since I've removed parts of it due to pure length.
The full file might contain a few more hints as to what went wrong.
Mark
#
# A fatal error has been detected by the Java Runtime Environment:
#
# EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x000000001131b169, pid=2084,
tid=5160
#
# JRE version: OpenJDK Runtime Environment Temurin-17.0.8.1+1 (17.0.8.1+1)
(build 17.0.8.1+1)
# Java VM: OpenJDK 64-Bit Server VM Temurin-17.0.8.1+1 (17.0.8.1+1, mixed mode,
sharing, tiered, compressed oops, compressed class ptrs, g1 gc, windows-amd64)
# Problematic frame:
# j
jakarta.servlet.http.HttpServletRequestWrapper.getDateHeader(Ljava/lang/String;)J+1
#
# Core dump will be written. Default location: E:\tomcat10\hs_err_pid2084.mdmp
#
# If you would like to submit a bug report, please visit:
# https://github.com/adoptium/adoptium-support/issues
#
--------------- S U M M A R Y ------------
Command Line: -Dcatalina.home=E:\tomcat10 -Dcatalina.base=E:\tomcat10
-Dignore.endorsed.dirs=E:\tomcat10\endorsed -Djava.io.tmpdir=E:\tomcat10\temp
-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
-Djava.util.logging.config.file=E:\tomcat10\conf\logging.properties
-Djava.locale.providers=COMPAT --add-opens=java.base/java.lang=ALL-UNNAMED
--add-opens=java.base/java.io=ALL-UNNAMED
--add-opens=java.base/java.util=ALL-UNNAMED
--add-opens=java.base/java.util.concurrent=ALL-UNNAMED
--add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED exit abort -Xms768m
-Xmx5090m -agentpath:C:\Program Files\SentinelOne\Sentinel Agent
22.3.4.612\SentinelJava64.dll
Host: Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz, 4 cores, 7G, Windows Server
2016 , 64 bit Build 14393 (10.0.14393.5786)
Time: Sat Nov 11 18:18:30 2023 W. Europe Standard Time elapsed time: 153.828934
seconds (0d 0h 2m 33s)
--------------- T H R E A D ---------------
Current thread (0x000000002e6a9bd0): JavaThread
"https-openssl-nio-0.0.0.0-443-exec-180" daemon [_thread_in_Java, id=5160,
stack(0x00000000403a0000,0x00000000404a0000)]
Stack: [0x00000000403a0000,0x00000000404a0000], sp=0x000000004049c1f8, free
space=1008k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C 0x000000001131b169
siginfo: EXCEPTION_ACCESS_VIOLATION (0xc0000005), reading address
0xffffffffffffffff
...
Stack slot to memory mapping:
stack at sp + 0 slots: 0x0000000011309657 is at code_begin+1463 in an
Interpreter codelet
return entry points [0x00000000113090a0, 0x0000000011309ba0] 2816 bytes
stack at sp + 1 slots: 0x0061006200650077 is an unknown value
stack at sp + 2 slots: 0x000000004049c208 is pointing into the stack for
thread: 0x000000002e6a9bd0
stack at sp + 3 slots: 0x000000002a938ae1 is pointing into metadata
stack at sp + 4 slots: 0x000000004049c268 is pointing into the stack for
thread: 0x000000002e6a9bd0
stack at sp + 5 slots: 0x000000002a93e930 is pointing into metadata
stack at sp + 6 slots: 0x0 is NULL
stack at sp + 7 slots: 0x00000006c5fd67d0 is an oop: java.lang.Class
{0x00000006c5fd67d0} - klass: 'java/lang/Class'
- ---- fields (total size 14 words):
- private volatile transient 'classRedefinedCount' 'I' @12 0
- private volatile transient 'cachedConstructor'
'Ljava/lang/reflect/Constructor;' @40 NULL (0)
- private transient 'name' 'Ljava/lang/String;' @44
"jakarta.servlet.http.HttpServletRequestWrapper"{0x00000006c5fd6840} (d8bfad08)
- private transient 'module' 'Ljava/lang/Module;' @48 a
'java/lang/Module'{0x00000006c1d03100} (d83a0620)
- private final 'classLoader' 'Ljava/lang/ClassLoader;' @52 a
'java/net/URLClassLoader'{0x00000006c1c01418} (d8380283)
- private transient 'classData' 'Ljava/lang/Object;' @56 NULL (0)
- private transient 'packageName' 'Ljava/lang/String;' @60
"jakarta.servlet.http"{0x00000006c20d6fb0} (d841adf6)
- private final 'componentType' 'Ljava/lang/Class;' @64 NULL (0)
- private volatile transient 'reflectionData' 'Ljava/lang/ref/SoftReference;'
@68 NULL (0)
- private volatile transient 'genericInfo'
'Lsun/reflect/generics/repository/ClassRepository;' @72 NULL (0)
- private volatile transient 'enumConstants' '[Ljava/lang/Object;' @76 NULL
(0)
- private volatile transient 'enumConstantDirectory' 'Ljava/util/Map;' @80
NULL (0)
- private volatile transient 'annotationData'
'Ljava/lang/Class$AnnotationData;' @84 NULL (0)
- private volatile transient 'annotationType'
'Lsun/reflect/annotation/AnnotationType;' @88 NULL (0)
- transient 'classValueMap' 'Ljava/lang/ClassValue$ClassValueMap;' @92 NULL
(0)
- signature: Ljakarta/servlet/http/HttpServletRequestWrapper;
- fake entry for mirror: 'jakarta/servlet/http/HttpServletRequestWrapper'
- fake entry for array: NULL
- fake entry for oop_size: 14
- fake entry for static_oop_field_count: 0
Regards, Øyvind Flatval
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org
For additional commands, e-mail: users-h...@tomcat.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org
For additional commands, e-mail: users-h...@tomcat.apache.org
