[
https://issues.apache.org/jira/browse/HIVE-24650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17267692#comment-17267692
]
Adrian Wang commented on HIVE-24650:
------------------------------------
As far as I am concerned, this could be an issue of calcite. Could you try `set
hive.cbo.enable=false` and check what happens?
> hiveserver2 memory usage is extremely high, GC unable to recycle
> ----------------------------------------------------------------
>
> Key: HIVE-24650
> URL: https://issues.apache.org/jira/browse/HIVE-24650
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Affects Versions: 3.1.0
> Environment: hive3.1.0
> Reporter: zhaojk
> Priority: Major
> Attachments: 1.png, 2.png, 3.png
>
>
> HDP's HiveServer2 is using 80GB of memory (HEAP is configured with 74GB), and
> when the memory is full, there will be frequent Full GC, and then the memory
> cannot be recycled, resulting in a service exception.Analyze memory usage.
> GC config:
> export HADOOP_OPTS="$HADOOP_OPTS
> -Xloggc:\{{hive_log_dir}}/hiveserver2-gc-%t.log -XX:ConcGCThreads=30
> -XX:ParallelGCThreads=30 -XX:+UseG1GC -XX:G1HeapRegionSize=8M
> -XX:+UseStringDeduplication -XX:MaxGCPauseMillis=1000
> -XX:InitiatingHeapOccupancyPercent=40 -XX:G1ReservePercent=15
> -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCCause
> -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=100M
> -XX:+HeapDumpOnOutOfMemoryError
> -XX:HeapDumpPath=/home/hive/hs2_heapdump.hprof
> -Dhive.log.dir=\{{hive_log_dir}} -Dhive.log.file=hiveserver2.log
> The details at
> [https://blog.csdn.net/Small_codeing/article/details/112601226]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
