Minor GC time in my cluster becomes longer and longer, and broker loss session
with zk:
2016-04-11T17:33:06.559+0800: 875.917: [GC2016-04-11T17:33:06.559+0800:
875.917: [ParNew: 3363139K->10287K(3774912K), 0.0858010 secs]
3875141K->522289K(31037888K), 0.0860890 secs] [Times: user=1.46 sys=0.02,
real=0.09 secs]
2016-04-11T17:38:50.477+0800: 1219.834:
[GC2016-04-11T17:38:50.477+0800: 1219.835: [ParNew: 3365807K->11295K(3774912K),
0.0858600 secs] 3877809K->523297K(31037888K), 0.0861390 secs] [Times: user=1.50
sys=0.00, real=0.08 secs]
2016-04-11T17:46:58.550+0800: 1707.908:
[GC2016-04-11T17:46:58.550+0800: 1707.908: [ParNew: 3366815K->8463K(3774912K),
15.8853640 secs] 3878817K->526017K(31037888K), 15.8855810 secs] [Times:
user=286.22 sys=0.00, real=15.89 secs]
2016-04-11T17:54:37.601+0800: 2166.959:
[GC2016-04-11T17:54:37.601+0800: 2166.959: [ParNew: 3363983K->5961K(3774912K),
22.5800540 secs] 3881537K->523515K(31037888K), 22.5803030 secs] [Times:
user=406.07 sys=0.00, real=22.58 secs]
Here is my jvm setting:
28808 kafka.Kafka -Xmx30G -Xms30G -Xmn4G -XX:+UseCompressedOops
-XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled
-XX:+UseCMSCompactAtFullCollection -XX:CMSFullGCsBeforeCompaction=0
-XX:+CMSParallelRemarkEnabled -XX:+DisableExplicitGC
-XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=75
-Xnoclassgc -XX:+UseParNewGC -XX:+UseConcMarkSweepGC
-XX:+CMSClassUnloadingEnabled -XX:+CMSScavengeBeforeRemark
-XX:+DisableExplicitGC -Djava.awt.headless=true
-Xloggc:/home/hadoop/kafka/bin/../logs/kafkaServer-gc.log -verbose:gc
-XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dkafka.logs.dir=/home/hadoop/kafka/bin/../logs
-Dlog4j.configuration=file:bin/../config/log4j.properties
Any suggestion to tune the jvm ?
Thanks,
lujinhong
