Re: Kafka gc remark time very long

2019-08-21 Thread Xiaobing Bu
brokers seems this broker is crash, and doing failover. On Thu, Aug 22, 2019 at 2:00 PM Eliza wrote: > Hi > > on 2019/8/22 13:48, Xiaobing Bu wrote: > > [2019-08-07 02:30:04,802] WARN Attempting to send response via channel > for > > which there is no open connection, connect

kafka __conusmer_offsets cleanup.policy change from delete to compact

2019-08-21 Thread Xiaobing Bu
Hi, Our kafka __consumer_offsets cleanup.policy set to delete, and retention.ms set to 8640(one day), because we found the default compact mode using very large disk, and we change to delete mode many years ago. Now we become understanding kafka failover, and found some partitions under __conus

Kafka gc remark time very long

2019-08-21 Thread Xiaobing Bu
Hi all, Our kafka cluster on production environment have some problem, some brokers connect to zookeeper timeout almost everyday. There are four brokers, each has 10 core CPU and 8G memory. The following is the server.log , it said broker can not connect to zookeeper. I had capture packets using t