How to deal with the Error: KAFKA_STORAGE_ERROR

2022-04-27 Thread Dong, Peter A. (NSB - CN/Qingdao)
Greetings, Kafka specialists A strange issue in my Kafka instance that blocked my for a couple of days. 1. Cannot produce event to [topic-test] due to a KAFKA_STORAGE_ERROR 2. It seems to me the log segment file is not having any problem. I can dump log, index, timeindex with kafka

Re: Unexpected Rebalances ,Any tips on APIs or debug techniques to figure out rebalance causes?

2022-04-27 Thread Luke Chen
1. is it correctly the idea about B ? i think it maybe the major factor for rebalance in my case ,because consuming data is slowly. => Looks like so, but we cannot confirm that because we don't have other information. You should check the consumer log to see why the consumer leave group. 2.

kafka 2.7 to 2.8 upgrade

2022-04-27 Thread David Ballano Fernandez
Hi guys. I have a question about upgrades. I am currently on 2.7 or confluent opensource 6.1. since my last upgrade from confluent opensoure 5.x (kafka 2.0) my server.properties has this: inter.broker.protocol.version=2.7 log.message.format.version=2.0 following confluent notes for upgrades me

Unexpected Rebalances ,Any tips on APIs or debug techniques to figure out rebalance causes?

2022-04-27 Thread 杨宝栓
HI: We are seeing unexpected rebalances in golang consumers, described below. 1. We have a topic with 36 partitions,and one consumer (lets name it consumer1) consuming it. 2. Run kafka in Docker and configuration:We use defaults 3. Consumer consuming data is slowly