Re: Topic partition Leader: none

2023-01-11 Thread Tom Bolitho
Hi All, Just a quick update to say that I've overcome this issue by temporarily enabling the unclean.leader.election.enable=false property on the __consumer_offsets topic, performing a rolling restart of the cluster and then applying a new reassignment config to the two partitions that were missin

Re: Topic partition Leader: none

2023-01-11 Thread Tom Bolitho
Just an update on the 'Leader: none' issue for one of the partitions of my __consumer_offsets topic, I have tried deleting all of the partition.metadata files relating to the __consumer_offsets topic on all of nodes in the cluster. I have then restarted each node in the cluster. Unfortunately, the

Re: Topic partition Leader: none

2023-01-10 Thread Tom Bolitho
Hi Megh Many thanks for taking the time to get back to me. It sounds like we've had a similar issue although I've checked all of the topic_id's in all of the partition.metadata relating to the problematic topic __consumer_offsets (e.g. grep -r 'topic_id' /data/*/kafka/data/__consumer_offsets-*) an

Re: Topic partition Leader: none

2023-01-10 Thread Tom Bolitho
Hi, Many thanks for getting back to me. I gave that a go but unfortunately it didn't solve the problem; the leader still has a status of none for a couple of the partitions of that particular topic after restarting the controller and assigning the controller to a different node. Thanks all the sam

Re: Topic partition Leader: none

2023-01-10 Thread Luke Chen
Hi, That sounds similar to this issue: KAFKA-14190 . Could you help confirm it and comment in the JIRA? That will let contributors know this is an important issue bothering many users. Thank you. Luke On Tue, Jan 10, 2023 at 10:08 AM megh vidani

Re: Topic partition Leader: none

2023-01-09 Thread megh vidani
Hi Tom, We faced similar problem wherein there was an issue with isr and we were also getting NotLeaderOrFollowerException on consumer end. Also, it was not getting fixed automatically with broker restarts. We eventually found out that the topicId for a few partitions in the topic (in the partiti

Re: Topic partition Leader: none

2023-01-09 Thread 高磊
According to our previous experience in dealing with similar scenarios, the controller node can be restarted for recovery. After the new controller is started successfully, the OfflinePartitionSelector election algorithm will be used to elect a leader from the ISR or living AR for the OfflinePartit

Topic partition Leader: none

2023-01-09 Thread Tom Bolitho
Dear Kafka Community, I'm hoping you can help with kafka topic partition that is missing a leader. The topic in question is the '__consumer_offsets' topic The output of a '--describe' on that topic looks like: Topic: __consumer_offsets Partition: 7 Leader: none Replicas 5Isr: 5 Topic: __