Request was for a topic or partition that does not exist on this broker error when using Kafka in Kraft mode

2022-04-02 Thread Francis Chuang
Hey Everyone, I have a Go library that publishes and consumes from Kafka using Shopify's sarama library. Initially, my test environment used Kafka and Zookeeper. Recently, I updated it to use Kafka in Kraft (no-zookeeper) mode. I noticed previously passing and stable tests started failing wi

Re: Request was for a topic or partition that does not exist on this broker error when using Kafka in Kraft mode

2022-04-04 Thread Francis Chuang
-418a-92e8-1f2d8fa0c704-0 with topic ID JujvHxuwSF65PjxapwU4KA and PartitionRegistration(replicas=[3], isr=[3], removingReplicas=[], addingReplicas=[], leader=3, leaderEpoch=0, partitionEpoch=0). (org.apache.kafka.controller.ReplicationControlManager) On 2/04/2022 7:56 pm, Francis Chuang w

Re: Request was for a topic or partition that does not exist on this broker error when using Kafka in Kraft mode

2022-04-04 Thread Francis Chuang
tId=sarama, clientHost=/172.21.0.6, sessionTimeoutMs=1, rebalanceTimeoutMs=6, supportedProtocols=List(range)) has left group test-bounded-context-1-6cdaff21-6562-418a-92e8-1f2d8fa0c704 through explicit `LeaveGroup` request (kafka.coordinator.group.GroupCoordinator) Thanks, Francis

Re: Request was for a topic or partition that does not exist on this broker error when using Kafka in Kraft mode

2022-04-04 Thread Francis Chuang
your consumer group, it looks like your consumer is repeatedly entering and leaving when hitting that error. Do you have logs from the consumer side? Cheers, Liam On Tue, 5 Apr 2022 at 11:30, Francis Chuang wrote: Not sure if this is due to the broker rebalancing multiple times every secon