Re: Topic partition Leader: none

2023-01-09 Thread megh vidani
Hi Tom, We faced similar problem wherein there was an issue with isr and we were also getting NotLeaderOrFollowerException on consumer end. Also, it was not getting fixed automatically with broker restarts. We eventually found out that the topicId for a few partitions in the topic (in the partiti

Re: Messages streaming from topic to topic

2023-11-21 Thread megh vidani
Hi Alexander, Have you explored Spark or Flink? Thanks, Megh On Tue, Nov 21, 2023, 15:50 Alexander Shapiro (ashapiro) wrote: > Hi team! > > > I am looking for an open-source Tool with capability to stream Kafka > message from topic A to topic B with bellow conditions: > a. A an

Re: Messages streaming from topic to topic

2023-11-21 Thread megh vidani
t; Apache Samza > Apache Spark > Apache Flink > Apache NiFi > Confluent replicator > StreamSets Data collector > Envoy Filters > > > > > > -Original Message- > From: megh vidani > Sent: Tuesday, November 21, 2023 12:46 > To: users@kafka.apache.org &g

Re: Kafka 2.7.2 to 3.5.1 upgrade

2023-12-01 Thread megh vidani
Hi Lud, The topics for which you're seeing under replicated partitions, Did you try to increase the number of partitions anytime after creation of those topics before the upgrade? We have earlier faced issues with 2.8.0, in which we had increased the number of partitions for some topics, and for

Re: Kakfa Topic gets auto-created post deletion

2024-02-18 Thread megh vidani
Hi Abhishek, The consumer offsets get stored in the __consumer_offsets topic by the kafka brokers and don't get automatically deleted when you delete a topic. If you have auto.create.topics.enable set to true in your broker configs, th consumer automatically creates the topic again. You will have